-- Logs begin at Mon 2022-04-11 13:11:08 UTC, end at Mon 2022-04-11 14:13:34 UTC. -- Apr 11 13:40:37.731841 dv-cinder-830787-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Apr 11 13:40:37.742395 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 11 13:40:37.743309 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Apr 11 13:40:37 2022] *** Apr 11 13:40:37.743309 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 11 13:40:37.743309 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 11 13:40:37.743309 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: nodename: dv-cinder-830787-2-iscsi Apr 11 13:40:37.743309 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: machine: x86_64 Apr 11 13:40:37.743309 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: clock source: unix Apr 11 13:40:37.743309 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: pcre jit disabled Apr 11 13:40:37.743309 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: detected number of CPU cores: 4 Apr 11 13:40:37.743309 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: current working directory: / Apr 11 13:40:37.743309 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: detected binary path: /usr/bin/uwsgi-core Apr 11 13:40:37.743309 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: your processes number limit is 47680 Apr 11 13:40:37.743309 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: your memory page size is 4096 bytes Apr 11 13:40:37.743309 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: detected max file descriptor number: 2048 Apr 11 13:40:37.743309 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: lock engine: pthread robust mutexes Apr 11 13:40:37.743309 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: thunder lock: enabled Apr 11 13:40:37.745891 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 11 13:40:37.745891 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 11 13:40:37.790861 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: Python main interpreter initialized at 0x5577fa95e9c0 Apr 11 13:40:37.790861 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: python threads support enabled Apr 11 13:40:37.790861 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: your server socket listen backlog is limited to 100 connections Apr 11 13:40:37.790861 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: your mercy for graceful operations on workers is 90 seconds Apr 11 13:40:37.791203 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: mapped 403077 bytes (393 KB) for 2 cores Apr 11 13:40:37.791359 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: *** Operational MODE: preforking *** Apr 11 13:40:37.791589 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: *** uWSGI is running in multiple interpreter mode *** Apr 11 13:40:37.791589 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: spawned uWSGI master process (pid: 79770) Apr 11 13:40:37.794946 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: spawned uWSGI worker 1 (pid: 79785, cores: 1) Apr 11 13:40:37.791810 dv-cinder-830787-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Apr 11 13:40:37.795140 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: spawned uWSGI worker 2 (pid: 79786, cores: 1) Apr 11 13:40:37.795439 dv-cinder-830787-2-iscsi devstack@keystone.service[79770]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 11 13:40:43.699116 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 13:40:43.699116 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: from cryptography.utils import int_from_bytes Apr 11 13:40:43.700461 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 13:40:43.700461 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: from cryptography.utils import int_from_bytes Apr 11 13:40:43.700768 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 13:40:43.700768 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: from cryptography.utils import int_from_bytes Apr 11 13:40:43.701214 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 13:40:43.701214 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: from cryptography.utils import int_from_bytes Apr 11 13:40:43.753655 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 13:40:43.753828 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 13:40:43.754021 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 13:40:43.754132 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] command line args: [] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 13:40:43.754204 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 13:40:43.754353 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 13:40:43.754439 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] command line args: [] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 13:40:43.754505 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ================================================================================ {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 13:40:43.754641 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 13:40:43.754724 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] admin_token = **** {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.754796 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ================================================================================ {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 13:40:43.754968 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] config_dir = [] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.755058 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] admin_token = **** {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.755193 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.755271 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] config_dir = [] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.755330 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] config_source = [] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.755472 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.755549 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] debug = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.755713 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] config_source = [] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.755796 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.758168 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] debug = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.758168 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.758631 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.758631 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.759035 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.759035 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.759418 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.759594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.759843 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.760014 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.760206 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] list_limit = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.760435 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] list_limit = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.760605 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] log_config_append = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.760804 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] log_config_append = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.761013 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.761211 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.761401 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] log_dir = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.761627 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] log_dir = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.761835 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] log_file = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.762006 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] log_file = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.762203 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.762399 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.762591 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.762853 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.763023 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.763186 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.763317 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.763498 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.763659 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.763840 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.763986 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.764122 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.764252 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.764385 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.764550 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.764691 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.764828 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.764955 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.765082 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.765223 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.765358 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.765492 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.765620 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.765746 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.765903 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.766047 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.766188 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.766321 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.766449 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.766582 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.766712 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.766848 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.767000 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] publish_errors = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.767128 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] publish_errors = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.767262 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.767395 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.767527 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.767527 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.767820 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.767953 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.768095 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.768370 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.768583 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.768719 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] standard_threads = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.768853 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.769004 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.769134 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] standard_threads = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.769260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.769392 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.769518 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.769518 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] use_journal = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.769768 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.769896 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] use_json = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.770028 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.770161 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] use_stderr = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.770288 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] use_journal = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.770414 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] use_syslog = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.770548 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] use_json = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.770548 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] use_stderr = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.770811 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.770939 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] use_syslog = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.771065 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.771192 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 13:40:43.771325 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.771453 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.771579 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.771737 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.771874 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.772008 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.772147 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.772276 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.772402 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.772528 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.772662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.772869 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.773002 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.773129 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.773255 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.773388 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.773515 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.773649 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.773776 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.773915 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.774049 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.774182 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.774315 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.774461 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.774595 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.774723 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.774854 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.774982 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.775115 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.775253 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.775382 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.775515 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.775673 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.775808 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.775944 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.776081 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.776218 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.776347 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.776479 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.776606 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.776731 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.776865 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.777001 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.777134 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.777261 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.777393 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.777537 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.777673 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.777801 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.778084 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.778235 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.778365 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.778499 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.778639 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.778767 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.778898 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.779026 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.779158 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.779285 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.779486 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.779622 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.779817 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.779945 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.780082 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.780209 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.780347 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.780480 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.780609 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.780735 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.780860 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.780986 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.781120 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.781248 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.781380 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.781507 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.781634 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.781772 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.781913 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.782040 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.782166 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.782297 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.782424 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.782562 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.782691 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.782823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.782961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.783089 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.783221 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.783356 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.783489 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.784708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.784885 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.785080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.785272 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.785505 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.785670 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.785863 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.786086 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.786252 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.786450 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.786678 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.786877 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.787106 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.787308 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.787485 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.787728 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.787934 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.787934 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.788274 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.788504 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.788704 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.788870 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.789099 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.789265 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.789463 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.789656 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.789819 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.789992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.790135 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.790310 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.790440 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.790608 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.790750 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.790879 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.791006 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.791143 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.791303 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.791436 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.791572 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.791768 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.791909 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.792038 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.792178 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.792307 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.792439 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.792574 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.792735 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.792870 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.793011 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.793745 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.793912 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.794075 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.794234 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.794364 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.794520 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.794652 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.794779 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.794907 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.795034 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.795170 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.795374 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.795511 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.795668 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.795803 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.795932 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.796059 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.796263 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.796394 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.796533 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.796661 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.796787 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.796914 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.797049 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.797178 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.797305 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.797305 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.797547 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.797682 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.797811 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.797938 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.798065 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.798202 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.798330 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.798465 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.798593 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.798719 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.798846 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.798972 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.799098 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.799098 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.799355 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.799494 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.799623 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.799777 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.799904 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.799904 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.800155 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.800294 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.800422 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.800550 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.800676 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.800802 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.801001 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.801156 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.801295 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.801425 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.801553 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.801687 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.801815 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.801960 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.802138 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.802274 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.802403 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.802531 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.802659 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.802795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.802924 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] auth.external = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.803051 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.803178 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.803305 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] auth.external = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.803441 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.803580 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.803809 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.803953 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.804084 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] auth.password = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.804211 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.804346 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] auth.token = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.804474 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] auth.password = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.804602 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.804762 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] auth.token = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.804893 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.805021 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.805149 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.805276 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.805411 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.805541 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.805678 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.805808 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.805935 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.806062 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.806198 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.806326 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.806453 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] credential.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.806588 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.806716 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.806844 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] credential.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.806979 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.807108 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.807235 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.807372 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.807501 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.807646 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.807646 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.807912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.808040 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.808168 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.808295 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.808422 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.808558 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.808734 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.809438 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.809613 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.809745 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.809893 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.810035 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.810165 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.810293 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.810427 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.810556 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.810691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.810827 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.810957 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.811085 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.811212 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.811340 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.811467 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] federation.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.811612 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] federation.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.811769 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.811897 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.812026 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.812153 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.812279 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.812484 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.812615 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.812743 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.812879 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.813008 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.813137 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.813273 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.813409 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.813689 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.813842 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.813974 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.814103 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.814240 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.814370 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.814505 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.814633 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.814760 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.814887 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.815029 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.815160 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.815300 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.815441 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.815570 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.815743 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.815884 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.816014 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.816142 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.816142 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.816385 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.816513 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.816648 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.816778 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.816906 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.817034 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.817198 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.817353 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.817484 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.817618 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.817752 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.817881 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.818009 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.818152 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.818281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.818410 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.818539 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.818667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.818794 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.818929 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.819067 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.819201 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.819330 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.819460 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.819588 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.819766 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.819897 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.820032 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.820161 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.820289 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.820418 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.820554 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.820682 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.820810 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.820957 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.821086 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.821214 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.821355 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.821486 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.821614 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.821742 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.821870 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.821997 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.822132 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.822260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.822388 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.822522 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.822662 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.822791 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.822927 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.823055 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.823190 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.823318 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.823462 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.823593 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.823757 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.823888 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.824016 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.824143 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.824284 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.824423 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.824569 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.824700 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.824828 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.824956 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.825102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.825330 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.825488 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.825621 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.825751 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.825878 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.826013 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.826143 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.826279 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.826409 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.826547 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.826683 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.826813 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.826941 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.827081 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.827217 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.827346 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.827474 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.827602 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.827792 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.827934 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.828064 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.828192 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.828331 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.828460 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.828587 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.828723 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.829116 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.829246 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.829374 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.829503 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.829631 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.829769 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.829899 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.830028 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.830156 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.830290 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.830435 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.830573 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.830702 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.830830 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.830959 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.831087 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.831223 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.831351 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.831480 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.831608 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.831760 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.831889 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.832029 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.832159 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.832300 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.832428 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.832556 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.832685 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.832820 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.832949 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.833077 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.833205 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.833339 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.833473 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.833610 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.833740 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.833866 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.834004 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.834133 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.834261 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.834397 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.834526 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.834659 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.834788 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.834788 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.835030 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.835167 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.835296 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.835431 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.835565 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.835762 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.835903 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.836043 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.836174 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.836302 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.836437 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.836571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.836704 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.836847 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.836983 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.837124 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.837260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.837394 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.837529 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.837672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.837672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.837939 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.838074 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.838208 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.838344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.838552 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.838690 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] resource.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.838825 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.838960 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.839094 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.839229 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.839372 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] resource.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.839508 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.839672 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.839815 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.839987 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.840130 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.840277 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.840415 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.840549 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.840684 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.840818 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.840953 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.841096 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.841231 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.841368 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.841502 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] role.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.841647 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.841782 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] role.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.841929 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.842064 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.842199 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] role.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.842334 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.842469 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] role.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.842604 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.842747 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.842883 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.843017 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.843151 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.843285 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.843431 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.843587 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.843748 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.843886 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.844020 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.844154 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.844294 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.844443 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.844581 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.844716 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.844851 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.844986 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.845121 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.845269 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.845416 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.845552 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.845686 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.845821 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.845964 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.846100 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.846234 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.846368 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.846502 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.846502 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.846765 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.846765 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.847022 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.847167 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.847301 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.847301 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.847564 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.847751 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.847888 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.848023 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.848260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.848416 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.848567 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.848705 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.848840 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.848973 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.849119 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.849254 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.849397 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.849533 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.849668 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.849803 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.849937 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.850071 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.850214 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.850350 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.850484 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.850619 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.850753 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.850888 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.851040 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.851177 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] token.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.851311 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.851446 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.851581 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.851754 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.851903 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.852040 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.852174 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] token.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.852308 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.852442 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.852585 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.852721 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.852865 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.853001 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.853135 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.853269 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.853423 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.853560 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.853694 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.853828 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.853963 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.854097 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.854240 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.854376 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.854510 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.854644 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.854788 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.854923 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.855065 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.855201 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.855335 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.855468 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.856161 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.856307 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.856456 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.856628 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.856771 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.connection = **** {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.856918 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.857063 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.857201 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.857350 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.857486 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.857630 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.857767 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.connection = **** {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.857910 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.858055 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.858192 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.858327 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.858462 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.858606 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.858742 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.858878 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.859013 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.859148 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.859295 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.859440 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.859577 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.859769 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.859907 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.860043 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.860178 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.860323 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.860459 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.860594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.860729 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.860865 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.861000 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.861222 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.861362 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.861498 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.861633 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.861633 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.861889 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.862032 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 13:40:43.862170 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.862170 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.862170 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.862170 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 13:40:43.862170 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 13:40:43.871052 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:43.871282 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:43.871981 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:43.872123 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:43.872263 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:43.872416 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:43.880648 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:43.880811 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:43.909260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:43.909499 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:43.909698 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:43.909855 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:43.966714 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:43.966977 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.016358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.016672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.017906 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.018145 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.085430 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.085713 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.085865 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.086031 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.086190 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.086330 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.086466 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.086601 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.086746 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.086884 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.087019 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.087019 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.111014 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.111242 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.111400 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.111539 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.111703 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.111853 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.111993 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.112143 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.112282 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.112418 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.112554 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.112690 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.112836 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.112986 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.123674 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.124446 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.136291 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.136505 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.136753 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.137032 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.137183 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.137321 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.137458 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.137604 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.137755 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.137892 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.137892 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79786) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.138151 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.138151 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.138151 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 13:40:44.155242 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.155453 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 11 13:40:44.155812 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.156017 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 11 13:40:44.156162 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.156312 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 11 13:40:44.156448 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.156583 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.156717 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.156862 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 11 13:40:44.156998 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.156998 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.157255 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.157255 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.157529 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.157734 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.167875 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.168793 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.169002 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.169283 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.169440 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.169681 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.169950 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.170231 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.177328 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.178336 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.180620 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.181008 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.181291 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.181573 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.181728 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.181866 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.182013 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.182151 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.182286 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.182422 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.182567 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.182705 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.182851 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.182987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.183123 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.183268 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.183405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.183540 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.183724 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.183870 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.184140 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.184407 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.210017 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.211614 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.211795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.211934 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.213245 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.213526 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.217729 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.217961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.218240 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.219321 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.219599 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.219903 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.225503 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.225782 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.228813 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.229098 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.230375 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.231221 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.231481 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.231786 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.232061 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.232333 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.232602 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.232869 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.234262 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.234553 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.234836 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.235117 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.235391 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.235683 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.235960 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.236229 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.251931 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.252202 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.255044 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.255324 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.256749 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.259911 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.260382 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.260676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.263587 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.263905 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.265858 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.268921 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.271008 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.274089 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.274675 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.274975 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.275257 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.275537 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.275903 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.276180 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.278593 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.279074 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.279429 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.279739 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.280019 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.280297 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.401753 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.402060 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.402336 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.403020 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.403185 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.403308 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.403545 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.403908 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.411007 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.411665 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.412732 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.413010 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.413369 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.413644 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.416046 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.416334 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.416700 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.416848 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.416988 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.417141 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.417326 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.417472 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.417692 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.417971 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.431662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.431862 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.432008 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.432155 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.432302 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.432443 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.432582 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.432722 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.432862 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.433009 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.433149 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.433288 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.433438 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.433576 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.451824 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.452275 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.455338 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.455801 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.458704 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.459125 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.460346 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.460769 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.462098 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.462377 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.462523 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.462683 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.462825 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.463061 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.470677 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.471223 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.472263 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.472864 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.475478 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.475794 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.476096 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.476242 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.476393 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.476534 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.476672 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.476943 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.485736 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.486026 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.486308 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.486460 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.486693 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.486984 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.494299 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79786) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.494582 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.494862 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.495033 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 13:40:44.495181 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.495322 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.495469 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.495609 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.495785 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.495935 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.496073 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.496222 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.496362 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.496500 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.496647 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.496842 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.497012 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.497161 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.497301 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.497439 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.497606 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.497755 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.497896 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.498034 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.498171 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79786) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.498309 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.498508 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.498772 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 13:40:44.536854 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5577fa95e9c0 pid: 79786 (default app) Apr 11 13:40:44.537806 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5577fa95e9c0 pid: 79785 (default app) Apr 11 13:40:44.540351 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f27dd-3225-48f2-9bd7-e9ded0921f38 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:40:44.540652 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f27dd-3225-48f2-9bd7-e9ded0921f38 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:40:44.540934 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f27dd-3225-48f2-9bd7-e9ded0921f38 None None] PATH_INFO: `/v3` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:40:44.545290 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 791 bytes} [Mon Apr 11 13:40:44 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:40:52.981450 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5230ab8-5698-4202-b1c5-1a067bfd9d28 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:40:52.982022 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5230ab8-5698-4202-b1c5-1a067bfd9d28 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:40:52.982022 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5230ab8-5698-4202-b1c5-1a067bfd9d28 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:40:52.986289 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1/2] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:40:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:40:52.991521 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e0fc5-533f-4028-abfe-0434b0d753c5 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:40:52.991967 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e0fc5-533f-4028-abfe-0434b0d753c5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:40:52.992138 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e0fc5-533f-4028-abfe-0434b0d753c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:40:53.023161 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG oslo_db.sqlalchemy.engines [None req-bd3e0fc5-533f-4028-abfe-0434b0d753c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 13:40:53.212739 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG passlib.handlers.bcrypt [None req-bd3e0fc5-533f-4028-abfe-0434b0d753c5 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79786) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 11 13:40:53.213153 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG passlib.handlers.bcrypt [None req-bd3e0fc5-533f-4028-abfe-0434b0d753c5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79786) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 11 13:40:53.268862 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-bd3e0fc5-533f-4028-abfe-0434b0d753c5 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:40:53.270411 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-bd3e0fc5-533f-4028-abfe-0434b0d753c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:40:53.392855 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 2/3] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:40:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Apr 11 13:40:53.550665 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5230ab8-5698-4202-b1c5-1a067bfd9d28 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:40:53.584013 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG oslo_db.sqlalchemy.engines [None req-b5230ab8-5698-4202-b1c5-1a067bfd9d28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79785) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 13:40:53.712562 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5230ab8-5698-4202-b1c5-1a067bfd9d28 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:40:53.716904 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef418720-d75f-483b-b7ac-135211c655cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:40:53.717569 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef418720-d75f-483b-b7ac-135211c655cc admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:40:53.717853 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef418720-d75f-483b-b7ac-135211c655cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:40:53.718130 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef418720-d75f-483b-b7ac-135211c655cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:40:53.726543 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef418720-d75f-483b-b7ac-135211c655cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:40:53.776894 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ef418720-d75f-483b-b7ac-135211c655cc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 11 13:40:53.777900 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef418720-d75f-483b-b7ac-135211c655cc admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:40:53.788233 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 2/4] 10.222.0.67 () {58 vars in 1324 bytes} [Mon Apr 11 13:40:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 11 13:40:53.795816 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e0fc5-533f-4028-abfe-0434b0d753c5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:40:53.810715 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e0fc5-533f-4028-abfe-0434b0d753c5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:40:53.815081 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abca6f-bd2e-47eb-a7aa-50c62c8438da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:40:53.816236 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abca6f-bd2e-47eb-a7aa-50c62c8438da admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:40:53.816523 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abca6f-bd2e-47eb-a7aa-50c62c8438da admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:40:53.816798 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abca6f-bd2e-47eb-a7aa-50c62c8438da admin admin] PATH_INFO: `/v3/projects/8ea005f626c8456495dc1d10183dc603` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:40:53.818323 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abca6f-bd2e-47eb-a7aa-50c62c8438da admin admin] RBAC: Authorizing `identity:get_project(project_id=8ea005f626c8456495dc1d10183dc603)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:40:53.869943 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.common.rbac_enforcer.enforcer [None req-60abca6f-bd2e-47eb-a7aa-50c62c8438da admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 11 13:40:53.870292 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abca6f-bd2e-47eb-a7aa-50c62c8438da admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:40:53.875582 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 3/5] 10.222.0.67 () {56 vars in 1207 bytes} [Mon Apr 11 13:40:53 2022] GET /identity/v3/projects/8ea005f626c8456495dc1d10183dc603 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:40:56.156952 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768ac43-4cc2-44aa-be33-0c718bacf834 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:40:56.157478 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768ac43-4cc2-44aa-be33-0c718bacf834 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:40:56.157569 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768ac43-4cc2-44aa-be33-0c718bacf834 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:40:56.161594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 3/6] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:40:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:40:56.167098 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757020cc-2be4-4390-a9c7-b15efbca5c51 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:40:56.167523 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757020cc-2be4-4390-a9c7-b15efbca5c51 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:40:56.167783 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757020cc-2be4-4390-a9c7-b15efbca5c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:40:56.186418 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-757020cc-2be4-4390-a9c7-b15efbca5c51 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:40:56.187960 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-757020cc-2be4-4390-a9c7-b15efbca5c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:40:56.195684 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 4/7] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:40:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 11 13:40:56.219023 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768ac43-4cc2-44aa-be33-0c718bacf834 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:40:56.230917 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768ac43-4cc2-44aa-be33-0c718bacf834 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:40:56.235089 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12acb6c-e29d-4393-97df-3b787194bed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:40:56.235752 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12acb6c-e29d-4393-97df-3b787194bed0 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:40:56.236039 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12acb6c-e29d-4393-97df-3b787194bed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:40:56.236315 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12acb6c-e29d-4393-97df-3b787194bed0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:40:56.244719 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12acb6c-e29d-4393-97df-3b787194bed0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:40:56.246606 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12acb6c-e29d-4393-97df-3b787194bed0 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:40:56.255477 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 4/8] 10.222.0.67 () {58 vars in 1324 bytes} [Mon Apr 11 13:40:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:40:56.262822 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757020cc-2be4-4390-a9c7-b15efbca5c51 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:40:56.271703 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757020cc-2be4-4390-a9c7-b15efbca5c51 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:40:56.276080 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee9116-656e-4309-a2dd-4ebfcc3a79d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:40:56.276963 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee9116-656e-4309-a2dd-4ebfcc3a79d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:40:56.277435 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee9116-656e-4309-a2dd-4ebfcc3a79d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:40:56.277818 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee9116-656e-4309-a2dd-4ebfcc3a79d4 admin admin] PATH_INFO: `/v3/users/a8b5e2d388d34b24a1ace24c7c6fb803` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:40:56.279215 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee9116-656e-4309-a2dd-4ebfcc3a79d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=a8b5e2d388d34b24a1ace24c7c6fb803)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:40:56.281066 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee9116-656e-4309-a2dd-4ebfcc3a79d4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:40:56.282790 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 5/9] 10.222.0.67 () {56 vars in 1198 bytes} [Mon Apr 11 13:40:56 2022] GET /identity/v3/users/a8b5e2d388d34b24a1ace24c7c6fb803 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:40:58.672581 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903ca4a-d720-438c-91ea-3e3d520f5012 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:40:58.673080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903ca4a-d720-438c-91ea-3e3d520f5012 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:40:58.673080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903ca4a-d720-438c-91ea-3e3d520f5012 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:40:58.674394 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 5/10] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:40:58.679723 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187fab3-bdd8-4660-bbfa-44aa7a9597f7 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:40:58.680152 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187fab3-bdd8-4660-bbfa-44aa7a9597f7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:40:58.680285 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187fab3-bdd8-4660-bbfa-44aa7a9597f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:40:58.682680 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcae78-bd24-421e-a7df-36d534fc4a2e None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:40:58.682961 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcae78-bd24-421e-a7df-36d534fc4a2e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:40:58.683381 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcae78-bd24-421e-a7df-36d534fc4a2e None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:40:58.684649 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 6/11] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:40:58.689740 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180640d-186d-45d6-965d-5356992a2f60 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:40:58.690032 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180640d-186d-45d6-965d-5356992a2f60 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:40:58.690323 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180640d-186d-45d6-965d-5356992a2f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:40:58.696744 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-f187fab3-bdd8-4660-bbfa-44aa7a9597f7 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:40:58.697947 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f187fab3-bdd8-4660-bbfa-44aa7a9597f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:40:58.730789 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG passlib.handlers.bcrypt [None req-1180640d-186d-45d6-965d-5356992a2f60 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79785) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 11 13:40:58.731212 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG passlib.handlers.bcrypt [None req-1180640d-186d-45d6-965d-5356992a2f60 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79785) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 11 13:40:58.776527 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 6/12] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:40:58.778441 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-1180640d-186d-45d6-965d-5356992a2f60 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:40:58.780090 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1180640d-186d-45d6-965d-5356992a2f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:40:58.801931 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187fab3-bdd8-4660-bbfa-44aa7a9597f7 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:40:58.876066 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 7/13] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:40:58.898166 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187fab3-bdd8-4660-bbfa-44aa7a9597f7 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:40:58.898454 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180640d-186d-45d6-965d-5356992a2f60 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:40:58.930419 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12848046-f15c-4a6f-a478-5edfa4ac2a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:40:58.931147 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12848046-f15c-4a6f-a478-5edfa4ac2a14 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:40:58.931421 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12848046-f15c-4a6f-a478-5edfa4ac2a14 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:40:58.931720 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12848046-f15c-4a6f-a478-5edfa4ac2a14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:40:58.942675 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12848046-f15c-4a6f-a478-5edfa4ac2a14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:40:58.950359 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-12848046-f15c-4a6f-a478-5edfa4ac2a14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:40:58.951571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 7/14] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:40:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:40:58.957557 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12848046-f15c-4a6f-a478-5edfa4ac2a14 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:40:58.996563 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180640d-186d-45d6-965d-5356992a2f60 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:40:59.029087 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca5306-2ee2-435a-8a63-afd5c9f3e8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:40:59.029984 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca5306-2ee2-435a-8a63-afd5c9f3e8bf None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:40:59.030271 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca5306-2ee2-435a-8a63-afd5c9f3e8bf None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:40:59.030551 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca5306-2ee2-435a-8a63-afd5c9f3e8bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:40:59.061401 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12848046-f15c-4a6f-a478-5edfa4ac2a14 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:40:59.093384 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efe6f4-6673-4112-8166-e47395e22a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:40:59.094044 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efe6f4-6673-4112-8166-e47395e22a7e None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:40:59.094199 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca5306-2ee2-435a-8a63-afd5c9f3e8bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:40:59.094327 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efe6f4-6673-4112-8166-e47395e22a7e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:40:59.094601 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efe6f4-6673-4112-8166-e47395e22a7e None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:40:59.095351 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efe6f4-6673-4112-8166-e47395e22a7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:40:59.095684 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efe6f4-6673-4112-8166-e47395e22a7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:40:59.095810 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca5306-2ee2-435a-8a63-afd5c9f3e8bf None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:40:59.097063 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efe6f4-6673-4112-8166-e47395e22a7e None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:40:59.108609 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 8/15] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:40:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:40:59.114093 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efe6f4-6673-4112-8166-e47395e22a7e None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:40:59.187440 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 8/16] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:40:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 13:40:59.194334 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca5306-2ee2-435a-8a63-afd5c9f3e8bf None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:40:59.207658 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efe6f4-6673-4112-8166-e47395e22a7e None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:40:59.238640 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5b130-3d8c-4f61-bbd3-77126cfa85aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:40:59.239499 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5b130-3d8c-4f61-bbd3-77126cfa85aa None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:40:59.239821 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5b130-3d8c-4f61-bbd3-77126cfa85aa None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:40:59.240099 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5b130-3d8c-4f61-bbd3-77126cfa85aa None admin] PATH_INFO: `/v3/users/a8b5e2d388d34b24a1ace24c7c6fb803` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:40:59.241279 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5b130-3d8c-4f61-bbd3-77126cfa85aa None admin] RBAC: Authorizing `identity:get_user(user_id=a8b5e2d388d34b24a1ace24c7c6fb803)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:40:59.242733 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5b130-3d8c-4f61-bbd3-77126cfa85aa None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:40:59.244368 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 9/17] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:40:59 2022] GET /identity/v3/users/a8b5e2d388d34b24a1ace24c7c6fb803 => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:40:59.250215 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5b130-3d8c-4f61-bbd3-77126cfa85aa None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:40:59.286118 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca5306-2ee2-435a-8a63-afd5c9f3e8bf None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:40:59.318382 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddf1bc-da39-41a9-8f1d-4b941f15ebe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:40:59.319178 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddf1bc-da39-41a9-8f1d-4b941f15ebe2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:40:59.319463 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddf1bc-da39-41a9-8f1d-4b941f15ebe2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:40:59.319771 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddf1bc-da39-41a9-8f1d-4b941f15ebe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:40:59.338180 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fddf1bc-da39-41a9-8f1d-4b941f15ebe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:40:59.340220 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fddf1bc-da39-41a9-8f1d-4b941f15ebe2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:40:59.342549 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5b130-3d8c-4f61-bbd3-77126cfa85aa None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:40:59.357657 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-4fddf1bc-da39-41a9-8f1d-4b941f15ebe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:40:59.358876 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 9/18] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:40:59.364547 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddf1bc-da39-41a9-8f1d-4b941f15ebe2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:40:59.374720 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a8333-c6bf-441e-8f59-4584d65fd740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:40:59.375516 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a8333-c6bf-441e-8f59-4584d65fd740 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:40:59.375827 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a8333-c6bf-441e-8f59-4584d65fd740 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:40:59.376105 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a8333-c6bf-441e-8f59-4584d65fd740 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:40:59.377280 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a8333-c6bf-441e-8f59-4584d65fd740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:40:59.378751 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a8333-c6bf-441e-8f59-4584d65fd740 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:40:59.380424 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 10/19] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:40:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:40:59.385962 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a8333-c6bf-441e-8f59-4584d65fd740 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:40:59.461515 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddf1bc-da39-41a9-8f1d-4b941f15ebe2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:40:59.478752 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a8333-c6bf-441e-8f59-4584d65fd740 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:40:59.493223 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93057efa-ce17-40bc-9dd5-1fcfbc5cb738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:40:59.493892 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93057efa-ce17-40bc-9dd5-1fcfbc5cb738 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:40:59.494176 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93057efa-ce17-40bc-9dd5-1fcfbc5cb738 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:40:59.494453 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93057efa-ce17-40bc-9dd5-1fcfbc5cb738 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:40:59.495172 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93057efa-ce17-40bc-9dd5-1fcfbc5cb738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:40:59.495479 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93057efa-ce17-40bc-9dd5-1fcfbc5cb738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:40:59.497038 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93057efa-ce17-40bc-9dd5-1fcfbc5cb738 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:40:59.512294 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0fb88-2b25-4089-9c51-e9f1e4de7296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:40:59.513049 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0fb88-2b25-4089-9c51-e9f1e4de7296 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:40:59.513372 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0fb88-2b25-4089-9c51-e9f1e4de7296 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:40:59.513655 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0fb88-2b25-4089-9c51-e9f1e4de7296 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:40:59.514496 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0fb88-2b25-4089-9c51-e9f1e4de7296 None admin] RBAC: Adding query filter params (role.id=e3333fcf22b040e3a1f0bfbfe657cffa, scope.domain.id=default, user.id=a8b5e2d388d34b24a1ace24c7c6fb803) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:40:59.514811 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0fb88-2b25-4089-9c51-e9f1e4de7296 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:40:59.515544 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 10/20] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:40:59.516328 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0fb88-2b25-4089-9c51-e9f1e4de7296 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:40:59.523375 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 11/21] 10.222.0.67 () {56 vars in 1322 bytes} [Mon Apr 11 13:40:59 2022] GET /identity/v3/role_assignments?user.id=a8b5e2d388d34b24a1ace24c7c6fb803&scope.domain.id=default&role.id=e3333fcf22b040e3a1f0bfbfe657cffa => generated 233 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:02.252963 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca1273-7ad3-492f-83f8-87dff6a44a40 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:02.253998 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca1273-7ad3-492f-83f8-87dff6a44a40 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:02.254485 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca1273-7ad3-492f-83f8-87dff6a44a40 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:02.256093 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 11/22] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:02.273367 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39f131-71a5-4344-b14e-2fc440dc9f67 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:02.274282 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39f131-71a5-4344-b14e-2fc440dc9f67 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:02.274752 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39f131-71a5-4344-b14e-2fc440dc9f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:02.298453 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-cb39f131-71a5-4344-b14e-2fc440dc9f67 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:02.299981 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-cb39f131-71a5-4344-b14e-2fc440dc9f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:02.320346 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21423e-760b-45f0-ad80-11c293c4821f None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:02.320972 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21423e-760b-45f0-ad80-11c293c4821f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:02.321469 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21423e-760b-45f0-ad80-11c293c4821f None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:02.323232 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 12/23] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:02.329079 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9471155-4b60-4ace-b82f-fff77cee7ce3 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:02.329621 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9471155-4b60-4ace-b82f-fff77cee7ce3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:02.330118 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9471155-4b60-4ace-b82f-fff77cee7ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:02.360651 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a9471155-4b60-4ace-b82f-fff77cee7ce3 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:02.362226 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a9471155-4b60-4ace-b82f-fff77cee7ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:02.390202 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 12/24] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:02.451532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39f131-71a5-4344-b14e-2fc440dc9f67 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:02.506417 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 13/25] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:41:02.520558 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5413a75-0324-4f0d-81fd-178e5130bb9b None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:02.520847 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5413a75-0324-4f0d-81fd-178e5130bb9b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:02.521136 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5413a75-0324-4f0d-81fd-178e5130bb9b None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:02.522731 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 14/26] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:02.545977 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96a957-9d06-4c23-a55c-a1d64a409733 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:02.546268 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96a957-9d06-4c23-a55c-a1d64a409733 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:02.546548 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96a957-9d06-4c23-a55c-a1d64a409733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:02.572309 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39f131-71a5-4344-b14e-2fc440dc9f67 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:02.581736 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-3b96a957-9d06-4c23-a55c-a1d64a409733 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:02.583264 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3b96a957-9d06-4c23-a55c-a1d64a409733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:02.613961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f63f8-a245-4dc1-a535-ea2da04e7baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:02.614763 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f63f8-a245-4dc1-a535-ea2da04e7baf None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:02.615046 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f63f8-a245-4dc1-a535-ea2da04e7baf None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:02.615319 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f63f8-a245-4dc1-a535-ea2da04e7baf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:02.633465 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f63f8-a245-4dc1-a535-ea2da04e7baf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:02.636677 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f63f8-a245-4dc1-a535-ea2da04e7baf None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:02.658104 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-5d3f63f8-a245-4dc1-a535-ea2da04e7baf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:41:02.659612 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 13/27] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:41:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:41:02.672900 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f63f8-a245-4dc1-a535-ea2da04e7baf None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:02.742294 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 15/28] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:41:02.743272 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96a957-9d06-4c23-a55c-a1d64a409733 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:02.786875 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f63f8-a245-4dc1-a535-ea2da04e7baf None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:02.832749 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9a7f6-7f25-4d11-8c46-ec26e70ea4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:02.833855 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9a7f6-7f25-4d11-8c46-ec26e70ea4c7 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:02.834287 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9a7f6-7f25-4d11-8c46-ec26e70ea4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:02.834705 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9a7f6-7f25-4d11-8c46-ec26e70ea4c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:02.863220 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9a7f6-7f25-4d11-8c46-ec26e70ea4c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:02.877307 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-cdf9a7f6-7f25-4d11-8c46-ec26e70ea4c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:41:02.879662 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 14/29] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:41:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:02.882138 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9a7f6-7f25-4d11-8c46-ec26e70ea4c7 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:02.929241 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96a957-9d06-4c23-a55c-a1d64a409733 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:02.974574 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ee2e2-5e72-4753-85db-60399d655d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:02.975492 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ee2e2-5e72-4753-85db-60399d655d74 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:02.977378 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ee2e2-5e72-4753-85db-60399d655d74 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:02.980535 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ee2e2-5e72-4753-85db-60399d655d74 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:02.981485 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ee2e2-5e72-4753-85db-60399d655d74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:02.981939 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ee2e2-5e72-4753-85db-60399d655d74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:02.983473 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ee2e2-5e72-4753-85db-60399d655d74 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:03.011469 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 16/30] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:03.012587 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ee2e2-5e72-4753-85db-60399d655d74 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:03.130009 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ee2e2-5e72-4753-85db-60399d655d74 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:03.139961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9a7f6-7f25-4d11-8c46-ec26e70ea4c7 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:03.173655 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d24d42-8030-45dd-af91-de0c4e31d44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:03.174701 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d24d42-8030-45dd-af91-de0c4e31d44b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:03.175218 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d24d42-8030-45dd-af91-de0c4e31d44b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:03.175696 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d24d42-8030-45dd-af91-de0c4e31d44b None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:03.177891 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d24d42-8030-45dd-af91-de0c4e31d44b None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:03.178379 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d24d42-8030-45dd-af91-de0c4e31d44b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:03.180980 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d24d42-8030-45dd-af91-de0c4e31d44b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:03.204361 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 17/31] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:03.205707 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d24d42-8030-45dd-af91-de0c4e31d44b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:03.240367 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19174f47-44d6-4484-8a72-74995169dd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:03.241053 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19174f47-44d6-4484-8a72-74995169dd64 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:03.241344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19174f47-44d6-4484-8a72-74995169dd64 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:03.241626 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19174f47-44d6-4484-8a72-74995169dd64 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:03.242398 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19174f47-44d6-4484-8a72-74995169dd64 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:03.243842 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19174f47-44d6-4484-8a72-74995169dd64 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:03.318546 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d24d42-8030-45dd-af91-de0c4e31d44b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:03.353177 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641f688-cf28-4e69-a83b-1e281a51fa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:03.353845 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641f688-cf28-4e69-a83b-1e281a51fa26 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:03.354129 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641f688-cf28-4e69-a83b-1e281a51fa26 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:03.354404 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641f688-cf28-4e69-a83b-1e281a51fa26 None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:03.355918 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641f688-cf28-4e69-a83b-1e281a51fa26 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:03.357345 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641f688-cf28-4e69-a83b-1e281a51fa26 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:03.401727 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 15/32] 10.222.0.67 () {60 vars in 1131 bytes} [Mon Apr 11 13:41:02 2022] POST /identity/v3/roles => generated 219 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:41:03.403194 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19174f47-44d6-4484-8a72-74995169dd64 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:03.504098 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 18/33] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Apr 11 13:41:03 2022] POST /identity/v3/projects => generated 301 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:41:03.506224 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7892ee8-8dfd-49bf-873d-b13f1a6e8192 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:03.506636 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7892ee8-8dfd-49bf-873d-b13f1a6e8192 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:03.507025 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7892ee8-8dfd-49bf-873d-b13f1a6e8192 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:03.508604 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 19/34] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:03.519657 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81354827-2d2b-42f0-9664-ec4476ee3a99 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:03.519848 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19174f47-44d6-4484-8a72-74995169dd64 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:03.520680 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81354827-2d2b-42f0-9664-ec4476ee3a99 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:03.521180 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81354827-2d2b-42f0-9664-ec4476ee3a99 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:03.523203 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 20/35] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:03 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:03.524697 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434abfe-3f4a-45d3-b8c0-b309b3f454d2 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:03.525201 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434abfe-3f4a-45d3-b8c0-b309b3f454d2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:03.525705 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434abfe-3f4a-45d3-b8c0-b309b3f454d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:03.554316 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e565e78-83a5-471d-8214-83369f4bb256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:03.555223 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e565e78-83a5-471d-8214-83369f4bb256 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:03.555511 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e565e78-83a5-471d-8214-83369f4bb256 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:03.555821 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e565e78-83a5-471d-8214-83369f4bb256 None admin] PATH_INFO: `/v3/users/a8b5e2d388d34b24a1ace24c7c6fb803` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:03.557434 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e565e78-83a5-471d-8214-83369f4bb256 None admin] RBAC: Authorizing `identity:get_user(user_id=a8b5e2d388d34b24a1ace24c7c6fb803)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:03.558306 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c434abfe-3f4a-45d3-b8c0-b309b3f454d2 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:03.559750 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e565e78-83a5-471d-8214-83369f4bb256 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:03.560219 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c434abfe-3f4a-45d3-b8c0-b309b3f454d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:03.562329 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 16/36] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:03 2022] GET /identity/v3/users/a8b5e2d388d34b24a1ace24c7c6fb803 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:03.568388 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdec1b0-69a3-4e9d-98a2-96f58c5ac3dd None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:03.568953 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdec1b0-69a3-4e9d-98a2-96f58c5ac3dd None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:03.569391 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdec1b0-69a3-4e9d-98a2-96f58c5ac3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:03.591342 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-5fdec1b0-69a3-4e9d-98a2-96f58c5ac3dd None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:03.593244 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5fdec1b0-69a3-4e9d-98a2-96f58c5ac3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:03.677388 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 17/37] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:03.678668 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdec1b0-69a3-4e9d-98a2-96f58c5ac3dd None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:03.693276 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 21/38] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:03.709965 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434abfe-3f4a-45d3-b8c0-b309b3f454d2 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:03.810346 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdec1b0-69a3-4e9d-98a2-96f58c5ac3dd None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:03.826240 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434abfe-3f4a-45d3-b8c0-b309b3f454d2 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:03.857944 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c4009-c339-45e2-b314-79085be75999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:03.858764 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c4009-c339-45e2-b314-79085be75999 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:03.859105 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c4009-c339-45e2-b314-79085be75999 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:03.859429 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c4009-c339-45e2-b314-79085be75999 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:03.860676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c4009-c339-45e2-b314-79085be75999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:03.862319 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c4009-c339-45e2-b314-79085be75999 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:03.864167 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 18/39] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:41:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:03.865188 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c4009-c339-45e2-b314-79085be75999 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:03.867955 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef659546-7e82-46b9-b762-2580f33584ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:03.868643 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef659546-7e82-46b9-b762-2580f33584ee None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:03.868932 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef659546-7e82-46b9-b762-2580f33584ee None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:03.869214 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef659546-7e82-46b9-b762-2580f33584ee None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:03.870050 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef659546-7e82-46b9-b762-2580f33584ee None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:03.872537 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef659546-7e82-46b9-b762-2580f33584ee None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:03.890751 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 22/40] 10.222.0.67 () {60 vars in 1131 bytes} [Mon Apr 11 13:41:03 2022] POST /identity/v3/roles => generated 223 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:41:03.896553 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef659546-7e82-46b9-b762-2580f33584ee None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:03.996357 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c4009-c339-45e2-b314-79085be75999 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:04.023831 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef659546-7e82-46b9-b762-2580f33584ee None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:04.031415 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e786c6-b359-4564-85ce-8e7ffc00481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:04.032136 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e786c6-b359-4564-85ce-8e7ffc00481b None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:04.032425 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e786c6-b359-4564-85ce-8e7ffc00481b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:04.032706 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e786c6-b359-4564-85ce-8e7ffc00481b None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:04.033473 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e786c6-b359-4564-85ce-8e7ffc00481b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:04.034925 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e786c6-b359-4564-85ce-8e7ffc00481b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:04.050417 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 19/41] 10.222.0.67 () {60 vars in 1131 bytes} [Mon Apr 11 13:41:03 2022] POST /identity/v3/roles => generated 225 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:41:04.052289 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073ae32-d12c-4508-8e6b-7cab14e1e66f None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:04.052756 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073ae32-d12c-4508-8e6b-7cab14e1e66f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:04.053210 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073ae32-d12c-4508-8e6b-7cab14e1e66f None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:04.055087 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 20/42] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:04.061090 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc8608-a8cc-4d74-aff3-bbe9755ec701 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:04.061997 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc8608-a8cc-4d74-aff3-bbe9755ec701 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:04.062283 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc8608-a8cc-4d74-aff3-bbe9755ec701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:04.076270 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc38d85-cc50-41cb-8ee0-f359cf1b0274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:04.077298 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc38d85-cc50-41cb-8ee0-f359cf1b0274 None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:04.077634 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc38d85-cc50-41cb-8ee0-f359cf1b0274 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:04.077973 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc38d85-cc50-41cb-8ee0-f359cf1b0274 None admin] PATH_INFO: `/v3/domains/default/users/a8b5e2d388d34b24a1ace24c7c6fb803/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:04.081076 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc38d85-cc50-41cb-8ee0-f359cf1b0274 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a8b5e2d388d34b24a1ace24c7c6fb803, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:04.082895 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc38d85-cc50-41cb-8ee0-f359cf1b0274 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:04.088983 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-8bdc8608-a8cc-4d74-aff3-bbe9755ec701 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:04.091794 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-8bdc8608-a8cc-4d74-aff3-bbe9755ec701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:04.101803 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 23/43] 10.222.0.67 () {58 vars in 1361 bytes} [Mon Apr 11 13:41:03 2022] PUT /identity/v3/domains/default/users/a8b5e2d388d34b24a1ace24c7c6fb803/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:41:04.187437 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 21/44] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:04.213612 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc38d85-cc50-41cb-8ee0-f359cf1b0274 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:04.323751 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc38d85-cc50-41cb-8ee0-f359cf1b0274 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:04.357578 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478fc964-ebad-4f56-9a1a-8bb87a721880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:04.358382 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fc964-ebad-4f56-9a1a-8bb87a721880 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:04.358670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fc964-ebad-4f56-9a1a-8bb87a721880 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:04.358951 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fc964-ebad-4f56-9a1a-8bb87a721880 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:04.360136 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478fc964-ebad-4f56-9a1a-8bb87a721880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:04.361590 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478fc964-ebad-4f56-9a1a-8bb87a721880 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:04.363214 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 24/45] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:41:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:04.368771 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc8608-a8cc-4d74-aff3-bbe9755ec701 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:04.464813 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc8608-a8cc-4d74-aff3-bbe9755ec701 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:04.496962 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e086d82-540d-466d-b8c3-0c2abcfa38ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:04.497711 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e086d82-540d-466d-b8c3-0c2abcfa38ae None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:04.498067 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e086d82-540d-466d-b8c3-0c2abcfa38ae None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:04.498444 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e086d82-540d-466d-b8c3-0c2abcfa38ae None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:04.499234 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e086d82-540d-466d-b8c3-0c2abcfa38ae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:04.500815 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e086d82-540d-466d-b8c3-0c2abcfa38ae None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:04.535395 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 22/46] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Apr 11 13:41:04 2022] POST /identity/v3/projects => generated 312 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:41:06.452042 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6967f5f-852f-49d4-97df-eb68ca7d293e None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:06.452593 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6967f5f-852f-49d4-97df-eb68ca7d293e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:06.452733 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6967f5f-852f-49d4-97df-eb68ca7d293e None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:06.454439 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 25/47] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:06.460350 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b5ea8-3d24-4267-b527-152b1848a33b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:06.460809 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b5ea8-3d24-4267-b527-152b1848a33b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:06.460919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b5ea8-3d24-4267-b527-152b1848a33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:06.477179 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-839b5ea8-3d24-4267-b527-152b1848a33b None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:06.478358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-839b5ea8-3d24-4267-b527-152b1848a33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:06.546183 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 23/48] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:06.570660 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6967f5f-852f-49d4-97df-eb68ca7d293e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:06.666639 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6967f5f-852f-49d4-97df-eb68ca7d293e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:06.698976 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d776f39-49ee-4461-9458-25c80189d53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:06.699912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d776f39-49ee-4461-9458-25c80189d53c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:06.700201 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d776f39-49ee-4461-9458-25c80189d53c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:06.700477 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d776f39-49ee-4461-9458-25c80189d53c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:06.711427 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d776f39-49ee-4461-9458-25c80189d53c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:06.718407 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-3d776f39-49ee-4461-9458-25c80189d53c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:41:06.719619 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 26/49] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:41:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:06.725366 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b5ea8-3d24-4267-b527-152b1848a33b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:06.815899 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6ab9a-28ed-4722-b477-7dcff4f38db6 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:06.816195 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6ab9a-28ed-4722-b477-7dcff4f38db6 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:06.816485 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6ab9a-28ed-4722-b477-7dcff4f38db6 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:06.817870 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 27/50] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:41:06.819323 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b5ea8-3d24-4267-b527-152b1848a33b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:06.822686 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f6f5-bb2b-40e6-9512-2cbcf5d69d6f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:06.822974 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f6f5-bb2b-40e6-9512-2cbcf5d69d6f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:06.823252 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f6f5-bb2b-40e6-9512-2cbcf5d69d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:06.840369 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a953f6f5-bb2b-40e6-9512-2cbcf5d69d6f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:06.841699 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a953f6f5-bb2b-40e6-9512-2cbcf5d69d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:06.852454 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d2485-2dea-46f1-8cf6-3e630966cf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:06.853123 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d2485-2dea-46f1-8cf6-3e630966cf9d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:06.853408 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d2485-2dea-46f1-8cf6-3e630966cf9d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:06.853685 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d2485-2dea-46f1-8cf6-3e630966cf9d None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:06.854443 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d2485-2dea-46f1-8cf6-3e630966cf9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:06.855350 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d2485-2dea-46f1-8cf6-3e630966cf9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:06.856988 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d2485-2dea-46f1-8cf6-3e630966cf9d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:06.866694 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 24/51] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:06.872237 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d2485-2dea-46f1-8cf6-3e630966cf9d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:06.905796 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 28/52] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:41:06.930798 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953f6f5-bb2b-40e6-9512-2cbcf5d69d6f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:06.966090 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d2485-2dea-46f1-8cf6-3e630966cf9d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:06.996330 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82899e8-c2d0-4927-99b1-897604b8372a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:06.997190 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82899e8-c2d0-4927-99b1-897604b8372a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:06.997468 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82899e8-c2d0-4927-99b1-897604b8372a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:06.997738 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82899e8-c2d0-4927-99b1-897604b8372a None admin] PATH_INFO: `/v3/users/a8b5e2d388d34b24a1ace24c7c6fb803` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:06.998928 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82899e8-c2d0-4927-99b1-897604b8372a None admin] RBAC: Authorizing `identity:get_user(user_id=a8b5e2d388d34b24a1ace24c7c6fb803)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:07.000400 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82899e8-c2d0-4927-99b1-897604b8372a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:07.002007 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 25/53] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:06 2022] GET /identity/v3/users/a8b5e2d388d34b24a1ace24c7c6fb803 => generated 247 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:07.007203 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82899e8-c2d0-4927-99b1-897604b8372a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:07.030561 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953f6f5-bb2b-40e6-9512-2cbcf5d69d6f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:07.065384 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be74956-88b7-4d56-a781-058a282d1fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:07.066182 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be74956-88b7-4d56-a781-058a282d1fc0 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:07.066475 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be74956-88b7-4d56-a781-058a282d1fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:07.066757 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be74956-88b7-4d56-a781-058a282d1fc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:07.067975 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be74956-88b7-4d56-a781-058a282d1fc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:07.069433 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be74956-88b7-4d56-a781-058a282d1fc0 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:07.071055 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 29/54] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:41:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:07.077091 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be74956-88b7-4d56-a781-058a282d1fc0 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:07.104030 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82899e8-c2d0-4927-99b1-897604b8372a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:07.137235 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0aadf-e5f9-4720-a95a-77305afa5315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:07.138031 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0aadf-e5f9-4720-a95a-77305afa5315 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:07.138317 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0aadf-e5f9-4720-a95a-77305afa5315 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:07.138597 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0aadf-e5f9-4720-a95a-77305afa5315 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:07.139809 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0aadf-e5f9-4720-a95a-77305afa5315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:07.141260 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0aadf-e5f9-4720-a95a-77305afa5315 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:07.142880 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 26/55] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:41:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:07.148447 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0aadf-e5f9-4720-a95a-77305afa5315 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:07.172002 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be74956-88b7-4d56-a781-058a282d1fc0 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:07.204485 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31666c75-9ec5-4bfe-8ee9-ff0b8edf434a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:07.205085 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31666c75-9ec5-4bfe-8ee9-ff0b8edf434a None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:07.205372 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31666c75-9ec5-4bfe-8ee9-ff0b8edf434a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:07.205652 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31666c75-9ec5-4bfe-8ee9-ff0b8edf434a None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:07.206525 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31666c75-9ec5-4bfe-8ee9-ff0b8edf434a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:07.207999 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31666c75-9ec5-4bfe-8ee9-ff0b8edf434a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:07.233792 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 30/56] 10.222.0.67 () {60 vars in 1140 bytes} [Mon Apr 11 13:41:07 2022] POST /identity/v3/projects => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:41:07.253140 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0aadf-e5f9-4720-a95a-77305afa5315 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:07.287744 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f83af-23ef-477f-81f2-5da155a1e62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:07.288540 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f83af-23ef-477f-81f2-5da155a1e62d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:07.288833 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f83af-23ef-477f-81f2-5da155a1e62d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:07.289115 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f83af-23ef-477f-81f2-5da155a1e62d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:07.289983 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f83af-23ef-477f-81f2-5da155a1e62d None admin] RBAC: Adding query filter params (role.id=e3333fcf22b040e3a1f0bfbfe657cffa, scope.domain.id=default, user.id=a8b5e2d388d34b24a1ace24c7c6fb803) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:07.290301 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f83af-23ef-477f-81f2-5da155a1e62d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:07.291834 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f83af-23ef-477f-81f2-5da155a1e62d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:07.299059 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 27/57] 10.222.0.67 () {56 vars in 1322 bytes} [Mon Apr 11 13:41:07 2022] GET /identity/v3/role_assignments?user.id=a8b5e2d388d34b24a1ace24c7c6fb803&scope.domain.id=default&role.id=e3333fcf22b040e3a1f0bfbfe657cffa => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:09.579862 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94532848-e741-420f-8b1f-259262d2a4e7 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:09.580358 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94532848-e741-420f-8b1f-259262d2a4e7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:09.580445 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94532848-e741-420f-8b1f-259262d2a4e7 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:09.581798 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 31/58] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:09.586862 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1eb25-14db-4689-bef1-95f84df0ed8a None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:09.587269 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1eb25-14db-4689-bef1-95f84df0ed8a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:09.587430 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1eb25-14db-4689-bef1-95f84df0ed8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:09.603729 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-27e1eb25-14db-4689-bef1-95f84df0ed8a None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:09.604954 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-27e1eb25-14db-4689-bef1-95f84df0ed8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:09.667809 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 28/59] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:09.693108 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94532848-e741-420f-8b1f-259262d2a4e7 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:09.788600 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94532848-e741-420f-8b1f-259262d2a4e7 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:09.820085 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b936d33-22ab-4956-86bf-c052547ec662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:09.820865 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b936d33-22ab-4956-86bf-c052547ec662 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:09.821152 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b936d33-22ab-4956-86bf-c052547ec662 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:09.821433 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b936d33-22ab-4956-86bf-c052547ec662 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:09.822615 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b936d33-22ab-4956-86bf-c052547ec662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:09.824268 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b936d33-22ab-4956-86bf-c052547ec662 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:09.826648 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 32/60] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:41:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:09.832355 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1eb25-14db-4689-bef1-95f84df0ed8a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:09.925323 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1eb25-14db-4689-bef1-95f84df0ed8a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:09.957531 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04a6fd-845a-45a5-af1b-e3fa70a79701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:09.958189 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04a6fd-845a-45a5-af1b-e3fa70a79701 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:09.958479 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04a6fd-845a-45a5-af1b-e3fa70a79701 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:09.958764 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04a6fd-845a-45a5-af1b-e3fa70a79701 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:09.959485 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04a6fd-845a-45a5-af1b-e3fa70a79701 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:09.960981 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04a6fd-845a-45a5-af1b-e3fa70a79701 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:09.985780 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 29/61] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Apr 11 13:41:09 2022] POST /identity/v3/users => generated 275 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:41:13.480548 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca90296-0db6-4a81-bb51-bf8cc46385f0 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:13.481504 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca90296-0db6-4a81-bb51-bf8cc46385f0 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:13.481997 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca90296-0db6-4a81-bb51-bf8cc46385f0 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:13.483622 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 33/62] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:13.496166 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b025b-e022-4e13-9fe5-72e587d5e394 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:13.496643 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b025b-e022-4e13-9fe5-72e587d5e394 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:13.497140 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b025b-e022-4e13-9fe5-72e587d5e394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:13.519108 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c89b025b-e022-4e13-9fe5-72e587d5e394 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:13.520692 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c89b025b-e022-4e13-9fe5-72e587d5e394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:13.522103 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12237493-82b9-4a77-8ae0-b6f5700f1a5a None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:13.522625 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12237493-82b9-4a77-8ae0-b6f5700f1a5a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:13.523099 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12237493-82b9-4a77-8ae0-b6f5700f1a5a None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:13.524932 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 34/63] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:13.531244 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ba257-8809-4a1c-922b-a437cc957227 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:13.531831 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ba257-8809-4a1c-922b-a437cc957227 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:13.532309 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ba257-8809-4a1c-922b-a437cc957227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:13.567859 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-408ba257-8809-4a1c-922b-a437cc957227 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:13.569072 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-408ba257-8809-4a1c-922b-a437cc957227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:13.605593 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 30/64] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:13.669166 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 35/65] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:41:13.675671 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b025b-e022-4e13-9fe5-72e587d5e394 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:13.693804 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ba257-8809-4a1c-922b-a437cc957227 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:13.788133 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b025b-e022-4e13-9fe5-72e587d5e394 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:13.824266 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a3c26-7b9d-4182-ae21-df64c0ba6b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:13.825179 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ba257-8809-4a1c-922b-a437cc957227 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:13.825484 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a3c26-7b9d-4182-ae21-df64c0ba6b13 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:13.825770 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a3c26-7b9d-4182-ae21-df64c0ba6b13 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:13.826046 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a3c26-7b9d-4182-ae21-df64c0ba6b13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:13.839031 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a3c26-7b9d-4182-ae21-df64c0ba6b13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:13.847742 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-2b4a3c26-7b9d-4182-ae21-df64c0ba6b13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:41:13.849709 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 31/66] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:41:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:13.852470 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6e6de-85ed-4b25-8db3-01b290f9363a None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:13.852966 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6e6de-85ed-4b25-8db3-01b290f9363a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:13.853455 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6e6de-85ed-4b25-8db3-01b290f9363a None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:13.856807 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 32/67] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:13.857966 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6e6de-85ed-4b25-8db3-01b290f9363a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:13.868179 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52983795-cb56-44b5-bfcc-2506516ff7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:13.869269 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52983795-cb56-44b5-bfcc-2506516ff7a9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:13.869773 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52983795-cb56-44b5-bfcc-2506516ff7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:13.870848 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52983795-cb56-44b5-bfcc-2506516ff7a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:13.882325 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52983795-cb56-44b5-bfcc-2506516ff7a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:13.892144 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-52983795-cb56-44b5-bfcc-2506516ff7a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 13:41:13.898087 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 36/68] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:41:13.898087 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4fd60-0c33-4c3c-937e-90e8fe4a3af2 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:13.898087 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4fd60-0c33-4c3c-937e-90e8fe4a3af2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:13.898087 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4fd60-0c33-4c3c-937e-90e8fe4a3af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:13.920944 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-09f4fd60-0c33-4c3c-937e-90e8fe4a3af2 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:13.922894 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-09f4fd60-0c33-4c3c-937e-90e8fe4a3af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:13.963529 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6e6de-85ed-4b25-8db3-01b290f9363a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:13.997600 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c97fc-e6ac-4fcd-9748-ee0990cbef55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:13.998483 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c97fc-e6ac-4fcd-9748-ee0990cbef55 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:13.998589 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c97fc-e6ac-4fcd-9748-ee0990cbef55 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:13.998828 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c97fc-e6ac-4fcd-9748-ee0990cbef55 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:13.999602 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c97fc-e6ac-4fcd-9748-ee0990cbef55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:13.999942 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c97fc-e6ac-4fcd-9748-ee0990cbef55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:14.001386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c97fc-e6ac-4fcd-9748-ee0990cbef55 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:14.002912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 37/69] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:14.004324 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b8cba-165f-4e98-8485-d90dc558fb67 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:14.004855 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b8cba-165f-4e98-8485-d90dc558fb67 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:14.005383 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b8cba-165f-4e98-8485-d90dc558fb67 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:14.011386 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 38/70] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:14.012678 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b8cba-165f-4e98-8485-d90dc558fb67 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:14.020889 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 33/71] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:14.022408 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98957b-0cb1-4afb-a089-b01194331062 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:14.022694 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98957b-0cb1-4afb-a089-b01194331062 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:14.022967 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98957b-0cb1-4afb-a089-b01194331062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:14.041357 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-cd98957b-0cb1-4afb-a089-b01194331062 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:14.043399 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-cd98957b-0cb1-4afb-a089-b01194331062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:14.114811 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 34/72] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:14.115953 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98957b-0cb1-4afb-a089-b01194331062 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:14.126537 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b8cba-165f-4e98-8485-d90dc558fb67 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:14.163281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747ec6f-9267-45c3-8ae4-109c518a707a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:14.164299 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747ec6f-9267-45c3-8ae4-109c518a707a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:14.164742 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747ec6f-9267-45c3-8ae4-109c518a707a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:14.165026 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747ec6f-9267-45c3-8ae4-109c518a707a None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:14.165780 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747ec6f-9267-45c3-8ae4-109c518a707a None admin] RBAC: Adding query filter params (name=member) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:14.166091 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747ec6f-9267-45c3-8ae4-109c518a707a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:14.168325 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747ec6f-9267-45c3-8ae4-109c518a707a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:14.176415 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 39/73] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:14.177404 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747ec6f-9267-45c3-8ae4-109c518a707a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:14.223301 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98957b-0cb1-4afb-a089-b01194331062 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:14.257334 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a5133-1316-4c2b-a9df-775f4ff4b461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:14.258209 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a5133-1316-4c2b-a9df-775f4ff4b461 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:14.258494 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a5133-1316-4c2b-a9df-775f4ff4b461 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:14.258894 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a5133-1316-4c2b-a9df-775f4ff4b461 None admin] PATH_INFO: `/v3/users/a8b5e2d388d34b24a1ace24c7c6fb803` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:14.260006 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a5133-1316-4c2b-a9df-775f4ff4b461 None admin] RBAC: Authorizing `identity:get_user(user_id=a8b5e2d388d34b24a1ace24c7c6fb803)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:14.261839 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a5133-1316-4c2b-a9df-775f4ff4b461 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:14.267689 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 35/74] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:14 2022] GET /identity/v3/users/a8b5e2d388d34b24a1ace24c7c6fb803 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:14.267689 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a5133-1316-4c2b-a9df-775f4ff4b461 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:14.277674 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747ec6f-9267-45c3-8ae4-109c518a707a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:14.310711 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869be488-8139-45c2-afe2-5c9649596e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:14.311537 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869be488-8139-45c2-afe2-5c9649596e15 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:14.311990 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869be488-8139-45c2-afe2-5c9649596e15 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:14.312281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869be488-8139-45c2-afe2-5c9649596e15 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:14.323871 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869be488-8139-45c2-afe2-5c9649596e15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:14.332241 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-869be488-8139-45c2-afe2-5c9649596e15 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 13:41:14.337981 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 40/75] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:41:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:14.337981 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869be488-8139-45c2-afe2-5c9649596e15 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:14.372060 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a5133-1316-4c2b-a9df-775f4ff4b461 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:14.407618 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411e74a-d78a-402b-b4b6-96ad2f1c422d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:14.408450 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411e74a-d78a-402b-b4b6-96ad2f1c422d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:14.408737 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411e74a-d78a-402b-b4b6-96ad2f1c422d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:14.409013 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411e74a-d78a-402b-b4b6-96ad2f1c422d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:14.419521 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411e74a-d78a-402b-b4b6-96ad2f1c422d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:14.426586 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-4411e74a-d78a-402b-b4b6-96ad2f1c422d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 13:41:14.427763 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 36/76] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:14.428538 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411e74a-d78a-402b-b4b6-96ad2f1c422d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:14.436088 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869be488-8139-45c2-afe2-5c9649596e15 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:14.469058 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8882f-234a-4618-a444-875ec8251ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:14.469937 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8882f-234a-4618-a444-875ec8251ea0 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:14.470221 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8882f-234a-4618-a444-875ec8251ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:14.470497 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8882f-234a-4618-a444-875ec8251ea0 None admin] PATH_INFO: `/v3/users/80fe3955cd0843e783a1c35d76b757b9` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:14.485408 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8882f-234a-4618-a444-875ec8251ea0 None admin] RBAC: Authorizing `identity:get_user(user_id=80fe3955cd0843e783a1c35d76b757b9)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:14.486848 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8882f-234a-4618-a444-875ec8251ea0 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:14.488543 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 41/77] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:14 2022] GET /identity/v3/users/80fe3955cd0843e783a1c35d76b757b9 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:14.489309 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8882f-234a-4618-a444-875ec8251ea0 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:14.532315 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411e74a-d78a-402b-b4b6-96ad2f1c422d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:14.563077 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480cebf3-248f-4f31-87ba-9c26732f5397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:14.563761 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cebf3-248f-4f31-87ba-9c26732f5397 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:14.564056 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cebf3-248f-4f31-87ba-9c26732f5397 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:14.564333 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cebf3-248f-4f31-87ba-9c26732f5397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:14.581658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8882f-234a-4618-a444-875ec8251ea0 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:14.612890 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc419f-f2fe-4fec-9660-49240f92a925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:14.613546 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc419f-f2fe-4fec-9660-49240f92a925 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:14.613828 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc419f-f2fe-4fec-9660-49240f92a925 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:14.614106 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc419f-f2fe-4fec-9660-49240f92a925 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:14.614847 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc419f-f2fe-4fec-9660-49240f92a925 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:14.615153 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc419f-f2fe-4fec-9660-49240f92a925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:14.616564 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc419f-f2fe-4fec-9660-49240f92a925 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:14.624307 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 42/78] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:41:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:14.625443 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbd750-f73b-49ce-9b68-6e318068bd7e None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:14.625732 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbd750-f73b-49ce-9b68-6e318068bd7e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:14.626013 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbd750-f73b-49ce-9b68-6e318068bd7e None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:14.627346 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 43/79] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:14.628060 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbd750-f73b-49ce-9b68-6e318068bd7e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:14.632159 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480cebf3-248f-4f31-87ba-9c26732f5397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:14.633677 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480cebf3-248f-4f31-87ba-9c26732f5397 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:14.724776 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbd750-f73b-49ce-9b68-6e318068bd7e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:14.727043 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 37/80] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:41:14.731550 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480cebf3-248f-4f31-87ba-9c26732f5397 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:14.757432 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d427a-fbec-4d02-9911-53ac8c59837d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:14.758098 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d427a-fbec-4d02-9911-53ac8c59837d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:14.758384 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d427a-fbec-4d02-9911-53ac8c59837d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:14.758661 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d427a-fbec-4d02-9911-53ac8c59837d None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:14.759407 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d427a-fbec-4d02-9911-53ac8c59837d None admin] RBAC: Adding query filter params (name=member) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:14.759746 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d427a-fbec-4d02-9911-53ac8c59837d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:14.761683 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d427a-fbec-4d02-9911-53ac8c59837d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:14.769396 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 44/81] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:14.770185 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d427a-fbec-4d02-9911-53ac8c59837d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:14.820312 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480cebf3-248f-4f31-87ba-9c26732f5397 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:14.853509 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10510f98-a206-40cc-8e37-fa107546bcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:14.854849 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10510f98-a206-40cc-8e37-fa107546bcb1 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:14.855147 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10510f98-a206-40cc-8e37-fa107546bcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:14.855594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10510f98-a206-40cc-8e37-fa107546bcb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:14.865919 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d427a-fbec-4d02-9911-53ac8c59837d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:14.897237 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e73de85-a209-47ef-bb34-9a0010e69f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:14.898102 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73de85-a209-47ef-bb34-9a0010e69f4a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:14.898380 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73de85-a209-47ef-bb34-9a0010e69f4a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:14.898651 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e73de85-a209-47ef-bb34-9a0010e69f4a None admin] PATH_INFO: `/v3/users/80fe3955cd0843e783a1c35d76b757b9` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:14.899873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73de85-a209-47ef-bb34-9a0010e69f4a None admin] RBAC: Authorizing `identity:get_user(user_id=80fe3955cd0843e783a1c35d76b757b9)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:14.901839 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e73de85-a209-47ef-bb34-9a0010e69f4a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:14.903537 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 45/82] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:14 2022] GET /identity/v3/users/80fe3955cd0843e783a1c35d76b757b9 => generated 275 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:14.904686 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbd1d0-2c6b-462b-a401-a1d56f84bcf0 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:14.904969 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbd1d0-2c6b-462b-a401-a1d56f84bcf0 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:14.905243 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbd1d0-2c6b-462b-a401-a1d56f84bcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:14.919596 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10510f98-a206-40cc-8e37-fa107546bcb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:14.921104 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10510f98-a206-40cc-8e37-fa107546bcb1 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:14.922673 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-23cbd1d0-2c6b-462b-a401-a1d56f84bcf0 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:14.923918 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-23cbd1d0-2c6b-462b-a401-a1d56f84bcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:14.986781 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 46/83] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:14.987724 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbd1d0-2c6b-462b-a401-a1d56f84bcf0 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:15.016539 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 38/84] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:41:15.017693 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10510f98-a206-40cc-8e37-fa107546bcb1 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:15.084428 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbd1d0-2c6b-462b-a401-a1d56f84bcf0 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:15.114506 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10510f98-a206-40cc-8e37-fa107546bcb1 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:15.117504 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4594cf-4cc3-4dcd-8ebd-c2a15c14dc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:15.118367 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4594cf-4cc3-4dcd-8ebd-c2a15c14dc74 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:15.118657 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4594cf-4cc3-4dcd-8ebd-c2a15c14dc74 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:15.118937 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4594cf-4cc3-4dcd-8ebd-c2a15c14dc74 None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:15.120274 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4594cf-4cc3-4dcd-8ebd-c2a15c14dc74 None admin] RBAC: Authorizing `identity:get_project(project_id=029a84f386ce4e48b750a76626f65b2d)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:15.121722 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4594cf-4cc3-4dcd-8ebd-c2a15c14dc74 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:15.123433 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 47/85] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:14 2022] GET /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:15.124228 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4594cf-4cc3-4dcd-8ebd-c2a15c14dc74 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:15.153798 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bac71-76de-4ebc-afbf-fb93a86ad8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:15.154677 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bac71-76de-4ebc-afbf-fb93a86ad8fb None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:15.154959 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bac71-76de-4ebc-afbf-fb93a86ad8fb None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:15.155232 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bac71-76de-4ebc-afbf-fb93a86ad8fb None admin] PATH_INFO: `/v3/users/80fe3955cd0843e783a1c35d76b757b9` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:15.156445 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bac71-76de-4ebc-afbf-fb93a86ad8fb None admin] RBAC: Authorizing `identity:get_user(user_id=80fe3955cd0843e783a1c35d76b757b9)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:15.157932 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bac71-76de-4ebc-afbf-fb93a86ad8fb None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:15.159559 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 39/86] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:15 2022] GET /identity/v3/users/80fe3955cd0843e783a1c35d76b757b9 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:15.160349 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bac71-76de-4ebc-afbf-fb93a86ad8fb None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:15.218853 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4594cf-4cc3-4dcd-8ebd-c2a15c14dc74 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:15.251030 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b303f-cb0b-471e-9391-99f6e98ad7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:15.251609 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b303f-cb0b-471e-9391-99f6e98ad7e9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:15.251922 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b303f-cb0b-471e-9391-99f6e98ad7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:15.252199 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b303f-cb0b-471e-9391-99f6e98ad7e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:15.252769 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bac71-76de-4ebc-afbf-fb93a86ad8fb None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:15.285378 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af48bf-d5f9-458d-a32d-569c585ec776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:15.286149 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af48bf-d5f9-458d-a32d-569c585ec776 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:15.286427 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af48bf-d5f9-458d-a32d-569c585ec776 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:15.286698 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af48bf-d5f9-458d-a32d-569c585ec776 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:15.287884 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af48bf-d5f9-458d-a32d-569c585ec776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:15.289325 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af48bf-d5f9-458d-a32d-569c585ec776 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:15.290920 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 40/87] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:41:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:15.291740 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af48bf-d5f9-458d-a32d-569c585ec776 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:15.319611 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b303f-cb0b-471e-9391-99f6e98ad7e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:15.321098 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b303f-cb0b-471e-9391-99f6e98ad7e9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:15.382368 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af48bf-d5f9-458d-a32d-569c585ec776 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:15.414905 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 48/88] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:41:15.415137 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a5eb8-58c2-4e36-930e-ca7bb136545a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:15.415773 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b303f-cb0b-471e-9391-99f6e98ad7e9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:15.416043 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a5eb8-58c2-4e36-930e-ca7bb136545a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:15.416330 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a5eb8-58c2-4e36-930e-ca7bb136545a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:15.416639 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a5eb8-58c2-4e36-930e-ca7bb136545a None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:15.417831 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a5eb8-58c2-4e36-930e-ca7bb136545a None admin] RBAC: Authorizing `identity:get_project(project_id=029a84f386ce4e48b750a76626f65b2d)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:15.419420 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a5eb8-58c2-4e36-930e-ca7bb136545a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:15.421288 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 41/89] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:15 2022] GET /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d => generated 298 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:15.422039 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a5eb8-58c2-4e36-930e-ca7bb136545a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:15.513392 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a5eb8-58c2-4e36-930e-ca7bb136545a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:15.514871 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b303f-cb0b-471e-9391-99f6e98ad7e9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:15.545310 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68f9de-1fbd-43a7-8f90-44954d53a5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:15.545947 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68f9de-1fbd-43a7-8f90-44954d53a5e7 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:15.546230 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68f9de-1fbd-43a7-8f90-44954d53a5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:15.546500 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68f9de-1fbd-43a7-8f90-44954d53a5e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:15.546681 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb69965-f8f0-43e5-9a70-be5250f7f573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:15.547345 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb69965-f8f0-43e5-9a70-be5250f7f573 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:15.547667 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb69965-f8f0-43e5-9a70-be5250f7f573 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:15.547936 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb69965-f8f0-43e5-9a70-be5250f7f573 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:15.548772 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb69965-f8f0-43e5-9a70-be5250f7f573 None admin] RBAC: Adding query filter params (role.id=e3333fcf22b040e3a1f0bfbfe657cffa, scope.project.id=029a84f386ce4e48b750a76626f65b2d, user.id=a8b5e2d388d34b24a1ace24c7c6fb803) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:15.549090 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb69965-f8f0-43e5-9a70-be5250f7f573 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:15.550545 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb69965-f8f0-43e5-9a70-be5250f7f573 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:15.558522 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 49/90] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:41:15 2022] GET /identity/v3/role_assignments?user.id=a8b5e2d388d34b24a1ace24c7c6fb803&scope.project.id=029a84f386ce4e48b750a76626f65b2d&role.id=e3333fcf22b040e3a1f0bfbfe657cffa => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:15.559294 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb69965-f8f0-43e5-9a70-be5250f7f573 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:15.614646 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68f9de-1fbd-43a7-8f90-44954d53a5e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:15.616204 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68f9de-1fbd-43a7-8f90-44954d53a5e7 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:15.673783 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb69965-f8f0-43e5-9a70-be5250f7f573 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:15.708449 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fe9a5-18d7-4cfe-a138-ef16f1bcf344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:15.709143 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fe9a5-18d7-4cfe-a138-ef16f1bcf344 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:15.709427 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fe9a5-18d7-4cfe-a138-ef16f1bcf344 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:15.709708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fe9a5-18d7-4cfe-a138-ef16f1bcf344 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:15.710438 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fe9a5-18d7-4cfe-a138-ef16f1bcf344 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:15.711953 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fe9a5-18d7-4cfe-a138-ef16f1bcf344 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:15.720722 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 42/91] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:41:15.721813 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68f9de-1fbd-43a7-8f90-44954d53a5e7 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:15.741087 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 50/92] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Apr 11 13:41:15 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:41:15.747684 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fe9a5-18d7-4cfe-a138-ef16f1bcf344 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:15.831022 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68f9de-1fbd-43a7-8f90-44954d53a5e7 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:15.853912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fe9a5-18d7-4cfe-a138-ef16f1bcf344 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:15.869617 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d260b-02c8-458f-9280-7797a1300a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:15.870544 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d260b-02c8-458f-9280-7797a1300a26 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:15.870901 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d260b-02c8-458f-9280-7797a1300a26 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:15.871183 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d260b-02c8-458f-9280-7797a1300a26 None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:15.872545 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d260b-02c8-458f-9280-7797a1300a26 None admin] RBAC: Authorizing `identity:get_project(project_id=029a84f386ce4e48b750a76626f65b2d)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:15.874216 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d260b-02c8-458f-9280-7797a1300a26 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:15.881102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 43/93] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:15 2022] GET /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:15.882099 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d260b-02c8-458f-9280-7797a1300a26 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:15.891667 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeb9e4-4c6a-4c1e-9853-ce6b0f807f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:15.892363 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeb9e4-4c6a-4c1e-9853-ce6b0f807f38 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:15.892654 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeb9e4-4c6a-4c1e-9853-ce6b0f807f38 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:15.892940 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeb9e4-4c6a-4c1e-9853-ce6b0f807f38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:15.893803 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aeb9e4-4c6a-4c1e-9853-ce6b0f807f38 None admin] RBAC: Adding query filter params (role.id=3daf622d91e64ce685da6f482aa181ea, scope.project.id=029a84f386ce4e48b750a76626f65b2d, user.id=80fe3955cd0843e783a1c35d76b757b9) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:15.894121 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aeb9e4-4c6a-4c1e-9853-ce6b0f807f38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:15.895706 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aeb9e4-4c6a-4c1e-9853-ce6b0f807f38 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:15.902648 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 51/94] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:41:15 2022] GET /identity/v3/role_assignments?user.id=80fe3955cd0843e783a1c35d76b757b9&scope.project.id=029a84f386ce4e48b750a76626f65b2d&role.id=3daf622d91e64ce685da6f482aa181ea => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:15.903387 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeb9e4-4c6a-4c1e-9853-ce6b0f807f38 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:16.024486 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeb9e4-4c6a-4c1e-9853-ce6b0f807f38 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:16.039777 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d260b-02c8-458f-9280-7797a1300a26 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:16.075763 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc80aeb-2f4b-4ba8-ac3b-ac653bb1d736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:16.077447 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc80aeb-2f4b-4ba8-ac3b-ac653bb1d736 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:16.078204 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc80aeb-2f4b-4ba8-ac3b-ac653bb1d736 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:16.078662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc80aeb-2f4b-4ba8-ac3b-ac653bb1d736 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:16.080246 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc80aeb-2f4b-4ba8-ac3b-ac653bb1d736 None admin] RBAC: Adding query filter params (role.id=fbb7398610b649859d123d0938aa8e75, scope.project.id=029a84f386ce4e48b750a76626f65b2d, user.id=80fe3955cd0843e783a1c35d76b757b9) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:16.080754 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc80aeb-2f4b-4ba8-ac3b-ac653bb1d736 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:16.082560 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc80aeb-2f4b-4ba8-ac3b-ac653bb1d736 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:16.091656 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26848dbb-88d0-431c-992f-bad62c516bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:16.091961 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 52/95] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:41:15 2022] GET /identity/v3/role_assignments?user.id=80fe3955cd0843e783a1c35d76b757b9&scope.project.id=029a84f386ce4e48b750a76626f65b2d&role.id=fbb7398610b649859d123d0938aa8e75 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:16.092683 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26848dbb-88d0-431c-992f-bad62c516bc2 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:16.093029 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26848dbb-88d0-431c-992f-bad62c516bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:16.093368 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26848dbb-88d0-431c-992f-bad62c516bc2 None admin] PATH_INFO: `/v3/projects/9925178d3a324d0faecb1788c31fe0c9` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:16.094658 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26848dbb-88d0-431c-992f-bad62c516bc2 None admin] RBAC: Authorizing `identity:get_project(project_id=9925178d3a324d0faecb1788c31fe0c9)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:16.103725 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26848dbb-88d0-431c-992f-bad62c516bc2 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:16.103725 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 44/96] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:15 2022] GET /identity/v3/projects/9925178d3a324d0faecb1788c31fe0c9 => generated 312 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:16.105484 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc80aeb-2f4b-4ba8-ac3b-ac653bb1d736 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:16.218360 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc80aeb-2f4b-4ba8-ac3b-ac653bb1d736 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:16.257618 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cd75d-899e-4041-806e-05fd13551d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:16.258305 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cd75d-899e-4041-806e-05fd13551d08 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:16.258589 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cd75d-899e-4041-806e-05fd13551d08 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:16.258867 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cd75d-899e-4041-806e-05fd13551d08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:16.259744 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cd75d-899e-4041-806e-05fd13551d08 None admin] RBAC: Adding query filter params (role.id=3daf622d91e64ce685da6f482aa181ea, scope.project.id=9925178d3a324d0faecb1788c31fe0c9, user.id=80fe3955cd0843e783a1c35d76b757b9) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:16.260058 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cd75d-899e-4041-806e-05fd13551d08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:16.261646 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cd75d-899e-4041-806e-05fd13551d08 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:16.267992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 53/97] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:41:16 2022] GET /identity/v3/role_assignments?user.id=80fe3955cd0843e783a1c35d76b757b9&scope.project.id=9925178d3a324d0faecb1788c31fe0c9&role.id=3daf622d91e64ce685da6f482aa181ea => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:18.737897 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114df6a7-17df-43aa-8767-89306c3b5cbe None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:18.738413 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114df6a7-17df-43aa-8767-89306c3b5cbe None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:18.738413 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114df6a7-17df-43aa-8767-89306c3b5cbe None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:18.739732 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 45/98] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:18.745569 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f56fd-c240-4bb5-a3d3-b7cbeb7a71ee None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:18.746077 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f56fd-c240-4bb5-a3d3-b7cbeb7a71ee None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:18.746313 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f56fd-c240-4bb5-a3d3-b7cbeb7a71ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:18.768768 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-857f56fd-c240-4bb5-a3d3-b7cbeb7a71ee None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:18.769955 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-857f56fd-c240-4bb5-a3d3-b7cbeb7a71ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:18.795132 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149cbfd-725b-4c19-9279-449456a41c08 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:18.795456 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149cbfd-725b-4c19-9279-449456a41c08 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:18.795714 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149cbfd-725b-4c19-9279-449456a41c08 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:18.797217 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 46/99] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:41:18.802058 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dd954-ab7e-4260-a165-520127c3ad8b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:18.802350 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dd954-ab7e-4260-a165-520127c3ad8b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:18.802629 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dd954-ab7e-4260-a165-520127c3ad8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:18.827670 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-985dd954-ab7e-4260-a165-520127c3ad8b None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:18.829105 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-985dd954-ab7e-4260-a165-520127c3ad8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:18.925610 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 54/100] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:41:18.957980 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 47/101] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:41:18.960913 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f56fd-c240-4bb5-a3d3-b7cbeb7a71ee None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:18.993069 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dd954-ab7e-4260-a165-520127c3ad8b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:19.108593 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dd954-ab7e-4260-a165-520127c3ad8b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:19.134111 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f56fd-c240-4bb5-a3d3-b7cbeb7a71ee None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:19.144306 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a962132-0237-4be4-9802-b31b889aa11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:19.145420 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a962132-0237-4be4-9802-b31b889aa11d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:19.145897 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a962132-0237-4be4-9802-b31b889aa11d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:19.146379 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a962132-0237-4be4-9802-b31b889aa11d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:19.157490 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a962132-0237-4be4-9802-b31b889aa11d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:19.171222 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-8a962132-0237-4be4-9802-b31b889aa11d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 13:41:19.172599 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 48/102] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:41:19.174903 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb3658-cec6-43dc-a5d1-39215bf507fd None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:19.175188 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb3658-cec6-43dc-a5d1-39215bf507fd None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:19.176124 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb3658-cec6-43dc-a5d1-39215bf507fd None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:19.179038 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 49/103] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:19.179781 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb3658-cec6-43dc-a5d1-39215bf507fd None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:19.180747 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235db8a-041e-46b4-b6bb-2b2903c356bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:19.181540 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235db8a-041e-46b4-b6bb-2b2903c356bc None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:19.182059 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235db8a-041e-46b4-b6bb-2b2903c356bc None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:19.185705 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235db8a-041e-46b4-b6bb-2b2903c356bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:19.203398 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235db8a-041e-46b4-b6bb-2b2903c356bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:19.211665 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-c235db8a-041e-46b4-b6bb-2b2903c356bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:41:19.213062 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 55/104] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:41:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:19.220476 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e741fe-2a2c-40e6-89df-602d27ca78ba None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:19.220759 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e741fe-2a2c-40e6-89df-602d27ca78ba None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:19.221037 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e741fe-2a2c-40e6-89df-602d27ca78ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:19.258131 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-10e741fe-2a2c-40e6-89df-602d27ca78ba None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:19.259292 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-10e741fe-2a2c-40e6-89df-602d27ca78ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:19.346506 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb3658-cec6-43dc-a5d1-39215bf507fd None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:19.393382 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 56/105] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:19.394604 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e741fe-2a2c-40e6-89df-602d27ca78ba None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:19.403600 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54468304-54aa-451e-883a-a3d290821b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:19.404589 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54468304-54aa-451e-883a-a3d290821b05 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:19.405082 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54468304-54aa-451e-883a-a3d290821b05 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:19.405570 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54468304-54aa-451e-883a-a3d290821b05 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:19.406544 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54468304-54aa-451e-883a-a3d290821b05 None admin] RBAC: Adding query filter params (name=member) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:19.407054 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54468304-54aa-451e-883a-a3d290821b05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:19.408662 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54468304-54aa-451e-883a-a3d290821b05 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:19.418923 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 50/106] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:19.420672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8ac1f-3df3-4a55-8a84-3890961df623 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:19.421184 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8ac1f-3df3-4a55-8a84-3890961df623 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:19.421665 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8ac1f-3df3-4a55-8a84-3890961df623 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:19.423405 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 51/107] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:19.428555 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8ac1f-3df3-4a55-8a84-3890961df623 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:19.527395 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e741fe-2a2c-40e6-89df-602d27ca78ba None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:19.535798 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8ac1f-3df3-4a55-8a84-3890961df623 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:19.562399 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ae8d9-4d0d-4a7d-a994-8e7713b34491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:19.563456 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ae8d9-4d0d-4a7d-a994-8e7713b34491 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:19.564008 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ae8d9-4d0d-4a7d-a994-8e7713b34491 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:19.564497 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ae8d9-4d0d-4a7d-a994-8e7713b34491 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:19.565457 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ae8d9-4d0d-4a7d-a994-8e7713b34491 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:19.565969 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ae8d9-4d0d-4a7d-a994-8e7713b34491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:19.567555 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ae8d9-4d0d-4a7d-a994-8e7713b34491 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:19.583675 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464a6d5-dd83-494c-96a0-850e6c970ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:19.583675 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464a6d5-dd83-494c-96a0-850e6c970ddd None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:19.583675 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464a6d5-dd83-494c-96a0-850e6c970ddd None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:19.583675 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464a6d5-dd83-494c-96a0-850e6c970ddd None admin] PATH_INFO: `/v3/users/80fe3955cd0843e783a1c35d76b757b9` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:19.584094 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464a6d5-dd83-494c-96a0-850e6c970ddd None admin] RBAC: Authorizing `identity:get_user(user_id=80fe3955cd0843e783a1c35d76b757b9)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:19.584094 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464a6d5-dd83-494c-96a0-850e6c970ddd None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:19.584720 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 57/108] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:19.585221 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 52/109] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:19 2022] GET /identity/v3/users/80fe3955cd0843e783a1c35d76b757b9 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:19.586223 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ae8d9-4d0d-4a7d-a994-8e7713b34491 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:19.586562 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f0506-39f1-4a9a-8305-1519eb5a744f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:19.586853 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f0506-39f1-4a9a-8305-1519eb5a744f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:19.587134 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f0506-39f1-4a9a-8305-1519eb5a744f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:19.611913 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-083f0506-39f1-4a9a-8305-1519eb5a744f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:19.613122 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-083f0506-39f1-4a9a-8305-1519eb5a744f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:19.696361 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ae8d9-4d0d-4a7d-a994-8e7713b34491 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:19.697663 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 53/110] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:19.699381 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f0506-39f1-4a9a-8305-1519eb5a744f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:19.733198 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0cc25-8b3b-486c-a97f-dbc8b0a627a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:19.734415 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0cc25-8b3b-486c-a97f-dbc8b0a627a9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:19.734904 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0cc25-8b3b-486c-a97f-dbc8b0a627a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:19.735384 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0cc25-8b3b-486c-a97f-dbc8b0a627a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:19.746485 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0cc25-8b3b-486c-a97f-dbc8b0a627a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:19.754864 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-47f0cc25-8b3b-486c-a97f-dbc8b0a627a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 13:41:19.756342 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 58/111] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:41:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:19.757321 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0cc25-8b3b-486c-a97f-dbc8b0a627a9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:19.813715 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f0506-39f1-4a9a-8305-1519eb5a744f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:19.856575 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b4aa5-130b-4088-92b7-b80a2ae35f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:19.857829 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b4aa5-130b-4088-92b7-b80a2ae35f72 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:19.858395 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b4aa5-130b-4088-92b7-b80a2ae35f72 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:19.859127 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b4aa5-130b-4088-92b7-b80a2ae35f72 None admin] PATH_INFO: `/v3/users/a8b5e2d388d34b24a1ace24c7c6fb803` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:19.860835 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b4aa5-130b-4088-92b7-b80a2ae35f72 None admin] RBAC: Authorizing `identity:get_user(user_id=a8b5e2d388d34b24a1ace24c7c6fb803)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:19.863214 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b4aa5-130b-4088-92b7-b80a2ae35f72 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:19.865519 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 54/112] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:19 2022] GET /identity/v3/users/a8b5e2d388d34b24a1ace24c7c6fb803 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:19.870162 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b4aa5-130b-4088-92b7-b80a2ae35f72 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:19.874373 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0cc25-8b3b-486c-a97f-dbc8b0a627a9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:19.918967 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6442c2d-c82d-4f71-9f60-aeca55508e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:19.920263 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6442c2d-c82d-4f71-9f60-aeca55508e9e None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:19.920745 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6442c2d-c82d-4f71-9f60-aeca55508e9e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:19.921709 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6442c2d-c82d-4f71-9f60-aeca55508e9e None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:19.923378 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6442c2d-c82d-4f71-9f60-aeca55508e9e None admin] RBAC: Authorizing `identity:get_project(project_id=029a84f386ce4e48b750a76626f65b2d)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:19.925817 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6442c2d-c82d-4f71-9f60-aeca55508e9e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:19.928646 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 59/113] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:19 2022] GET /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:19.929831 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6442c2d-c82d-4f71-9f60-aeca55508e9e None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:19.979288 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b4aa5-130b-4088-92b7-b80a2ae35f72 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:20.013870 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95df85-ebaa-42dc-b642-0283b9b349e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:20.014678 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95df85-ebaa-42dc-b642-0283b9b349e8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:20.014964 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95df85-ebaa-42dc-b642-0283b9b349e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:20.015243 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95df85-ebaa-42dc-b642-0283b9b349e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:20.025353 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95df85-ebaa-42dc-b642-0283b9b349e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:20.032993 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-9b95df85-ebaa-42dc-b642-0283b9b349e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 13:41:20.033594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6442c2d-c82d-4f71-9f60-aeca55508e9e None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:20.034381 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 55/114] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:20.034994 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95df85-ebaa-42dc-b642-0283b9b349e8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:20.070421 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3587fce-3c1e-4438-b719-1a0288b44e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:20.071015 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3587fce-3c1e-4438-b719-1a0288b44e05 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:20.071299 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3587fce-3c1e-4438-b719-1a0288b44e05 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:20.071575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3587fce-3c1e-4438-b719-1a0288b44e05 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:20.072353 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3587fce-3c1e-4438-b719-1a0288b44e05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:20.073129 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3587fce-3c1e-4438-b719-1a0288b44e05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:20.075056 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3587fce-3c1e-4438-b719-1a0288b44e05 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:20.084233 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 60/115] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:41:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:20.085048 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3587fce-3c1e-4438-b719-1a0288b44e05 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:20.129752 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95df85-ebaa-42dc-b642-0283b9b349e8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:20.160662 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b45013-e9fb-4c7c-8017-539dcbd0d9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:20.161521 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b45013-e9fb-4c7c-8017-539dcbd0d9c2 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:20.161806 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b45013-e9fb-4c7c-8017-539dcbd0d9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:20.162084 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b45013-e9fb-4c7c-8017-539dcbd0d9c2 None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:20.163260 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b45013-e9fb-4c7c-8017-539dcbd0d9c2 None admin] RBAC: Authorizing `identity:get_project(project_id=029a84f386ce4e48b750a76626f65b2d)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:20.164746 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b45013-e9fb-4c7c-8017-539dcbd0d9c2 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:20.167219 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 56/116] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:20 2022] GET /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d => generated 298 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:20.168296 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17e978-cb9f-4940-acad-b86f674a7f28 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:20.168606 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17e978-cb9f-4940-acad-b86f674a7f28 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:20.168854 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17e978-cb9f-4940-acad-b86f674a7f28 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:20.170213 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 57/117] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:20.170783 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17e978-cb9f-4940-acad-b86f674a7f28 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:20.181025 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3587fce-3c1e-4438-b719-1a0288b44e05 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:20.212996 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9d310-eb80-434b-95f3-faf0240c0a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:20.214678 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9d310-eb80-434b-95f3-faf0240c0a69 None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:20.214967 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9d310-eb80-434b-95f3-faf0240c0a69 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:20.215249 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9d310-eb80-434b-95f3-faf0240c0a69 None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d/users/80fe3955cd0843e783a1c35d76b757b9/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:20.217274 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9d310-eb80-434b-95f3-faf0240c0a69 None admin] RBAC: Authorizing `identity:create_grant(project_id=029a84f386ce4e48b750a76626f65b2d, user_id=80fe3955cd0843e783a1c35d76b757b9, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:20.218715 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9d310-eb80-434b-95f3-faf0240c0a69 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:20.231587 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 61/118] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:41:20 2022] PUT /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d/users/80fe3955cd0843e783a1c35d76b757b9/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:41:20.232942 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8657f2-4c83-49cc-a07d-5929c632df5d None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:20.233237 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8657f2-4c83-49cc-a07d-5929c632df5d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:20.233538 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8657f2-4c83-49cc-a07d-5929c632df5d None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:20.234801 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 62/119] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:20.235579 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8657f2-4c83-49cc-a07d-5929c632df5d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:20.280676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17e978-cb9f-4940-acad-b86f674a7f28 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:20.318806 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865be7c8-43bc-4907-8c14-a2dd63e1e5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:20.319558 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865be7c8-43bc-4907-8c14-a2dd63e1e5f4 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:20.319864 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865be7c8-43bc-4907-8c14-a2dd63e1e5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:20.320147 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865be7c8-43bc-4907-8c14-a2dd63e1e5f4 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:20.321019 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865be7c8-43bc-4907-8c14-a2dd63e1e5f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:20.321305 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865be7c8-43bc-4907-8c14-a2dd63e1e5f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:20.322772 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865be7c8-43bc-4907-8c14-a2dd63e1e5f4 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:20.339673 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 58/120] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:20.339673 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865be7c8-43bc-4907-8c14-a2dd63e1e5f4 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:20.350956 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8657f2-4c83-49cc-a07d-5929c632df5d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:20.389971 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2eb13-ec3f-42de-aaa6-0031a32b7512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:20.390863 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2eb13-ec3f-42de-aaa6-0031a32b7512 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:20.391148 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2eb13-ec3f-42de-aaa6-0031a32b7512 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:20.391424 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2eb13-ec3f-42de-aaa6-0031a32b7512 None admin] PATH_INFO: `/v3/users/80fe3955cd0843e783a1c35d76b757b9` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:20.394863 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2eb13-ec3f-42de-aaa6-0031a32b7512 None admin] RBAC: Authorizing `identity:get_user(user_id=80fe3955cd0843e783a1c35d76b757b9)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:20.394863 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2eb13-ec3f-42de-aaa6-0031a32b7512 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:20.396187 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 63/121] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:20 2022] GET /identity/v3/users/80fe3955cd0843e783a1c35d76b757b9 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:20.397425 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a895bb3-10af-4da1-98c9-5c729f1d5fd5 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:20.397714 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a895bb3-10af-4da1-98c9-5c729f1d5fd5 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:20.397998 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a895bb3-10af-4da1-98c9-5c729f1d5fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:20.419500 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-6a895bb3-10af-4da1-98c9-5c729f1d5fd5 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:20.420774 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6a895bb3-10af-4da1-98c9-5c729f1d5fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:20.451981 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865be7c8-43bc-4907-8c14-a2dd63e1e5f4 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:20.490743 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 64/122] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:20.491171 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9745f2-5c70-473b-a467-7dcfcd7cccdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:20.492196 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9745f2-5c70-473b-a467-7dcfcd7cccdb None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:20.492553 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9745f2-5c70-473b-a467-7dcfcd7cccdb None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:20.492953 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9745f2-5c70-473b-a467-7dcfcd7cccdb None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d/users/a8b5e2d388d34b24a1ace24c7c6fb803/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:20.493150 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aad896-7bcb-4731-963c-b106aab059c1 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:20.493615 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aad896-7bcb-4731-963c-b106aab059c1 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:20.494093 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aad896-7bcb-4731-963c-b106aab059c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:20.500546 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9745f2-5c70-473b-a467-7dcfcd7cccdb None admin] RBAC: Authorizing `identity:create_grant(project_id=029a84f386ce4e48b750a76626f65b2d, user_id=a8b5e2d388d34b24a1ace24c7c6fb803, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:20.502211 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9745f2-5c70-473b-a467-7dcfcd7cccdb None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:20.518540 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e0aad896-7bcb-4731-963c-b106aab059c1 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:20.519878 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e0aad896-7bcb-4731-963c-b106aab059c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:20.521013 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 59/123] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:41:20 2022] PUT /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d/users/a8b5e2d388d34b24a1ace24c7c6fb803/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:41:20.522171 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9745f2-5c70-473b-a467-7dcfcd7cccdb None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:20.603693 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 65/124] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:20.605042 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aad896-7bcb-4731-963c-b106aab059c1 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:20.656338 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9745f2-5c70-473b-a467-7dcfcd7cccdb None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:20.702299 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ced96-3193-476b-8f0f-04cab41d7e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:20.704190 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ced96-3193-476b-8f0f-04cab41d7e76 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:20.704490 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ced96-3193-476b-8f0f-04cab41d7e76 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:20.704773 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ced96-3193-476b-8f0f-04cab41d7e76 None admin] PATH_INFO: `/v3/users/80fe3955cd0843e783a1c35d76b757b9` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:20.706568 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ced96-3193-476b-8f0f-04cab41d7e76 None admin] RBAC: Authorizing `identity:get_user(user_id=80fe3955cd0843e783a1c35d76b757b9)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:20.712392 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ced96-3193-476b-8f0f-04cab41d7e76 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:20.714353 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 60/125] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:20 2022] GET /identity/v3/users/80fe3955cd0843e783a1c35d76b757b9 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:20.715146 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ced96-3193-476b-8f0f-04cab41d7e76 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:20.742569 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aad896-7bcb-4731-963c-b106aab059c1 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:20.777304 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242087b-4cf9-49f6-9d41-f2bd1d0afd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:20.778177 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242087b-4cf9-49f6-9d41-f2bd1d0afd54 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:20.778459 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242087b-4cf9-49f6-9d41-f2bd1d0afd54 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:20.778905 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242087b-4cf9-49f6-9d41-f2bd1d0afd54 None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:20.780361 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242087b-4cf9-49f6-9d41-f2bd1d0afd54 None admin] RBAC: Authorizing `identity:get_project(project_id=029a84f386ce4e48b750a76626f65b2d)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:20.781846 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e242087b-4cf9-49f6-9d41-f2bd1d0afd54 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:20.783685 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 66/126] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:20 2022] GET /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:20.784407 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242087b-4cf9-49f6-9d41-f2bd1d0afd54 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:20.826998 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ced96-3193-476b-8f0f-04cab41d7e76 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:20.861869 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73781256-c2f5-48f7-98e4-f839b99aff1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:20.862617 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73781256-c2f5-48f7-98e4-f839b99aff1e None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:20.862901 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73781256-c2f5-48f7-98e4-f839b99aff1e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:20.863177 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73781256-c2f5-48f7-98e4-f839b99aff1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:20.874289 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73781256-c2f5-48f7-98e4-f839b99aff1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:20.881562 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-73781256-c2f5-48f7-98e4-f839b99aff1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 13:41:20.882827 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 61/127] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:20.883637 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73781256-c2f5-48f7-98e4-f839b99aff1e None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:20.892405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242087b-4cf9-49f6-9d41-f2bd1d0afd54 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:20.926220 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3ab63-be48-4a91-83bf-7ffc0bcc4e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:20.927365 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3ab63-be48-4a91-83bf-7ffc0bcc4e30 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:20.927903 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3ab63-be48-4a91-83bf-7ffc0bcc4e30 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:20.928405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3ab63-be48-4a91-83bf-7ffc0bcc4e30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:20.929794 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3ab63-be48-4a91-83bf-7ffc0bcc4e30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:20.931455 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3ab63-be48-4a91-83bf-7ffc0bcc4e30 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:20.933931 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 67/128] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:41:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:20.934905 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3ab63-be48-4a91-83bf-7ffc0bcc4e30 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:20.992966 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73781256-c2f5-48f7-98e4-f839b99aff1e None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:21.029919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafaa006-04a7-46a5-bc23-c8f243f86383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:21.030847 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafaa006-04a7-46a5-bc23-c8f243f86383 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:21.031141 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafaa006-04a7-46a5-bc23-c8f243f86383 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:21.031426 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafaa006-04a7-46a5-bc23-c8f243f86383 None admin] PATH_INFO: `/v3/projects/9925178d3a324d0faecb1788c31fe0c9` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:21.032739 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafaa006-04a7-46a5-bc23-c8f243f86383 None admin] RBAC: Authorizing `identity:get_project(project_id=9925178d3a324d0faecb1788c31fe0c9)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:21.034240 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafaa006-04a7-46a5-bc23-c8f243f86383 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:21.036141 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 62/129] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:20 2022] GET /identity/v3/projects/9925178d3a324d0faecb1788c31fe0c9 => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:21.036918 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafaa006-04a7-46a5-bc23-c8f243f86383 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:21.039618 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3ab63-be48-4a91-83bf-7ffc0bcc4e30 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:21.087817 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022083e-645c-49b4-9566-6a0b809b97ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:21.088788 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022083e-645c-49b4-9566-6a0b809b97ee None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:21.089080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022083e-645c-49b4-9566-6a0b809b97ee None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:21.089355 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022083e-645c-49b4-9566-6a0b809b97ee None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d/users/80fe3955cd0843e783a1c35d76b757b9/roles/fbb7398610b649859d123d0938aa8e75` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:21.094302 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022083e-645c-49b4-9566-6a0b809b97ee None admin] RBAC: Authorizing `identity:create_grant(project_id=029a84f386ce4e48b750a76626f65b2d, user_id=80fe3955cd0843e783a1c35d76b757b9, role_id=fbb7398610b649859d123d0938aa8e75)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:21.096272 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022083e-645c-49b4-9566-6a0b809b97ee None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:21.112969 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 68/130] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:41:20 2022] PUT /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d/users/80fe3955cd0843e783a1c35d76b757b9/roles/fbb7398610b649859d123d0938aa8e75 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:41:21.113629 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022083e-645c-49b4-9566-6a0b809b97ee None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:21.141933 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafaa006-04a7-46a5-bc23-c8f243f86383 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:21.178407 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdfadf-b469-49f5-9fa5-4e2ffb28f5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:21.179085 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdfadf-b469-49f5-9fa5-4e2ffb28f5de None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:21.179370 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdfadf-b469-49f5-9fa5-4e2ffb28f5de None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:21.179667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdfadf-b469-49f5-9fa5-4e2ffb28f5de None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:21.180438 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdfadf-b469-49f5-9fa5-4e2ffb28f5de None admin] RBAC: Adding query filter params (name=reader) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:21.180750 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdfadf-b469-49f5-9fa5-4e2ffb28f5de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:21.182176 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdfadf-b469-49f5-9fa5-4e2ffb28f5de None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:21.191594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 63/131] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:21.193513 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdfadf-b469-49f5-9fa5-4e2ffb28f5de None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:21.278923 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022083e-645c-49b4-9566-6a0b809b97ee None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:21.315010 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf903b-93bc-4769-a903-82e0a8866a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:21.315789 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf903b-93bc-4769-a903-82e0a8866a7a None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:21.316080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf903b-93bc-4769-a903-82e0a8866a7a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:21.316361 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf903b-93bc-4769-a903-82e0a8866a7a None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:21.317136 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf903b-93bc-4769-a903-82e0a8866a7a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:21.318609 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf903b-93bc-4769-a903-82e0a8866a7a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:21.326350 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdfadf-b469-49f5-9fa5-4e2ffb28f5de None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:21.364675 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 69/132] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Apr 11 13:41:21 2022] POST /identity/v3/projects => generated 302 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:41:21.365966 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf903b-93bc-4769-a903-82e0a8866a7a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:21.367200 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032db1e-73bc-4310-89c5-9733c8795c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:21.368152 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032db1e-73bc-4310-89c5-9733c8795c52 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:21.368435 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032db1e-73bc-4310-89c5-9733c8795c52 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:21.368711 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032db1e-73bc-4310-89c5-9733c8795c52 None admin] PATH_INFO: `/v3/projects/9925178d3a324d0faecb1788c31fe0c9/users/80fe3955cd0843e783a1c35d76b757b9/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:21.372328 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032db1e-73bc-4310-89c5-9733c8795c52 None admin] RBAC: Authorizing `identity:create_grant(project_id=9925178d3a324d0faecb1788c31fe0c9, user_id=80fe3955cd0843e783a1c35d76b757b9, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:21.373186 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032db1e-73bc-4310-89c5-9733c8795c52 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:21.393973 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 64/133] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:41:21 2022] PUT /identity/v3/projects/9925178d3a324d0faecb1788c31fe0c9/users/80fe3955cd0843e783a1c35d76b757b9/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:41:21.526667 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf903b-93bc-4769-a903-82e0a8866a7a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:21.572674 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b969d-783e-4980-a7fb-fec5308ed0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:21.574613 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b969d-783e-4980-a7fb-fec5308ed0d2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:21.575109 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b969d-783e-4980-a7fb-fec5308ed0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:21.575584 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b969d-783e-4980-a7fb-fec5308ed0d2 None admin] PATH_INFO: `/v3/users/db80f278a3b94471ae5e3d871f83c9aa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:21.600983 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b969d-783e-4980-a7fb-fec5308ed0d2 None admin] RBAC: Authorizing `identity:get_user(user_id=db80f278a3b94471ae5e3d871f83c9aa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:21.602942 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b969d-783e-4980-a7fb-fec5308ed0d2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:21.605658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 70/134] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:21 2022] GET /identity/v3/users/db80f278a3b94471ae5e3d871f83c9aa => generated 289 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:21.611708 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032db1e-73bc-4310-89c5-9733c8795c52 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:21.727139 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032db1e-73bc-4310-89c5-9733c8795c52 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:21.762691 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bd4ca-abd9-41e8-abd1-bfe97c12a01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:21.763358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bd4ca-abd9-41e8-abd1-bfe97c12a01c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:21.763672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bd4ca-abd9-41e8-abd1-bfe97c12a01c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:21.763942 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bd4ca-abd9-41e8-abd1-bfe97c12a01c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:21.832204 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204bd4ca-abd9-41e8-abd1-bfe97c12a01c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:21.833697 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204bd4ca-abd9-41e8-abd1-bfe97c12a01c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:21.931405 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 65/135] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:41:21.938321 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b969d-783e-4980-a7fb-fec5308ed0d2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:22.079402 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b969d-783e-4980-a7fb-fec5308ed0d2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:22.114953 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e4c44-849f-4ae4-9ed5-f9fb44bc8fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:22.116264 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e4c44-849f-4ae4-9ed5-f9fb44bc8fdf None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:22.116746 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e4c44-849f-4ae4-9ed5-f9fb44bc8fdf None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:22.117270 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e4c44-849f-4ae4-9ed5-f9fb44bc8fdf None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:22.118682 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e4c44-849f-4ae4-9ed5-f9fb44bc8fdf None admin] RBAC: Authorizing `identity:get_project(project_id=029a84f386ce4e48b750a76626f65b2d)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:22.120411 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e4c44-849f-4ae4-9ed5-f9fb44bc8fdf None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:22.122367 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 71/136] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:21 2022] GET /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:22.128396 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bd4ca-abd9-41e8-abd1-bfe97c12a01c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:22.277869 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bd4ca-abd9-41e8-abd1-bfe97c12a01c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:22.318712 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47993914-9fa7-4422-bfc2-acc2729904ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:22.319370 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47993914-9fa7-4422-bfc2-acc2729904ac None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:22.319674 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47993914-9fa7-4422-bfc2-acc2729904ac None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:22.319959 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47993914-9fa7-4422-bfc2-acc2729904ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:22.320791 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47993914-9fa7-4422-bfc2-acc2729904ac None admin] RBAC: Adding query filter params (role.id=d6ff23054a6c45d1b4e7e5da9305d7f3, scope.project.id=029a84f386ce4e48b750a76626f65b2d, user.id=db80f278a3b94471ae5e3d871f83c9aa) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:22.321104 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47993914-9fa7-4422-bfc2-acc2729904ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:22.323137 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47993914-9fa7-4422-bfc2-acc2729904ac None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:22.329011 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 66/137] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:41:22 2022] GET /identity/v3/role_assignments?user.id=db80f278a3b94471ae5e3d871f83c9aa&scope.project.id=029a84f386ce4e48b750a76626f65b2d&role.id=d6ff23054a6c45d1b4e7e5da9305d7f3 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:23.109761 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8da0a-642f-4d72-9be8-716349eddb33 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:23.110769 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8da0a-642f-4d72-9be8-716349eddb33 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:23.111251 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8da0a-642f-4d72-9be8-716349eddb33 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:23.113085 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 72/138] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:23.118507 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60379141-dcd9-4f65-84e2-ff4b1f85e099 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:23.119929 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60379141-dcd9-4f65-84e2-ff4b1f85e099 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:23.120542 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60379141-dcd9-4f65-84e2-ff4b1f85e099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:23.138215 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-60379141-dcd9-4f65-84e2-ff4b1f85e099 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:23.139774 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-60379141-dcd9-4f65-84e2-ff4b1f85e099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:23.220013 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 67/139] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:23.256613 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8da0a-642f-4d72-9be8-716349eddb33 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:23.402959 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8da0a-642f-4d72-9be8-716349eddb33 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:23.444972 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e3130-9205-4202-af2c-f95aa7e9a84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:23.446152 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e3130-9205-4202-af2c-f95aa7e9a84f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:23.446639 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e3130-9205-4202-af2c-f95aa7e9a84f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:23.447179 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e3130-9205-4202-af2c-f95aa7e9a84f None admin] PATH_INFO: `/v3/roles/member` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:23.464108 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e3130-9205-4202-af2c-f95aa7e9a84f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:23.471444 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-0c1e3130-9205-4202-af2c-f95aa7e9a84f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 13:41:23.472865 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 73/140] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:23.479472 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60379141-dcd9-4f65-84e2-ff4b1f85e099 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:23.618201 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04093ae0-380a-4a7c-9039-2e2ff539816e None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:23.618591 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04093ae0-380a-4a7c-9039-2e2ff539816e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:23.618954 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04093ae0-380a-4a7c-9039-2e2ff539816e None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:23.621309 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 74/141] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:41:23.626075 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfd325-c4bb-4cab-9b80-3352f4737827 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:23.626795 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfd325-c4bb-4cab-9b80-3352f4737827 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:23.627150 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfd325-c4bb-4cab-9b80-3352f4737827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:23.630693 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60379141-dcd9-4f65-84e2-ff4b1f85e099 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:23.656925 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a3cfd325-c4bb-4cab-9b80-3352f4737827 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:23.658281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a3cfd325-c4bb-4cab-9b80-3352f4737827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:23.704325 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06139780-7e96-48f9-886e-84a1bde7422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:23.705317 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06139780-7e96-48f9-886e-84a1bde7422f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:23.705780 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06139780-7e96-48f9-886e-84a1bde7422f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:23.706251 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06139780-7e96-48f9-886e-84a1bde7422f None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:23.707242 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06139780-7e96-48f9-886e-84a1bde7422f None admin] RBAC: Adding query filter params (name=member) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:23.707756 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06139780-7e96-48f9-886e-84a1bde7422f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:23.709311 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06139780-7e96-48f9-886e-84a1bde7422f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:23.720605 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 68/142] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:23.734049 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06139780-7e96-48f9-886e-84a1bde7422f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:23.778571 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 75/143] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:41:23.816433 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfd325-c4bb-4cab-9b80-3352f4737827 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:23.934022 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06139780-7e96-48f9-886e-84a1bde7422f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:24.001586 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfd325-c4bb-4cab-9b80-3352f4737827 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:24.002203 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e431c-4399-4aa4-82fd-d6999a3611e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:24.003260 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e431c-4399-4aa4-82fd-d6999a3611e6 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:24.003556 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e431c-4399-4aa4-82fd-d6999a3611e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:24.003868 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e431c-4399-4aa4-82fd-d6999a3611e6 None admin] PATH_INFO: `/v3/users/80fe3955cd0843e783a1c35d76b757b9` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:24.005101 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e431c-4399-4aa4-82fd-d6999a3611e6 None admin] RBAC: Authorizing `identity:get_user(user_id=80fe3955cd0843e783a1c35d76b757b9)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:24.006582 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e431c-4399-4aa4-82fd-d6999a3611e6 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:24.008264 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 69/144] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:23 2022] GET /identity/v3/users/80fe3955cd0843e783a1c35d76b757b9 => generated 275 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:24.015060 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e431c-4399-4aa4-82fd-d6999a3611e6 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:24.082203 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d613d7-24b6-4bdc-8368-b02e99886ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:24.083013 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d613d7-24b6-4bdc-8368-b02e99886ee9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:24.083303 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d613d7-24b6-4bdc-8368-b02e99886ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:24.083586 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d613d7-24b6-4bdc-8368-b02e99886ee9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:24.113236 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d613d7-24b6-4bdc-8368-b02e99886ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:24.120355 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-b7d613d7-24b6-4bdc-8368-b02e99886ee9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:41:24.128125 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 76/145] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:41:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:24.129010 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d613d7-24b6-4bdc-8368-b02e99886ee9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:24.175761 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e431c-4399-4aa4-82fd-d6999a3611e6 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:24.232439 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e13b4-123a-4228-bc62-16b0f1206398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:24.233890 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e13b4-123a-4228-bc62-16b0f1206398 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:24.234182 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e13b4-123a-4228-bc62-16b0f1206398 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:24.234465 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e13b4-123a-4228-bc62-16b0f1206398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:24.320758 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e13b4-123a-4228-bc62-16b0f1206398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:24.322322 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e13b4-123a-4228-bc62-16b0f1206398 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:24.342874 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d613d7-24b6-4bdc-8368-b02e99886ee9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:24.400341 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2a6d4-8177-40a1-a2ac-292e4d147591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:24.401277 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2a6d4-8177-40a1-a2ac-292e4d147591 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:24.407679 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2a6d4-8177-40a1-a2ac-292e4d147591 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:24.407679 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2a6d4-8177-40a1-a2ac-292e4d147591 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:24.407679 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2a6d4-8177-40a1-a2ac-292e4d147591 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:24.407679 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2a6d4-8177-40a1-a2ac-292e4d147591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:24.407679 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2a6d4-8177-40a1-a2ac-292e4d147591 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:24.422750 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 77/146] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:24.428366 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2a6d4-8177-40a1-a2ac-292e4d147591 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:24.435150 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 70/147] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 13:41:24.440872 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e13b4-123a-4228-bc62-16b0f1206398 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:24.543545 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e13b4-123a-4228-bc62-16b0f1206398 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:24.576711 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2a6d4-8177-40a1-a2ac-292e4d147591 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:24.582011 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd4856-4ec7-4412-adee-7ba6a24f2a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:24.582897 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd4856-4ec7-4412-adee-7ba6a24f2a0d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:24.583185 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd4856-4ec7-4412-adee-7ba6a24f2a0d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:24.583468 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd4856-4ec7-4412-adee-7ba6a24f2a0d None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:24.584775 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd4856-4ec7-4412-adee-7ba6a24f2a0d None admin] RBAC: Authorizing `identity:get_project(project_id=029a84f386ce4e48b750a76626f65b2d)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:24.586296 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd4856-4ec7-4412-adee-7ba6a24f2a0d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:24.588827 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 71/148] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:24 2022] GET /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:24.594975 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd4856-4ec7-4412-adee-7ba6a24f2a0d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:24.613062 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb1663-ba9c-489c-8b1f-d3e97446bcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:24.614403 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb1663-ba9c-489c-8b1f-d3e97446bcdc None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:24.614696 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb1663-ba9c-489c-8b1f-d3e97446bcdc None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:24.614975 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb1663-ba9c-489c-8b1f-d3e97446bcdc None admin] PATH_INFO: `/v3/users/a8b5e2d388d34b24a1ace24c7c6fb803` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:24.616427 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb1663-ba9c-489c-8b1f-d3e97446bcdc None admin] RBAC: Authorizing `identity:get_user(user_id=a8b5e2d388d34b24a1ace24c7c6fb803)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:24.618336 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb1663-ba9c-489c-8b1f-d3e97446bcdc None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:24.621430 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 78/149] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:24 2022] GET /identity/v3/users/a8b5e2d388d34b24a1ace24c7c6fb803 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:24.627247 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb1663-ba9c-489c-8b1f-d3e97446bcdc None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:24.702185 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd4856-4ec7-4412-adee-7ba6a24f2a0d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:24.751004 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977ef17-c808-4f0b-b6d1-083b249ffd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:24.751708 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977ef17-c808-4f0b-b6d1-083b249ffd2c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:24.752663 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977ef17-c808-4f0b-b6d1-083b249ffd2c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:24.754188 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977ef17-c808-4f0b-b6d1-083b249ffd2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:24.755044 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977ef17-c808-4f0b-b6d1-083b249ffd2c None admin] RBAC: Adding query filter params (role.id=3daf622d91e64ce685da6f482aa181ea, scope.project.id=029a84f386ce4e48b750a76626f65b2d, user.id=80fe3955cd0843e783a1c35d76b757b9) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:24.755366 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977ef17-c808-4f0b-b6d1-083b249ffd2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:24.756862 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977ef17-c808-4f0b-b6d1-083b249ffd2c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:24.761999 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb1663-ba9c-489c-8b1f-d3e97446bcdc None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:24.779748 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 72/150] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:41:24 2022] GET /identity/v3/role_assignments?user.id=80fe3955cd0843e783a1c35d76b757b9&scope.project.id=029a84f386ce4e48b750a76626f65b2d&role.id=3daf622d91e64ce685da6f482aa181ea => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:24.805884 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6045854-e8d4-4de4-bde0-3fd9ebf57c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:24.806478 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6045854-e8d4-4de4-bde0-3fd9ebf57c09 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:24.807288 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6045854-e8d4-4de4-bde0-3fd9ebf57c09 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:24.807575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6045854-e8d4-4de4-bde0-3fd9ebf57c09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:24.888903 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6045854-e8d4-4de4-bde0-3fd9ebf57c09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:24.890476 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6045854-e8d4-4de4-bde0-3fd9ebf57c09 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:24.981787 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c06949-0776-4117-b86e-c83c04869a6b None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:24.982104 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c06949-0776-4117-b86e-c83c04869a6b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:24.982355 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c06949-0776-4117-b86e-c83c04869a6b None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:24.984182 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 73/151] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:24.990101 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6d51-3dfd-43b5-a463-6a16116aba8c None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:24.990101 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6d51-3dfd-43b5-a463-6a16116aba8c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:24.990101 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab6d51-3dfd-43b5-a463-6a16116aba8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:25.017465 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-38ab6d51-3dfd-43b5-a463-6a16116aba8c None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:25.020800 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 79/152] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:41:25.026154 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-38ab6d51-3dfd-43b5-a463-6a16116aba8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:25.031539 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6045854-e8d4-4de4-bde0-3fd9ebf57c09 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:25.140826 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 74/153] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:41:25.181971 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab6d51-3dfd-43b5-a463-6a16116aba8c None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:25.200180 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6045854-e8d4-4de4-bde0-3fd9ebf57c09 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:25.238320 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58489ea2-7d63-43ec-9d5c-81280f2af4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:25.239208 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58489ea2-7d63-43ec-9d5c-81280f2af4c2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:25.239492 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58489ea2-7d63-43ec-9d5c-81280f2af4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:25.239876 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58489ea2-7d63-43ec-9d5c-81280f2af4c2 None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:25.241231 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58489ea2-7d63-43ec-9d5c-81280f2af4c2 None admin] RBAC: Authorizing `identity:get_project(project_id=029a84f386ce4e48b750a76626f65b2d)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:25.242675 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58489ea2-7d63-43ec-9d5c-81280f2af4c2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:25.244984 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 80/154] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:25 2022] GET /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:25.253850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58489ea2-7d63-43ec-9d5c-81280f2af4c2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:25.346592 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab6d51-3dfd-43b5-a463-6a16116aba8c None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:25.367765 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58489ea2-7d63-43ec-9d5c-81280f2af4c2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:25.387191 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875081c-ea0d-434a-ad95-ecc069e025ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:25.388058 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875081c-ea0d-434a-ad95-ecc069e025ad None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:25.388339 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875081c-ea0d-434a-ad95-ecc069e025ad None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:25.388622 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875081c-ea0d-434a-ad95-ecc069e025ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:25.398795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875081c-ea0d-434a-ad95-ecc069e025ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:25.406364 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4643f38-0447-4f11-8563-9b2cb1df175b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:25.407031 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4643f38-0447-4f11-8563-9b2cb1df175b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:25.407131 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-b875081c-ea0d-434a-ad95-ecc069e025ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 13:41:25.407323 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4643f38-0447-4f11-8563-9b2cb1df175b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:25.407601 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4643f38-0447-4f11-8563-9b2cb1df175b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:25.408613 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 75/155] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:41:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:25.408726 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4643f38-0447-4f11-8563-9b2cb1df175b None admin] RBAC: Adding query filter params (role.id=e3333fcf22b040e3a1f0bfbfe657cffa, scope.project.id=029a84f386ce4e48b750a76626f65b2d, user.id=a8b5e2d388d34b24a1ace24c7c6fb803) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:25.408877 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4643f38-0447-4f11-8563-9b2cb1df175b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:25.410349 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4643f38-0447-4f11-8563-9b2cb1df175b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:25.413076 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d3888-0cf8-4a50-aaf0-ab88941f72ee None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:25.413774 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d3888-0cf8-4a50-aaf0-ab88941f72ee None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:25.413774 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d3888-0cf8-4a50-aaf0-ab88941f72ee None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:25.415066 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 76/156] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:25.417491 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 81/157] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:41:25 2022] GET /identity/v3/role_assignments?user.id=a8b5e2d388d34b24a1ace24c7c6fb803&scope.project.id=029a84f386ce4e48b750a76626f65b2d&role.id=e3333fcf22b040e3a1f0bfbfe657cffa => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:25.418083 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a85cc5-d704-4b4f-9ca2-bb1040d71834 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:25.418605 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a85cc5-d704-4b4f-9ca2-bb1040d71834 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:25.419097 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a85cc5-d704-4b4f-9ca2-bb1040d71834 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:25.420475 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4643f38-0447-4f11-8563-9b2cb1df175b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:25.420926 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 77/158] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:25.422254 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c602ad2-4929-4577-a745-037dacc6ea9e None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:25.422735 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c602ad2-4929-4577-a745-037dacc6ea9e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:25.423445 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c602ad2-4929-4577-a745-037dacc6ea9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:25.453443 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0c602ad2-4929-4577-a745-037dacc6ea9e None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:25.455857 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0c602ad2-4929-4577-a745-037dacc6ea9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:25.532787 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4643f38-0447-4f11-8563-9b2cb1df175b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:25.551695 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 78/159] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:25.553363 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ed237-d923-4afa-8224-801076d8a038 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:25.553851 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ed237-d923-4afa-8224-801076d8a038 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:25.554320 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ed237-d923-4afa-8224-801076d8a038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:25.585337 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-724ed237-d923-4afa-8224-801076d8a038 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:25.586863 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-724ed237-d923-4afa-8224-801076d8a038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:25.594291 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c03706-0a93-44b6-aeaa-980caf0b8a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:25.595367 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c03706-0a93-44b6-aeaa-980caf0b8a37 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:25.595942 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c03706-0a93-44b6-aeaa-980caf0b8a37 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:25.596466 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c03706-0a93-44b6-aeaa-980caf0b8a37 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:25.597455 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c03706-0a93-44b6-aeaa-980caf0b8a37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:25.597973 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c03706-0a93-44b6-aeaa-980caf0b8a37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:25.599682 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c03706-0a93-44b6-aeaa-980caf0b8a37 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:25.610445 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 82/160] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:41:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:25.611852 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c03706-0a93-44b6-aeaa-980caf0b8a37 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:25.668269 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 79/161] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:25.669419 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ed237-d923-4afa-8224-801076d8a038 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:25.730462 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c03706-0a93-44b6-aeaa-980caf0b8a37 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:25.768743 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e5b72-baa7-43fb-9d17-9c1c87ff28b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:25.769550 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e5b72-baa7-43fb-9d17-9c1c87ff28b4 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:25.769841 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e5b72-baa7-43fb-9d17-9c1c87ff28b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:25.770127 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e5b72-baa7-43fb-9d17-9c1c87ff28b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:25.771299 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e5b72-baa7-43fb-9d17-9c1c87ff28b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:25.772797 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e5b72-baa7-43fb-9d17-9c1c87ff28b4 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:25.774604 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 83/162] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:41:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:25.775188 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e5b72-baa7-43fb-9d17-9c1c87ff28b4 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:25.806571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ed237-d923-4afa-8224-801076d8a038 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:25.842291 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d4b31-b54a-4eb7-a171-95148f9d556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:25.843155 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d4b31-b54a-4eb7-a171-95148f9d556f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:25.843444 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d4b31-b54a-4eb7-a171-95148f9d556f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:25.843798 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d4b31-b54a-4eb7-a171-95148f9d556f None admin] PATH_INFO: `/v3/users/80fe3955cd0843e783a1c35d76b757b9` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:25.845381 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d4b31-b54a-4eb7-a171-95148f9d556f None admin] RBAC: Authorizing `identity:get_user(user_id=80fe3955cd0843e783a1c35d76b757b9)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:25.846838 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d4b31-b54a-4eb7-a171-95148f9d556f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:25.848523 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 80/163] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:25 2022] GET /identity/v3/users/80fe3955cd0843e783a1c35d76b757b9 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:25.853231 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d4b31-b54a-4eb7-a171-95148f9d556f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:25.877247 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e5b72-baa7-43fb-9d17-9c1c87ff28b4 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:25.911495 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2eceb-b5ad-46f5-9ae3-5e0625aa3e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:25.912358 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2eceb-b5ad-46f5-9ae3-5e0625aa3e01 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:25.912595 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2eceb-b5ad-46f5-9ae3-5e0625aa3e01 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:25.912878 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2eceb-b5ad-46f5-9ae3-5e0625aa3e01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:25.923539 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2eceb-b5ad-46f5-9ae3-5e0625aa3e01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:25.930506 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-b5a2eceb-b5ad-46f5-9ae3-5e0625aa3e01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 13:41:25.931791 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 84/164] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:25.933061 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2eceb-b5ad-46f5-9ae3-5e0625aa3e01 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:25.957661 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d4b31-b54a-4eb7-a171-95148f9d556f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:25.993258 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ffe93-10c8-49fd-9c37-d22a0fc016bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:25.993928 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ffe93-10c8-49fd-9c37-d22a0fc016bf None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:25.994246 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ffe93-10c8-49fd-9c37-d22a0fc016bf None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:25.994522 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ffe93-10c8-49fd-9c37-d22a0fc016bf None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:25.995235 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ffe93-10c8-49fd-9c37-d22a0fc016bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:25.996717 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ffe93-10c8-49fd-9c37-d22a0fc016bf None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:26.016020 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 81/165] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Apr 11 13:41:25 2022] POST /identity/v3/users => generated 283 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:41:26.016836 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ffe93-10c8-49fd-9c37-d22a0fc016bf None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:26.043787 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2eceb-b5ad-46f5-9ae3-5e0625aa3e01 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:26.082820 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122de4b7-1518-4db5-8806-5eb5248492b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:26.083850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122de4b7-1518-4db5-8806-5eb5248492b4 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:26.084336 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122de4b7-1518-4db5-8806-5eb5248492b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:26.084756 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122de4b7-1518-4db5-8806-5eb5248492b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:26.127146 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ffe93-10c8-49fd-9c37-d22a0fc016bf None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:26.164290 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122de4b7-1518-4db5-8806-5eb5248492b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:26.166343 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122de4b7-1518-4db5-8806-5eb5248492b4 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:26.166499 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7b16f-46ac-4350-9e62-7a2d7e14ad77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:26.167137 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7b16f-46ac-4350-9e62-7a2d7e14ad77 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:26.167415 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7b16f-46ac-4350-9e62-7a2d7e14ad77 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:26.167717 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7b16f-46ac-4350-9e62-7a2d7e14ad77 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:26.168493 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7b16f-46ac-4350-9e62-7a2d7e14ad77 None admin] RBAC: Adding query filter params (name=member) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:26.168795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7b16f-46ac-4350-9e62-7a2d7e14ad77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:26.170199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7b16f-46ac-4350-9e62-7a2d7e14ad77 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:26.179302 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 82/166] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:26.180671 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd910ad1-691d-4856-9d4d-9d28d0330df1 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:26.180956 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd910ad1-691d-4856-9d4d-9d28d0330df1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:26.181227 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd910ad1-691d-4856-9d4d-9d28d0330df1 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:26.183621 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 83/167] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:26.188422 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd910ad1-691d-4856-9d4d-9d28d0330df1 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:26.271451 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 85/168] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:41:26.273357 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074b3ae-eca2-4d56-ac7e-827e062e9bba None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:26.273648 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074b3ae-eca2-4d56-ac7e-827e062e9bba None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:26.273925 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074b3ae-eca2-4d56-ac7e-827e062e9bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:26.291691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-2074b3ae-eca2-4d56-ac7e-827e062e9bba None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:26.292892 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2074b3ae-eca2-4d56-ac7e-827e062e9bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:26.302529 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd910ad1-691d-4856-9d4d-9d28d0330df1 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:26.344338 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6c0d9-bcfd-4341-b77a-d716c13b0f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:26.345220 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6c0d9-bcfd-4341-b77a-d716c13b0f8f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:26.345501 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6c0d9-bcfd-4341-b77a-d716c13b0f8f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:26.345781 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6c0d9-bcfd-4341-b77a-d716c13b0f8f None admin] PATH_INFO: `/v3/users/80fe3955cd0843e783a1c35d76b757b9` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:26.347833 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6c0d9-bcfd-4341-b77a-d716c13b0f8f None admin] RBAC: Authorizing `identity:get_user(user_id=80fe3955cd0843e783a1c35d76b757b9)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:26.349299 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6c0d9-bcfd-4341-b77a-d716c13b0f8f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:26.350955 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 84/169] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:26 2022] GET /identity/v3/users/80fe3955cd0843e783a1c35d76b757b9 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:26.352378 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6c0d9-bcfd-4341-b77a-d716c13b0f8f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:26.366839 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 86/170] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:26.367829 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074b3ae-eca2-4d56-ac7e-827e062e9bba None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:26.485048 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6c0d9-bcfd-4341-b77a-d716c13b0f8f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:26.490608 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074b3ae-eca2-4d56-ac7e-827e062e9bba None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:26.526896 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d749baf-f39c-4a2a-a0de-771c673bc6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:26.527798 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d749baf-f39c-4a2a-a0de-771c673bc6ca None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:26.528175 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d749baf-f39c-4a2a-a0de-771c673bc6ca None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:26.528346 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d749baf-f39c-4a2a-a0de-771c673bc6ca None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:26.530033 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d749baf-f39c-4a2a-a0de-771c673bc6ca None admin] RBAC: Authorizing `identity:get_project(project_id=029a84f386ce4e48b750a76626f65b2d)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:26.531493 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d749baf-f39c-4a2a-a0de-771c673bc6ca None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:26.533308 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 85/171] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:26 2022] GET /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:26.534083 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d749baf-f39c-4a2a-a0de-771c673bc6ca None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:26.534883 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377d00c-d93f-401e-8493-599b10da1706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:26.535791 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377d00c-d93f-401e-8493-599b10da1706 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:26.536256 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377d00c-d93f-401e-8493-599b10da1706 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:26.536707 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377d00c-d93f-401e-8493-599b10da1706 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:26.624629 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377d00c-d93f-401e-8493-599b10da1706 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:26.626398 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377d00c-d93f-401e-8493-599b10da1706 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:26.655797 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d749baf-f39c-4a2a-a0de-771c673bc6ca None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:26.690670 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a5416-75ec-4065-b5a7-482c46e266cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:26.691840 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a5416-75ec-4065-b5a7-482c46e266cb None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:26.692323 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a5416-75ec-4065-b5a7-482c46e266cb None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:26.692793 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a5416-75ec-4065-b5a7-482c46e266cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:26.703735 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a5416-75ec-4065-b5a7-482c46e266cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:26.711339 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-699a5416-75ec-4065-b5a7-482c46e266cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 13:41:26.713213 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 86/172] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:26.714357 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a5416-75ec-4065-b5a7-482c46e266cb None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:26.733864 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 87/173] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:41:26.734678 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377d00c-d93f-401e-8493-599b10da1706 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:26.818500 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a5416-75ec-4065-b5a7-482c46e266cb None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:26.836237 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377d00c-d93f-401e-8493-599b10da1706 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:26.865069 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01e4ef-1f8c-4d83-a2dd-49e8edad24bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:26.865733 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01e4ef-1f8c-4d83-a2dd-49e8edad24bc None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:26.866015 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01e4ef-1f8c-4d83-a2dd-49e8edad24bc None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:26.866293 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01e4ef-1f8c-4d83-a2dd-49e8edad24bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:26.867129 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01e4ef-1f8c-4d83-a2dd-49e8edad24bc None admin] RBAC: Adding query filter params (role.id=fbb7398610b649859d123d0938aa8e75, scope.project.id=029a84f386ce4e48b750a76626f65b2d, user.id=80fe3955cd0843e783a1c35d76b757b9) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:26.867437 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01e4ef-1f8c-4d83-a2dd-49e8edad24bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:26.868914 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01e4ef-1f8c-4d83-a2dd-49e8edad24bc None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:26.872786 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffe3fe-5c1e-4f1c-a113-abd00adf0c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:26.873464 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffe3fe-5c1e-4f1c-a113-abd00adf0c37 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:26.873749 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffe3fe-5c1e-4f1c-a113-abd00adf0c37 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:26.874027 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffe3fe-5c1e-4f1c-a113-abd00adf0c37 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:26.874782 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffe3fe-5c1e-4f1c-a113-abd00adf0c37 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:26.875092 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffe3fe-5c1e-4f1c-a113-abd00adf0c37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:26.876504 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edffe3fe-5c1e-4f1c-a113-abd00adf0c37 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:26.885894 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 88/174] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:26.886700 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffe3fe-5c1e-4f1c-a113-abd00adf0c37 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:26.889896 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 87/175] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:41:26 2022] GET /identity/v3/role_assignments?user.id=80fe3955cd0843e783a1c35d76b757b9&scope.project.id=029a84f386ce4e48b750a76626f65b2d&role.id=fbb7398610b649859d123d0938aa8e75 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:26.892951 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01e4ef-1f8c-4d83-a2dd-49e8edad24bc None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:27.056058 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edffe3fe-5c1e-4f1c-a113-abd00adf0c37 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:27.122658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a79c0-d769-475a-b591-da1dc12b435a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:27.123616 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a79c0-d769-475a-b591-da1dc12b435a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:27.123928 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a79c0-d769-475a-b591-da1dc12b435a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:27.124203 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a79c0-d769-475a-b591-da1dc12b435a None admin] PATH_INFO: `/v3/projects/9925178d3a324d0faecb1788c31fe0c9` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:27.125433 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a79c0-d769-475a-b591-da1dc12b435a None admin] RBAC: Authorizing `identity:get_project(project_id=9925178d3a324d0faecb1788c31fe0c9)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:27.127294 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a79c0-d769-475a-b591-da1dc12b435a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:27.129678 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 89/176] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:26 2022] GET /identity/v3/projects/9925178d3a324d0faecb1788c31fe0c9 => generated 312 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:27.129805 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01e4ef-1f8c-4d83-a2dd-49e8edad24bc None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:27.138682 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a79c0-d769-475a-b591-da1dc12b435a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:27.200328 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6f8cc-f39b-4da3-a911-940112b9fbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:27.201220 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6f8cc-f39b-4da3-a911-940112b9fbb8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:27.201498 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6f8cc-f39b-4da3-a911-940112b9fbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:27.201772 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6f8cc-f39b-4da3-a911-940112b9fbb8 None admin] PATH_INFO: `/v3/users/db80f278a3b94471ae5e3d871f83c9aa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:27.206995 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6f8cc-f39b-4da3-a911-940112b9fbb8 None admin] RBAC: Authorizing `identity:get_user(user_id=db80f278a3b94471ae5e3d871f83c9aa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:27.208485 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6f8cc-f39b-4da3-a911-940112b9fbb8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:27.210434 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 88/177] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:26 2022] GET /identity/v3/users/db80f278a3b94471ae5e3d871f83c9aa => generated 289 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:27.216513 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6f8cc-f39b-4da3-a911-940112b9fbb8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:27.273699 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a79c0-d769-475a-b591-da1dc12b435a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:27.309709 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9b6b1-4973-43c2-a565-4a5ebf76f183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:27.310384 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9b6b1-4973-43c2-a565-4a5ebf76f183 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:27.310670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9b6b1-4973-43c2-a565-4a5ebf76f183 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:27.310947 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9b6b1-4973-43c2-a565-4a5ebf76f183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:27.311820 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9b6b1-4973-43c2-a565-4a5ebf76f183 None admin] RBAC: Adding query filter params (role.id=3daf622d91e64ce685da6f482aa181ea, scope.project.id=9925178d3a324d0faecb1788c31fe0c9, user.id=80fe3955cd0843e783a1c35d76b757b9) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:27.312133 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9b6b1-4973-43c2-a565-4a5ebf76f183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:27.313579 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9b6b1-4973-43c2-a565-4a5ebf76f183 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:27.323924 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 90/178] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:41:27 2022] GET /identity/v3/role_assignments?user.id=80fe3955cd0843e783a1c35d76b757b9&scope.project.id=9925178d3a324d0faecb1788c31fe0c9&role.id=3daf622d91e64ce685da6f482aa181ea => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:27.391569 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6f8cc-f39b-4da3-a911-940112b9fbb8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:27.440744 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09be47f-42e0-4bc7-8917-417544f148e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:27.441648 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09be47f-42e0-4bc7-8917-417544f148e4 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:27.441934 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09be47f-42e0-4bc7-8917-417544f148e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:27.442211 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09be47f-42e0-4bc7-8917-417544f148e4 None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:27.443527 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09be47f-42e0-4bc7-8917-417544f148e4 None admin] RBAC: Authorizing `identity:get_project(project_id=029a84f386ce4e48b750a76626f65b2d)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:27.446658 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09be47f-42e0-4bc7-8917-417544f148e4 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:27.449637 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 89/179] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:27 2022] GET /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:27.455315 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9b6b1-4973-43c2-a565-4a5ebf76f183 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:27.569210 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9b6b1-4973-43c2-a565-4a5ebf76f183 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:27.606882 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbd9b9-c4f7-4d7e-8d41-ad570ec59271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:27.608165 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbd9b9-c4f7-4d7e-8d41-ad570ec59271 None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:27.608651 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbd9b9-c4f7-4d7e-8d41-ad570ec59271 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:27.609127 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbd9b9-c4f7-4d7e-8d41-ad570ec59271 None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d/users/db80f278a3b94471ae5e3d871f83c9aa/roles/d6ff23054a6c45d1b4e7e5da9305d7f3` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:27.611378 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbd9b9-c4f7-4d7e-8d41-ad570ec59271 None admin] RBAC: Authorizing `identity:create_grant(project_id=029a84f386ce4e48b750a76626f65b2d, user_id=db80f278a3b94471ae5e3d871f83c9aa, role_id=d6ff23054a6c45d1b4e7e5da9305d7f3)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:27.613105 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbd9b9-c4f7-4d7e-8d41-ad570ec59271 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:27.639864 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 91/180] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:41:27 2022] PUT /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d/users/db80f278a3b94471ae5e3d871f83c9aa/roles/d6ff23054a6c45d1b4e7e5da9305d7f3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:41:28.805453 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ed2c1-a448-4e11-9655-c13edc9e1d05 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:28.805939 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ed2c1-a448-4e11-9655-c13edc9e1d05 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:28.805939 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ed2c1-a448-4e11-9655-c13edc9e1d05 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:28.807353 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 90/181] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:28.812612 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c65383-f053-4fe2-9521-363811478558 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:28.813011 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c65383-f053-4fe2-9521-363811478558 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:28.813345 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c65383-f053-4fe2-9521-363811478558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:28.834385 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-01c65383-f053-4fe2-9521-363811478558 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:28.835575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-01c65383-f053-4fe2-9521-363811478558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:28.911750 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 92/182] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:41:28.931394 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ed2c1-a448-4e11-9655-c13edc9e1d05 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:29.034398 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ed2c1-a448-4e11-9655-c13edc9e1d05 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:29.073035 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40450732-5492-4146-aed8-8c406f0617d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:29.074185 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40450732-5492-4146-aed8-8c406f0617d2 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:29.074695 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40450732-5492-4146-aed8-8c406f0617d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:29.075165 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40450732-5492-4146-aed8-8c406f0617d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:29.085010 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab666f8-c1ba-4c37-aeed-f5ec2c5d1ee2 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:29.085298 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab666f8-c1ba-4c37-aeed-f5ec2c5d1ee2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:29.085578 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab666f8-c1ba-4c37-aeed-f5ec2c5d1ee2 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:29.086847 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40450732-5492-4146-aed8-8c406f0617d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:29.087195 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 93/183] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:41:29.092532 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d28fa-0dc6-4d94-8ae7-ea21ab3a5c84 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:29.092816 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d28fa-0dc6-4d94-8ae7-ea21ab3a5c84 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:29.093095 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d28fa-0dc6-4d94-8ae7-ea21ab3a5c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:29.095668 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-40450732-5492-4146-aed8-8c406f0617d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:41:29.097106 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 91/184] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:41:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:29.098649 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59807e-79c0-4bca-bbee-27d92ee0b426 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:29.099138 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59807e-79c0-4bca-bbee-27d92ee0b426 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:29.099622 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59807e-79c0-4bca-bbee-27d92ee0b426 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:29.101131 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 92/185] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:41:29.104581 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59807e-79c0-4bca-bbee-27d92ee0b426 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:29.110930 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-385d28fa-0dc6-4d94-8ae7-ea21ab3a5c84 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:29.112142 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-385d28fa-0dc6-4d94-8ae7-ea21ab3a5c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:29.181318 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 94/186] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:41:29.183254 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306ad27-07ba-476a-82cb-638d4289fabb None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:29.183825 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306ad27-07ba-476a-82cb-638d4289fabb None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:29.184300 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306ad27-07ba-476a-82cb-638d4289fabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:29.203839 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-0306ad27-07ba-476a-82cb-638d4289fabb None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:29.206109 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0306ad27-07ba-476a-82cb-638d4289fabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:29.208812 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59807e-79c0-4bca-bbee-27d92ee0b426 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:29.245919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6cb65-3637-4c82-b488-f87f145f485f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:29.247336 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6cb65-3637-4c82-b488-f87f145f485f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:29.247823 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6cb65-3637-4c82-b488-f87f145f485f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:29.248237 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6cb65-3637-4c82-b488-f87f145f485f None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:29.249513 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6cb65-3637-4c82-b488-f87f145f485f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:29.250274 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6cb65-3637-4c82-b488-f87f145f485f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:29.252439 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6cb65-3637-4c82-b488-f87f145f485f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:29.261909 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 93/187] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:29.262724 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6cb65-3637-4c82-b488-f87f145f485f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:29.278529 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 95/188] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:29.278529 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306ad27-07ba-476a-82cb-638d4289fabb None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:29.370404 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6cb65-3637-4c82-b488-f87f145f485f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:29.382477 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306ad27-07ba-476a-82cb-638d4289fabb None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:29.405729 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b9300-24de-45c6-a002-5defef50710b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:29.406524 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b9300-24de-45c6-a002-5defef50710b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:29.406801 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b9300-24de-45c6-a002-5defef50710b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:29.407068 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b9300-24de-45c6-a002-5defef50710b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:29.408246 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b9300-24de-45c6-a002-5defef50710b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:29.409699 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b9300-24de-45c6-a002-5defef50710b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:29.411311 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 94/189] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:41:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:29.416477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b9300-24de-45c6-a002-5defef50710b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:29.420696 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7be74-3768-4a05-871b-d123eec882e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:29.421575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7be74-3768-4a05-871b-d123eec882e2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:29.421861 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7be74-3768-4a05-871b-d123eec882e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:29.422138 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7be74-3768-4a05-871b-d123eec882e2 None admin] PATH_INFO: `/v3/users/a70223b705ec4352a13fca9a0479cad8` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:29.436155 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7be74-3768-4a05-871b-d123eec882e2 None admin] RBAC: Authorizing `identity:get_user(user_id=a70223b705ec4352a13fca9a0479cad8)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:29.438008 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7be74-3768-4a05-871b-d123eec882e2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:29.443972 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 96/190] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:29 2022] GET /identity/v3/users/a70223b705ec4352a13fca9a0479cad8 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:29.443972 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7be74-3768-4a05-871b-d123eec882e2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:29.522499 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b9300-24de-45c6-a002-5defef50710b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:29.539204 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7be74-3768-4a05-871b-d123eec882e2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:29.560321 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa25277-b7fc-4120-bc8b-0d71cb5e6da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:29.561432 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa25277-b7fc-4120-bc8b-0d71cb5e6da7 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:29.561877 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa25277-b7fc-4120-bc8b-0d71cb5e6da7 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:29.562161 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa25277-b7fc-4120-bc8b-0d71cb5e6da7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:29.574384 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a2f13-a18b-48b8-8127-dfeac38e2780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:29.575051 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a2f13-a18b-48b8-8127-dfeac38e2780 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:29.575334 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a2f13-a18b-48b8-8127-dfeac38e2780 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:29.575604 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a2f13-a18b-48b8-8127-dfeac38e2780 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:29.575813 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa25277-b7fc-4120-bc8b-0d71cb5e6da7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:29.576339 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a2f13-a18b-48b8-8127-dfeac38e2780 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:29.578021 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a2f13-a18b-48b8-8127-dfeac38e2780 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:29.583419 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-6aa25277-b7fc-4120-bc8b-0d71cb5e6da7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 13:41:29.591133 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 95/191] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:41:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:29.591133 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa25277-b7fc-4120-bc8b-0d71cb5e6da7 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:29.600453 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 97/192] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Apr 11 13:41:29 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:41:29.600453 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a2f13-a18b-48b8-8127-dfeac38e2780 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:29.710864 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa25277-b7fc-4120-bc8b-0d71cb5e6da7 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:29.753462 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a2f13-a18b-48b8-8127-dfeac38e2780 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:29.753978 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806922e0-e3e8-440d-afc8-b46903cc1546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:29.754657 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806922e0-e3e8-440d-afc8-b46903cc1546 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:29.754944 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806922e0-e3e8-440d-afc8-b46903cc1546 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:29.755469 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806922e0-e3e8-440d-afc8-b46903cc1546 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:29.791355 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e557542-b6fb-4d72-ae25-6c24dac5f7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:29.791355 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e557542-b6fb-4d72-ae25-6c24dac5f7d9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:29.791355 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e557542-b6fb-4d72-ae25-6c24dac5f7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:29.791832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e557542-b6fb-4d72-ae25-6c24dac5f7d9 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:29.792494 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e557542-b6fb-4d72-ae25-6c24dac5f7d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:29.792858 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e557542-b6fb-4d72-ae25-6c24dac5f7d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:29.794737 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e557542-b6fb-4d72-ae25-6c24dac5f7d9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:29.803058 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 98/193] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:41:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:29.809433 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e557542-b6fb-4d72-ae25-6c24dac5f7d9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:29.837220 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806922e0-e3e8-440d-afc8-b46903cc1546 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:29.839287 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806922e0-e3e8-440d-afc8-b46903cc1546 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:29.920058 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e557542-b6fb-4d72-ae25-6c24dac5f7d9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:29.940282 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 96/194] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:41:29.945721 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806922e0-e3e8-440d-afc8-b46903cc1546 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:29.961116 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe42f38-8971-4538-93ac-b6cbd87767bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:29.961945 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe42f38-8971-4538-93ac-b6cbd87767bb None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:29.962228 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe42f38-8971-4538-93ac-b6cbd87767bb None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:29.962505 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe42f38-8971-4538-93ac-b6cbd87767bb None admin] PATH_INFO: `/v3/users/a70223b705ec4352a13fca9a0479cad8` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:29.967276 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe42f38-8971-4538-93ac-b6cbd87767bb None admin] RBAC: Authorizing `identity:get_user(user_id=a70223b705ec4352a13fca9a0479cad8)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:29.967828 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe42f38-8971-4538-93ac-b6cbd87767bb None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:29.970513 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 99/195] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:29 2022] GET /identity/v3/users/a70223b705ec4352a13fca9a0479cad8 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:29.975929 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe42f38-8971-4538-93ac-b6cbd87767bb None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:30.084765 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806922e0-e3e8-440d-afc8-b46903cc1546 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:30.092199 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe42f38-8971-4538-93ac-b6cbd87767bb None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:30.128382 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bbb91-b95e-47d3-bafc-30906e94bd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:30.129342 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bbb91-b95e-47d3-bafc-30906e94bd7f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:30.129624 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bbb91-b95e-47d3-bafc-30906e94bd7f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:30.129901 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bbb91-b95e-47d3-bafc-30906e94bd7f None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:30.130842 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b29c62-9883-4dcb-a72d-08fb432f0643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:30.131215 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bbb91-b95e-47d3-bafc-30906e94bd7f None admin] RBAC: Authorizing `identity:get_project(project_id=63fb9340f10a4486a0c9270676f88f02)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:30.131657 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b29c62-9883-4dcb-a72d-08fb432f0643 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:30.132024 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b29c62-9883-4dcb-a72d-08fb432f0643 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:30.132374 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b29c62-9883-4dcb-a72d-08fb432f0643 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:30.132721 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bbb91-b95e-47d3-bafc-30906e94bd7f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:30.135297 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 97/196] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:29 2022] GET /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:30.141254 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bbb91-b95e-47d3-bafc-30906e94bd7f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:30.213533 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b29c62-9883-4dcb-a72d-08fb432f0643 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:30.214997 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b29c62-9883-4dcb-a72d-08fb432f0643 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:30.267288 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bbb91-b95e-47d3-bafc-30906e94bd7f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:30.301322 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f708f0-a5c8-4289-9f22-451087df62a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:30.302260 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f708f0-a5c8-4289-9f22-451087df62a8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:30.302708 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f708f0-a5c8-4289-9f22-451087df62a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:30.303171 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f708f0-a5c8-4289-9f22-451087df62a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:30.304200 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f708f0-a5c8-4289-9f22-451087df62a8 None admin] RBAC: Adding query filter params (role.id=e3333fcf22b040e3a1f0bfbfe657cffa, scope.project.id=63fb9340f10a4486a0c9270676f88f02, user.id=a70223b705ec4352a13fca9a0479cad8) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:30.304676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f708f0-a5c8-4289-9f22-451087df62a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:30.307199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f708f0-a5c8-4289-9f22-451087df62a8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:30.319231 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 98/198] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:41:30 2022] GET /identity/v3/role_assignments?user.id=a70223b705ec4352a13fca9a0479cad8&scope.project.id=63fb9340f10a4486a0c9270676f88f02&role.id=e3333fcf22b040e3a1f0bfbfe657cffa => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:30.319432 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 100/198] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 13:41:30.320627 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f708f0-a5c8-4289-9f22-451087df62a8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:30.320902 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2548c0-a135-4ce6-a629-f93295710781 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:30.321200 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2548c0-a135-4ce6-a629-f93295710781 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:30.321503 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2548c0-a135-4ce6-a629-f93295710781 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:30.322899 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 101/199] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:30.339437 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa709b2-0a17-493d-854b-d99e0c74d0d7 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:30.339757 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa709b2-0a17-493d-854b-d99e0c74d0d7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:30.340045 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa709b2-0a17-493d-854b-d99e0c74d0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:30.370988 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-2aa709b2-0a17-493d-854b-d99e0c74d0d7 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:30.372253 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2aa709b2-0a17-493d-854b-d99e0c74d0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:30.458581 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 102/200] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:41:30.482351 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa709b2-0a17-493d-854b-d99e0c74d0d7 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:30.552074 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f708f0-a5c8-4289-9f22-451087df62a8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:30.621156 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a1931-bb11-4088-9667-58216f374912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:30.622034 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a1931-bb11-4088-9667-58216f374912 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:30.622315 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a1931-bb11-4088-9667-58216f374912 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:30.622594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a1931-bb11-4088-9667-58216f374912 None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:30.624972 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa709b2-0a17-493d-854b-d99e0c74d0d7 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:30.625838 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a1931-bb11-4088-9667-58216f374912 None admin] RBAC: Authorizing `identity:get_project(project_id=63fb9340f10a4486a0c9270676f88f02)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:30.627307 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a1931-bb11-4088-9667-58216f374912 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:30.630527 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 99/201] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:30 2022] GET /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02 => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:30.636466 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a1931-bb11-4088-9667-58216f374912 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:30.684277 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033d883-b90c-449c-a970-53bd62b7750a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:30.685401 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d883-b90c-449c-a970-53bd62b7750a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:30.685829 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d883-b90c-449c-a970-53bd62b7750a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:30.686109 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d883-b90c-449c-a970-53bd62b7750a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:30.696841 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033d883-b90c-449c-a970-53bd62b7750a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:30.705018 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-d033d883-b90c-449c-a970-53bd62b7750a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 13:41:30.706756 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 103/202] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:30.715553 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033d883-b90c-449c-a970-53bd62b7750a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:30.816167 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033d883-b90c-449c-a970-53bd62b7750a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:30.841254 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a1931-bb11-4088-9667-58216f374912 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:30.849684 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc509a35-2b02-4bd2-9026-90177b1c1226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:30.850618 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc509a35-2b02-4bd2-9026-90177b1c1226 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:30.851081 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc509a35-2b02-4bd2-9026-90177b1c1226 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:30.851502 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc509a35-2b02-4bd2-9026-90177b1c1226 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:30.852403 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc509a35-2b02-4bd2-9026-90177b1c1226 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:30.852843 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc509a35-2b02-4bd2-9026-90177b1c1226 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:30.855178 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc509a35-2b02-4bd2-9026-90177b1c1226 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:30.863851 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 104/203] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:30.869715 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc509a35-2b02-4bd2-9026-90177b1c1226 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:30.895722 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675076e-c434-4934-b902-2ae9d59ff71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:30.896383 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675076e-c434-4934-b902-2ae9d59ff71b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:30.896663 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675076e-c434-4934-b902-2ae9d59ff71b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:30.896934 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675076e-c434-4934-b902-2ae9d59ff71b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:30.897773 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675076e-c434-4934-b902-2ae9d59ff71b None admin] RBAC: Adding query filter params (role.id=fbb7398610b649859d123d0938aa8e75, scope.project.id=63fb9340f10a4486a0c9270676f88f02, user.id=a70223b705ec4352a13fca9a0479cad8) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:30.898078 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675076e-c434-4934-b902-2ae9d59ff71b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:30.899520 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675076e-c434-4934-b902-2ae9d59ff71b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:30.912505 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 100/204] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:41:30 2022] GET /identity/v3/role_assignments?user.id=a70223b705ec4352a13fca9a0479cad8&scope.project.id=63fb9340f10a4486a0c9270676f88f02&role.id=fbb7398610b649859d123d0938aa8e75 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:30.997603 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc509a35-2b02-4bd2-9026-90177b1c1226 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:31.043294 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d196ac2-f035-46b5-a983-d33cc5746fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:31.044287 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d196ac2-f035-46b5-a983-d33cc5746fdf None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:31.044573 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d196ac2-f035-46b5-a983-d33cc5746fdf None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:31.044852 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d196ac2-f035-46b5-a983-d33cc5746fdf None admin] PATH_INFO: `/v3/users/db80f278a3b94471ae5e3d871f83c9aa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:31.046074 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d196ac2-f035-46b5-a983-d33cc5746fdf None admin] RBAC: Authorizing `identity:get_user(user_id=db80f278a3b94471ae5e3d871f83c9aa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:31.047977 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d196ac2-f035-46b5-a983-d33cc5746fdf None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:31.049668 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 105/205] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:30 2022] GET /identity/v3/users/db80f278a3b94471ae5e3d871f83c9aa => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:31.055385 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675076e-c434-4934-b902-2ae9d59ff71b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:31.164310 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675076e-c434-4934-b902-2ae9d59ff71b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:31.202120 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb0537-1909-4428-b841-b3f061c25461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:31.203033 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb0537-1909-4428-b841-b3f061c25461 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:31.203314 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb0537-1909-4428-b841-b3f061c25461 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:31.203590 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb0537-1909-4428-b841-b3f061c25461 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:31.291583 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb0537-1909-4428-b841-b3f061c25461 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:31.293173 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb0537-1909-4428-b841-b3f061c25461 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:31.426499 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 101/206] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:41:31.432536 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d196ac2-f035-46b5-a983-d33cc5746fdf None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:31.608915 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d196ac2-f035-46b5-a983-d33cc5746fdf None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:31.646830 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d617c1-d028-4fae-9476-e1f069a3a313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:31.648102 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d617c1-d028-4fae-9476-e1f069a3a313 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:31.648573 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d617c1-d028-4fae-9476-e1f069a3a313 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:31.649032 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d617c1-d028-4fae-9476-e1f069a3a313 None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:31.650950 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d617c1-d028-4fae-9476-e1f069a3a313 None admin] RBAC: Authorizing `identity:get_project(project_id=029a84f386ce4e48b750a76626f65b2d)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:31.652603 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d617c1-d028-4fae-9476-e1f069a3a313 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:31.654836 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 106/207] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:31 2022] GET /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:31.660687 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb0537-1909-4428-b841-b3f061c25461 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:31.796545 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb0537-1909-4428-b841-b3f061c25461 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:31.830447 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f312d-85cc-4e57-9d88-a047c297bfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:31.831110 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f312d-85cc-4e57-9d88-a047c297bfe1 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:31.831393 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f312d-85cc-4e57-9d88-a047c297bfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:31.831689 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f312d-85cc-4e57-9d88-a047c297bfe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:31.832522 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f312d-85cc-4e57-9d88-a047c297bfe1 None admin] RBAC: Adding query filter params (role.id=d6ff23054a6c45d1b4e7e5da9305d7f3, scope.project.id=029a84f386ce4e48b750a76626f65b2d, user.id=db80f278a3b94471ae5e3d871f83c9aa) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:31.832833 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f312d-85cc-4e57-9d88-a047c297bfe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:31.834295 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f312d-85cc-4e57-9d88-a047c297bfe1 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:31.840771 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 102/208] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:41:31 2022] GET /identity/v3/role_assignments?user.id=db80f278a3b94471ae5e3d871f83c9aa&scope.project.id=029a84f386ce4e48b750a76626f65b2d&role.id=d6ff23054a6c45d1b4e7e5da9305d7f3 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:32.578265 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe15e1-dc14-4725-9c5a-412b696d7f9e None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:32.579314 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe15e1-dc14-4725-9c5a-412b696d7f9e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:32.579866 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe15e1-dc14-4725-9c5a-412b696d7f9e None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:32.581817 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 107/209] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:32.587816 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332c827-9c23-4898-8de6-5032b774bb7d None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:32.588745 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332c827-9c23-4898-8de6-5032b774bb7d None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:32.589243 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332c827-9c23-4898-8de6-5032b774bb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:32.606806 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b332c827-9c23-4898-8de6-5032b774bb7d None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:32.608430 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b332c827-9c23-4898-8de6-5032b774bb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:32.679375 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 103/210] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:32.695669 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac6c19-1abc-4776-80c9-9ebb8ad18828 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:32.696269 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac6c19-1abc-4776-80c9-9ebb8ad18828 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:32.696759 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac6c19-1abc-4776-80c9-9ebb8ad18828 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:32.699084 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 108/211] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:32.704266 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df28e21-5339-4521-9524-9f723d721221 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:32.704563 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df28e21-5339-4521-9524-9f723d721221 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:32.704885 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df28e21-5339-4521-9524-9f723d721221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:32.712256 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac6c19-1abc-4776-80c9-9ebb8ad18828 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:32.722236 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-9df28e21-5339-4521-9524-9f723d721221 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:32.723425 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9df28e21-5339-4521-9524-9f723d721221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:32.807176 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 104/212] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:32.824939 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac6c19-1abc-4776-80c9-9ebb8ad18828 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:32.833175 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df28e21-5339-4521-9524-9f723d721221 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:32.864596 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f839a-c4fd-494e-bb24-0adf8cbb1d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:32.866184 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f839a-c4fd-494e-bb24-0adf8cbb1d0d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:32.866906 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f839a-c4fd-494e-bb24-0adf8cbb1d0d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:32.867404 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f839a-c4fd-494e-bb24-0adf8cbb1d0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:32.869508 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f839a-c4fd-494e-bb24-0adf8cbb1d0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:32.872213 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f839a-c4fd-494e-bb24-0adf8cbb1d0d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:32.874102 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 109/213] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:41:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:32.879990 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f839a-c4fd-494e-bb24-0adf8cbb1d0d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:32.943279 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df28e21-5339-4521-9524-9f723d721221 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:32.984225 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9657dcc-ed0c-4ebb-8967-1ed1ab512258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:32.985050 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9657dcc-ed0c-4ebb-8967-1ed1ab512258 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:32.985335 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9657dcc-ed0c-4ebb-8967-1ed1ab512258 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:32.985610 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9657dcc-ed0c-4ebb-8967-1ed1ab512258 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:32.994917 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f839a-c4fd-494e-bb24-0adf8cbb1d0d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:32.995860 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9657dcc-ed0c-4ebb-8967-1ed1ab512258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:33.002822 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-c9657dcc-ed0c-4ebb-8967-1ed1ab512258 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 13:41:33.004074 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 105/214] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:33.008994 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493bd29-a8ab-477b-b1e8-136f14856c25 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:33.009282 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493bd29-a8ab-477b-b1e8-136f14856c25 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:33.009597 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493bd29-a8ab-477b-b1e8-136f14856c25 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:33.010928 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 106/215] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:33.012412 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493bd29-a8ab-477b-b1e8-136f14856c25 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:33.034195 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e5d7b-ca7a-48e7-8883-e449a5e79067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:33.034871 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e5d7b-ca7a-48e7-8883-e449a5e79067 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:33.035158 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e5d7b-ca7a-48e7-8883-e449a5e79067 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:33.035439 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e5d7b-ca7a-48e7-8883-e449a5e79067 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:33.036192 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e5d7b-ca7a-48e7-8883-e449a5e79067 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:33.037630 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e5d7b-ca7a-48e7-8883-e449a5e79067 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:33.063662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 110/216] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Apr 11 13:41:32 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:41:33.063662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db989ed-f029-4b3e-b4f3-d3a128c24f3d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:33.063662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db989ed-f029-4b3e-b4f3-d3a128c24f3d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:33.063662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db989ed-f029-4b3e-b4f3-d3a128c24f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:33.082341 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-8db989ed-f029-4b3e-b4f3-d3a128c24f3d None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:33.083563 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8db989ed-f029-4b3e-b4f3-d3a128c24f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:33.149777 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493bd29-a8ab-477b-b1e8-136f14856c25 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:33.169779 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 111/217] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:33.192542 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db989ed-f029-4b3e-b4f3-d3a128c24f3d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:33.208217 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32459521-5ee6-422a-b404-6b218bb88db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:33.209257 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32459521-5ee6-422a-b404-6b218bb88db1 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:33.209791 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32459521-5ee6-422a-b404-6b218bb88db1 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:33.210266 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32459521-5ee6-422a-b404-6b218bb88db1 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:33.211344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32459521-5ee6-422a-b404-6b218bb88db1 None admin] RBAC: Adding query filter params (name=member) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:33.211912 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32459521-5ee6-422a-b404-6b218bb88db1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:33.213945 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32459521-5ee6-422a-b404-6b218bb88db1 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:33.223883 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 107/218] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:33.230608 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32459521-5ee6-422a-b404-6b218bb88db1 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:33.323470 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db989ed-f029-4b3e-b4f3-d3a128c24f3d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:33.375493 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32459521-5ee6-422a-b404-6b218bb88db1 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:33.377540 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c1e34-52ce-4cd2-9f3c-428d91536fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:33.378354 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c1e34-52ce-4cd2-9f3c-428d91536fdf None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:33.378638 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c1e34-52ce-4cd2-9f3c-428d91536fdf None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:33.378914 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c1e34-52ce-4cd2-9f3c-428d91536fdf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:33.398466 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c1e34-52ce-4cd2-9f3c-428d91536fdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:33.408522 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-7c1c1e34-52ce-4cd2-9f3c-428d91536fdf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:41:33.410899 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 112/219] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:41:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:41:33.416351 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c1e34-52ce-4cd2-9f3c-428d91536fdf None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:33.428137 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a92ea-39cc-41a2-8bbb-8d7959c303f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:33.429026 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a92ea-39cc-41a2-8bbb-8d7959c303f8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:33.429307 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a92ea-39cc-41a2-8bbb-8d7959c303f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:33.429637 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a92ea-39cc-41a2-8bbb-8d7959c303f8 None admin] PATH_INFO: `/v3/users/f47cbda85a884daca8577b3e5559dafd` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:33.451523 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a92ea-39cc-41a2-8bbb-8d7959c303f8 None admin] RBAC: Authorizing `identity:get_user(user_id=f47cbda85a884daca8577b3e5559dafd)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:33.453363 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a92ea-39cc-41a2-8bbb-8d7959c303f8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:33.455261 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 108/220] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:33 2022] GET /identity/v3/users/f47cbda85a884daca8577b3e5559dafd => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:33.460689 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a92ea-39cc-41a2-8bbb-8d7959c303f8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:33.540230 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c1e34-52ce-4cd2-9f3c-428d91536fdf None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:33.580321 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a92ea-39cc-41a2-8bbb-8d7959c303f8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:33.592785 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72be84-13ad-4ef3-bf07-b8d915690f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:33.594130 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72be84-13ad-4ef3-bf07-b8d915690f5c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:33.594603 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72be84-13ad-4ef3-bf07-b8d915690f5c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:33.595085 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72be84-13ad-4ef3-bf07-b8d915690f5c None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:33.596148 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72be84-13ad-4ef3-bf07-b8d915690f5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:33.596647 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72be84-13ad-4ef3-bf07-b8d915690f5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:33.600133 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72be84-13ad-4ef3-bf07-b8d915690f5c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:33.610741 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 113/221] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:33.623981 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72be84-13ad-4ef3-bf07-b8d915690f5c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:33.650538 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24839b4a-d36a-43c3-849a-2205624e79a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:33.651205 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24839b4a-d36a-43c3-849a-2205624e79a2 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:33.651482 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24839b4a-d36a-43c3-849a-2205624e79a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:33.651806 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24839b4a-d36a-43c3-849a-2205624e79a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:33.750927 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72be84-13ad-4ef3-bf07-b8d915690f5c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:33.752219 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24839b4a-d36a-43c3-849a-2205624e79a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:33.754621 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24839b4a-d36a-43c3-849a-2205624e79a2 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:33.785508 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e990143-4a82-4026-915e-8d7767c44fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:33.786716 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e990143-4a82-4026-915e-8d7767c44fa4 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:33.787187 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e990143-4a82-4026-915e-8d7767c44fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:33.787682 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e990143-4a82-4026-915e-8d7767c44fa4 None admin] PATH_INFO: `/v3/users/a70223b705ec4352a13fca9a0479cad8` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:33.789088 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e990143-4a82-4026-915e-8d7767c44fa4 None admin] RBAC: Authorizing `identity:get_user(user_id=a70223b705ec4352a13fca9a0479cad8)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:33.791392 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e990143-4a82-4026-915e-8d7767c44fa4 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:33.793394 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 114/222] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:33 2022] GET /identity/v3/users/a70223b705ec4352a13fca9a0479cad8 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:33.794994 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4b122-271c-42a8-8342-393f95d1e62a None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:33.795471 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4b122-271c-42a8-8342-393f95d1e62a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:33.795951 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4b122-271c-42a8-8342-393f95d1e62a None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:33.797995 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 115/223] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:33.798938 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4b122-271c-42a8-8342-393f95d1e62a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:33.860491 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 109/224] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:41:33.862248 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5f65c-b9e7-464f-81b6-96b51e89aab1 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:33.862727 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5f65c-b9e7-464f-81b6-96b51e89aab1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:33.863209 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5f65c-b9e7-464f-81b6-96b51e89aab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:33.880431 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b7e5f65c-b9e7-464f-81b6-96b51e89aab1 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:33.881868 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b7e5f65c-b9e7-464f-81b6-96b51e89aab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:33.910049 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4b122-271c-42a8-8342-393f95d1e62a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:33.944448 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ecc4-536c-4b22-97c4-081013b40203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:33.945570 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ecc4-536c-4b22-97c4-081013b40203 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:33.945997 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ecc4-536c-4b22-97c4-081013b40203 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:33.946413 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ecc4-536c-4b22-97c4-081013b40203 None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:33.947986 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63ecc4-536c-4b22-97c4-081013b40203 None admin] RBAC: Authorizing `identity:get_project(project_id=63fb9340f10a4486a0c9270676f88f02)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:33.949438 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 110/225] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:33.949764 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63ecc4-536c-4b22-97c4-081013b40203 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:33.950571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5f65c-b9e7-464f-81b6-96b51e89aab1 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:33.952350 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 116/226] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:33 2022] GET /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:33.963111 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ecc4-536c-4b22-97c4-081013b40203 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:34.066020 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ecc4-536c-4b22-97c4-081013b40203 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:34.075929 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5f65c-b9e7-464f-81b6-96b51e89aab1 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:34.111733 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc223b3-d398-405e-8edd-ba17fc779997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:34.112943 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc223b3-d398-405e-8edd-ba17fc779997 None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:34.113402 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc223b3-d398-405e-8edd-ba17fc779997 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:34.113850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc223b3-d398-405e-8edd-ba17fc779997 None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02/users/a70223b705ec4352a13fca9a0479cad8/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:34.114408 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629e2cc-607f-40fe-84e1-8513a9e9c316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:34.115480 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629e2cc-607f-40fe-84e1-8513a9e9c316 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:34.115938 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629e2cc-607f-40fe-84e1-8513a9e9c316 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:34.116279 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629e2cc-607f-40fe-84e1-8513a9e9c316 None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:34.116894 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc223b3-d398-405e-8edd-ba17fc779997 None admin] RBAC: Authorizing `identity:create_grant(project_id=63fb9340f10a4486a0c9270676f88f02, user_id=a70223b705ec4352a13fca9a0479cad8, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:34.117684 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629e2cc-607f-40fe-84e1-8513a9e9c316 None admin] RBAC: Authorizing `identity:get_project(project_id=63fb9340f10a4486a0c9270676f88f02)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:34.118809 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc223b3-d398-405e-8edd-ba17fc779997 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:34.119433 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629e2cc-607f-40fe-84e1-8513a9e9c316 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:34.125839 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 111/227] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:33 2022] GET /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:34.125839 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629e2cc-607f-40fe-84e1-8513a9e9c316 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:34.142973 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 117/228] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:41:33 2022] PUT /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02/users/a70223b705ec4352a13fca9a0479cad8/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:41:34.144663 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc223b3-d398-405e-8edd-ba17fc779997 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:34.273266 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629e2cc-607f-40fe-84e1-8513a9e9c316 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:34.311745 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995c328-100b-43bb-9568-077d46a83738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:34.312899 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995c328-100b-43bb-9568-077d46a83738 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:34.313354 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995c328-100b-43bb-9568-077d46a83738 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:34.313810 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995c328-100b-43bb-9568-077d46a83738 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:34.326173 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995c328-100b-43bb-9568-077d46a83738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:34.334458 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-b995c328-100b-43bb-9568-077d46a83738 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 13:41:34.336042 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 112/229] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:41:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:34.342969 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995c328-100b-43bb-9568-077d46a83738 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:34.365832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc223b3-d398-405e-8edd-ba17fc779997 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:34.417424 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0df864-2ae8-4156-b2a3-aa2ac0ba660e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:34.418131 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0df864-2ae8-4156-b2a3-aa2ac0ba660e None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:34.418418 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0df864-2ae8-4156-b2a3-aa2ac0ba660e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:34.418691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0df864-2ae8-4156-b2a3-aa2ac0ba660e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:34.419525 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0df864-2ae8-4156-b2a3-aa2ac0ba660e None admin] RBAC: Adding query filter params (role.id=3daf622d91e64ce685da6f482aa181ea, scope.project.id=63fb9340f10a4486a0c9270676f88f02, user.id=f47cbda85a884daca8577b3e5559dafd) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:34.419931 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0df864-2ae8-4156-b2a3-aa2ac0ba660e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:34.421446 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0df864-2ae8-4156-b2a3-aa2ac0ba660e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:34.427503 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 118/230] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:41:34 2022] GET /identity/v3/role_assignments?user.id=f47cbda85a884daca8577b3e5559dafd&scope.project.id=63fb9340f10a4486a0c9270676f88f02&role.id=3daf622d91e64ce685da6f482aa181ea => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:34.448242 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995c328-100b-43bb-9568-077d46a83738 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:34.485812 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525d5e9-8144-48bf-b347-1d513e3ef793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:34.486729 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525d5e9-8144-48bf-b347-1d513e3ef793 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:34.487179 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525d5e9-8144-48bf-b347-1d513e3ef793 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:34.487594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525d5e9-8144-48bf-b347-1d513e3ef793 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:34.488520 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525d5e9-8144-48bf-b347-1d513e3ef793 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:34.488973 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525d5e9-8144-48bf-b347-1d513e3ef793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:34.490505 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525d5e9-8144-48bf-b347-1d513e3ef793 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:34.500511 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 113/231] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:41:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:34.507852 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0df864-2ae8-4156-b2a3-aa2ac0ba660e None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:34.653340 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0df864-2ae8-4156-b2a3-aa2ac0ba660e None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:34.689532 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80726ee-72d5-4392-9549-77e142d8f3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:34.690650 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80726ee-72d5-4392-9549-77e142d8f3ae None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:34.691103 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80726ee-72d5-4392-9549-77e142d8f3ae None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:34.691530 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80726ee-72d5-4392-9549-77e142d8f3ae None admin] PATH_INFO: `/v3/users/a70223b705ec4352a13fca9a0479cad8` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:34.692897 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80726ee-72d5-4392-9549-77e142d8f3ae None admin] RBAC: Authorizing `identity:get_user(user_id=a70223b705ec4352a13fca9a0479cad8)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:34.694488 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80726ee-72d5-4392-9549-77e142d8f3ae None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:34.696594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 119/232] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:34 2022] GET /identity/v3/users/a70223b705ec4352a13fca9a0479cad8 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:34.702940 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525d5e9-8144-48bf-b347-1d513e3ef793 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:34.803340 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525d5e9-8144-48bf-b347-1d513e3ef793 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:34.836945 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd261eb-a3ea-427e-a1f6-9c35354817c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:34.838402 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd261eb-a3ea-427e-a1f6-9c35354817c8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:34.838830 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd261eb-a3ea-427e-a1f6-9c35354817c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:34.839273 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd261eb-a3ea-427e-a1f6-9c35354817c8 None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:34.840646 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd261eb-a3ea-427e-a1f6-9c35354817c8 None admin] RBAC: Authorizing `identity:get_project(project_id=63fb9340f10a4486a0c9270676f88f02)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:34.842234 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd261eb-a3ea-427e-a1f6-9c35354817c8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:34.844116 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 114/233] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:34 2022] GET /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:34.852714 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80726ee-72d5-4392-9549-77e142d8f3ae None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:34.968772 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80726ee-72d5-4392-9549-77e142d8f3ae None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:35.002434 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a87b04-4040-4f59-8a9a-d3a2ebf4d64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:35.003328 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a87b04-4040-4f59-8a9a-d3a2ebf4d64c None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:35.003613 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a87b04-4040-4f59-8a9a-d3a2ebf4d64c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:35.003918 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a87b04-4040-4f59-8a9a-d3a2ebf4d64c None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02/users/a70223b705ec4352a13fca9a0479cad8/roles/fbb7398610b649859d123d0938aa8e75` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:35.006163 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a87b04-4040-4f59-8a9a-d3a2ebf4d64c None admin] RBAC: Authorizing `identity:create_grant(project_id=63fb9340f10a4486a0c9270676f88f02, user_id=a70223b705ec4352a13fca9a0479cad8, role_id=fbb7398610b649859d123d0938aa8e75)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:35.007609 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a87b04-4040-4f59-8a9a-d3a2ebf4d64c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:35.024248 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 120/234] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:41:34 2022] PUT /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02/users/a70223b705ec4352a13fca9a0479cad8/roles/fbb7398610b649859d123d0938aa8e75 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:41:35.965065 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65772d61-fab3-4702-8216-a6dc3faa10af None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:35.965621 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65772d61-fab3-4702-8216-a6dc3faa10af None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:35.965621 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65772d61-fab3-4702-8216-a6dc3faa10af None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:35.967336 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 115/235] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:35.972847 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40068f-76a8-4663-9a16-28a1420919ed None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:35.973423 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40068f-76a8-4663-9a16-28a1420919ed None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:35.973423 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40068f-76a8-4663-9a16-28a1420919ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:36.000691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-da40068f-76a8-4663-9a16-28a1420919ed None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:36.001899 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-da40068f-76a8-4663-9a16-28a1420919ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:36.031402 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bc285-a88f-4d9a-84f1-7a25274fc92f None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:36.031692 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bc285-a88f-4d9a-84f1-7a25274fc92f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:36.034344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bc285-a88f-4d9a-84f1-7a25274fc92f None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:36.034344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 116/236] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:36.038681 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a2582-9ea7-49dd-865a-1b0c779d16b3 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:36.039003 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a2582-9ea7-49dd-865a-1b0c779d16b3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:36.039282 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a2582-9ea7-49dd-865a-1b0c779d16b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:36.057373 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-6a3a2582-9ea7-49dd-865a-1b0c779d16b3 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:36.058572 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6a3a2582-9ea7-49dd-865a-1b0c779d16b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:36.099088 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 121/237] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:36.123191 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40068f-76a8-4663-9a16-28a1420919ed None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:36.160319 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 117/238] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:36.202880 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a2582-9ea7-49dd-865a-1b0c779d16b3 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:36.220648 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40068f-76a8-4663-9a16-28a1420919ed None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:36.254683 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ece4cc-8c6a-4b30-a207-e3a698c5fce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:36.255544 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ece4cc-8c6a-4b30-a207-e3a698c5fce1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:36.255856 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ece4cc-8c6a-4b30-a207-e3a698c5fce1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:36.256131 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ece4cc-8c6a-4b30-a207-e3a698c5fce1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:36.266309 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ece4cc-8c6a-4b30-a207-e3a698c5fce1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:36.273224 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-39ece4cc-8c6a-4b30-a207-e3a698c5fce1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 13:41:36.274681 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 122/239] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:41:36.280434 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ece4cc-8c6a-4b30-a207-e3a698c5fce1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:36.380801 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ece4cc-8c6a-4b30-a207-e3a698c5fce1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:36.415214 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02608b5c-4799-4c21-9906-e349a3c4747a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:36.416451 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02608b5c-4799-4c21-9906-e349a3c4747a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:36.416738 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02608b5c-4799-4c21-9906-e349a3c4747a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:36.417015 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02608b5c-4799-4c21-9906-e349a3c4747a None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:36.417774 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02608b5c-4799-4c21-9906-e349a3c4747a None admin] RBAC: Adding query filter params (name=reader) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:36.418081 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02608b5c-4799-4c21-9906-e349a3c4747a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:36.419468 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02608b5c-4799-4c21-9906-e349a3c4747a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:36.425855 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a2582-9ea7-49dd-865a-1b0c779d16b3 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:36.428128 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 123/240] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:36.439658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02608b5c-4799-4c21-9906-e349a3c4747a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:36.496882 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e310cad-ee42-4e5e-b6d1-a0da9d40008c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:36.497608 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e310cad-ee42-4e5e-b6d1-a0da9d40008c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:36.497892 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e310cad-ee42-4e5e-b6d1-a0da9d40008c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:36.498164 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e310cad-ee42-4e5e-b6d1-a0da9d40008c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:36.499879 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e310cad-ee42-4e5e-b6d1-a0da9d40008c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:36.501349 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e310cad-ee42-4e5e-b6d1-a0da9d40008c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:36.503197 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 118/241] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:41:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:36.512095 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e310cad-ee42-4e5e-b6d1-a0da9d40008c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:36.636874 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02608b5c-4799-4c21-9906-e349a3c4747a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:36.703701 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e310cad-ee42-4e5e-b6d1-a0da9d40008c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:36.712946 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7b7b0-129f-4790-b533-5aff6f972e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:36.713839 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7b7b0-129f-4790-b533-5aff6f972e9c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:36.714119 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7b7b0-129f-4790-b533-5aff6f972e9c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:36.714391 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7b7b0-129f-4790-b533-5aff6f972e9c None admin] PATH_INFO: `/v3/users/0df420bdcfc14207b7b7846bd16d4868` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:36.741080 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e933806-0fdd-43fe-aa90-13dab0cb3f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:36.741756 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e933806-0fdd-43fe-aa90-13dab0cb3f71 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:36.742041 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e933806-0fdd-43fe-aa90-13dab0cb3f71 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:36.742317 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e933806-0fdd-43fe-aa90-13dab0cb3f71 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:36.743251 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e933806-0fdd-43fe-aa90-13dab0cb3f71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:36.745518 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e933806-0fdd-43fe-aa90-13dab0cb3f71 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:36.747115 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7b7b0-129f-4790-b533-5aff6f972e9c None admin] RBAC: Authorizing `identity:get_user(user_id=0df420bdcfc14207b7b7846bd16d4868)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:36.748823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7b7b0-129f-4790-b533-5aff6f972e9c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:36.750775 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 124/242] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:36 2022] GET /identity/v3/users/0df420bdcfc14207b7b7846bd16d4868 => generated 297 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:36.756122 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7b7b0-129f-4790-b533-5aff6f972e9c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:36.779814 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 119/243] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Apr 11 13:41:36 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:41:36.901957 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7b7b0-129f-4790-b533-5aff6f972e9c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:36.955303 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a6fb0-e4e4-4194-87bb-4343536657cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:36.956019 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a6fb0-e4e4-4194-87bb-4343536657cf None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:36.956307 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a6fb0-e4e4-4194-87bb-4343536657cf None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:36.956588 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a6fb0-e4e4-4194-87bb-4343536657cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:37.049524 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a6fb0-e4e4-4194-87bb-4343536657cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:37.051799 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a6fb0-e4e4-4194-87bb-4343536657cf None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:37.153575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 125/244] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 13:41:37.158745 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e933806-0fdd-43fe-aa90-13dab0cb3f71 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:37.200185 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b712f87-66d9-491b-a72c-e949ccb967f2 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:37.200805 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b712f87-66d9-491b-a72c-e949ccb967f2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:37.201270 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b712f87-66d9-491b-a72c-e949ccb967f2 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:37.203117 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 126/245] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:41:37.209622 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece92739-5a77-49c6-9e88-11401aa01529 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:37.210160 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece92739-5a77-49c6-9e88-11401aa01529 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:37.210627 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece92739-5a77-49c6-9e88-11401aa01529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:37.227571 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-ece92739-5a77-49c6-9e88-11401aa01529 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:37.229627 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ece92739-5a77-49c6-9e88-11401aa01529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:37.269213 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e933806-0fdd-43fe-aa90-13dab0cb3f71 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:37.303820 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 127/246] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:41:37.309650 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3244007-aba3-466c-9503-7fd3de360a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:37.310526 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3244007-aba3-466c-9503-7fd3de360a27 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:37.310813 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3244007-aba3-466c-9503-7fd3de360a27 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:37.311091 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3244007-aba3-466c-9503-7fd3de360a27 None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:37.312308 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3244007-aba3-466c-9503-7fd3de360a27 None admin] RBAC: Authorizing `identity:get_project(project_id=63fb9340f10a4486a0c9270676f88f02)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:37.313784 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3244007-aba3-466c-9503-7fd3de360a27 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:37.315807 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 120/247] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:37 2022] GET /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:37.321317 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece92739-5a77-49c6-9e88-11401aa01529 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:37.330708 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3244007-aba3-466c-9503-7fd3de360a27 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:37.435003 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece92739-5a77-49c6-9e88-11401aa01529 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:37.446135 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3244007-aba3-466c-9503-7fd3de360a27 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:37.470486 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b4ed2-bc54-4ee9-8ef3-d3c5dc1f786a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:37.471206 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b4ed2-bc54-4ee9-8ef3-d3c5dc1f786a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:37.471487 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b4ed2-bc54-4ee9-8ef3-d3c5dc1f786a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:37.471794 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b4ed2-bc54-4ee9-8ef3-d3c5dc1f786a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:37.472631 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b4ed2-bc54-4ee9-8ef3-d3c5dc1f786a None admin] RBAC: Adding query filter params (role.id=d6ff23054a6c45d1b4e7e5da9305d7f3, scope.project.id=63fb9340f10a4486a0c9270676f88f02, user.id=0df420bdcfc14207b7b7846bd16d4868) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:37.472941 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b4ed2-bc54-4ee9-8ef3-d3c5dc1f786a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:37.474380 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b4ed2-bc54-4ee9-8ef3-d3c5dc1f786a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:37.481117 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 128/248] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:41:37 2022] GET /identity/v3/role_assignments?user.id=0df420bdcfc14207b7b7846bd16d4868&scope.project.id=63fb9340f10a4486a0c9270676f88f02&role.id=d6ff23054a6c45d1b4e7e5da9305d7f3 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:37.482600 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e97800-fa56-4add-95d1-6c28216d70c2 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:37.482886 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e97800-fa56-4add-95d1-6c28216d70c2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:37.483159 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e97800-fa56-4add-95d1-6c28216d70c2 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:37.484722 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 129/249] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:37.485710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae377c6e-c6f6-412c-9e6f-f2eb03ab2aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:37.486766 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae377c6e-c6f6-412c-9e6f-f2eb03ab2aaa None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:37.487402 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae377c6e-c6f6-412c-9e6f-f2eb03ab2aaa None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:37.487912 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae377c6e-c6f6-412c-9e6f-f2eb03ab2aaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:37.490608 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce5243-cca6-4ace-a1aa-8d84dc75d9d6 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:37.490879 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce5243-cca6-4ace-a1aa-8d84dc75d9d6 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:37.491134 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce5243-cca6-4ace-a1aa-8d84dc75d9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:37.502221 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae377c6e-c6f6-412c-9e6f-f2eb03ab2aaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:37.509897 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-ae377c6e-c6f6-412c-9e6f-f2eb03ab2aaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:41:37.510183 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-64ce5243-cca6-4ace-a1aa-8d84dc75d9d6 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:37.511372 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-64ce5243-cca6-4ace-a1aa-8d84dc75d9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:37.511986 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 121/250] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:41:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:41:37.520737 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae377c6e-c6f6-412c-9e6f-f2eb03ab2aaa None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:37.588672 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 130/251] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:41:37.611336 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce5243-cca6-4ace-a1aa-8d84dc75d9d6 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:37.633526 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae377c6e-c6f6-412c-9e6f-f2eb03ab2aaa None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:37.672786 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb6fc3-53e2-4dce-8e2a-35e51b7d5057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:37.673843 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb6fc3-53e2-4dce-8e2a-35e51b7d5057 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:37.674347 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb6fc3-53e2-4dce-8e2a-35e51b7d5057 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:37.674907 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb6fc3-53e2-4dce-8e2a-35e51b7d5057 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:37.675948 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb6fc3-53e2-4dce-8e2a-35e51b7d5057 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:37.676480 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb6fc3-53e2-4dce-8e2a-35e51b7d5057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:37.678135 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb6fc3-53e2-4dce-8e2a-35e51b7d5057 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:37.687818 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 122/252] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:37.693323 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb6fc3-53e2-4dce-8e2a-35e51b7d5057 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:37.717545 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce5243-cca6-4ace-a1aa-8d84dc75d9d6 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:37.754002 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9a0d6-cee5-420e-bcc7-80ae69de0ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:37.754799 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9a0d6-cee5-420e-bcc7-80ae69de0ff5 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:37.755079 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9a0d6-cee5-420e-bcc7-80ae69de0ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:37.755353 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9a0d6-cee5-420e-bcc7-80ae69de0ff5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:37.776444 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9a0d6-cee5-420e-bcc7-80ae69de0ff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:37.783327 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-c5a9a0d6-cee5-420e-bcc7-80ae69de0ff5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 13:41:37.784709 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 131/253] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:41:37.790582 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9a0d6-cee5-420e-bcc7-80ae69de0ff5 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:37.891714 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9a0d6-cee5-420e-bcc7-80ae69de0ff5 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:37.911280 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb6fc3-53e2-4dce-8e2a-35e51b7d5057 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:37.931338 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b92fa-882d-4b28-a5c6-bb6359c50a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:37.932123 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b92fa-882d-4b28-a5c6-bb6359c50a4e None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:37.932410 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b92fa-882d-4b28-a5c6-bb6359c50a4e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:37.932680 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b92fa-882d-4b28-a5c6-bb6359c50a4e None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:37.933429 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b92fa-882d-4b28-a5c6-bb6359c50a4e None admin] RBAC: Adding query filter params (name=member) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:37.933731 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b92fa-882d-4b28-a5c6-bb6359c50a4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:37.935119 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b92fa-882d-4b28-a5c6-bb6359c50a4e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:37.952309 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 132/254] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:37.966052 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b92fa-882d-4b28-a5c6-bb6359c50a4e None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:37.988882 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70072c4-538b-4c85-9724-5acd027a0dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:37.989876 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70072c4-538b-4c85-9724-5acd027a0dcb None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:37.990157 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70072c4-538b-4c85-9724-5acd027a0dcb None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:37.990424 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70072c4-538b-4c85-9724-5acd027a0dcb None admin] PATH_INFO: `/v3/users/a70223b705ec4352a13fca9a0479cad8` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:37.993196 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70072c4-538b-4c85-9724-5acd027a0dcb None admin] RBAC: Authorizing `identity:get_user(user_id=a70223b705ec4352a13fca9a0479cad8)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:37.994852 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70072c4-538b-4c85-9724-5acd027a0dcb None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:37.999209 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 123/255] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:37 2022] GET /identity/v3/users/a70223b705ec4352a13fca9a0479cad8 => generated 283 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:38.001678 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073113a-8d92-4511-892f-e3c3d17beb3c None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:38.001965 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073113a-8d92-4511-892f-e3c3d17beb3c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:38.002236 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073113a-8d92-4511-892f-e3c3d17beb3c None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:38.007020 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 124/256] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:38.007826 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073113a-8d92-4511-892f-e3c3d17beb3c None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:38.123187 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b92fa-882d-4b28-a5c6-bb6359c50a4e None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:38.160747 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073113a-8d92-4511-892f-e3c3d17beb3c None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:38.170039 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33672ae2-b257-4697-abaa-4ff8645e6e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:38.170916 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33672ae2-b257-4697-abaa-4ff8645e6e53 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:38.171195 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33672ae2-b257-4697-abaa-4ff8645e6e53 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:38.171516 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33672ae2-b257-4697-abaa-4ff8645e6e53 None admin] PATH_INFO: `/v3/users/f47cbda85a884daca8577b3e5559dafd` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:38.173746 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33672ae2-b257-4697-abaa-4ff8645e6e53 None admin] RBAC: Authorizing `identity:get_user(user_id=f47cbda85a884daca8577b3e5559dafd)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:38.175187 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33672ae2-b257-4697-abaa-4ff8645e6e53 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:38.176836 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 133/257] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:37 2022] GET /identity/v3/users/f47cbda85a884daca8577b3e5559dafd => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:38.178816 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da635da-e866-4c10-9866-0dfbc496cb0d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:38.179098 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da635da-e866-4c10-9866-0dfbc496cb0d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:38.179370 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da635da-e866-4c10-9866-0dfbc496cb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:38.207355 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-0da635da-e866-4c10-9866-0dfbc496cb0d None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:38.208559 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0da635da-e866-4c10-9866-0dfbc496cb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:38.230045 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478863f-241d-48b8-9299-2a41a8bc1a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:38.230711 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478863f-241d-48b8-9299-2a41a8bc1a33 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:38.230995 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478863f-241d-48b8-9299-2a41a8bc1a33 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:38.231271 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478863f-241d-48b8-9299-2a41a8bc1a33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:38.302647 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478863f-241d-48b8-9299-2a41a8bc1a33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:38.304160 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478863f-241d-48b8-9299-2a41a8bc1a33 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:38.308309 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 134/258] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:38.309057 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da635da-e866-4c10-9866-0dfbc496cb0d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:38.435315 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 125/259] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:41:38.436126 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478863f-241d-48b8-9299-2a41a8bc1a33 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:38.535269 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478863f-241d-48b8-9299-2a41a8bc1a33 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:38.539169 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da635da-e866-4c10-9866-0dfbc496cb0d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:38.575775 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5b382-0d8b-4300-9c00-5436ee777fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:38.576598 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5b382-0d8b-4300-9c00-5436ee777fdd None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:38.577132 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5b382-0d8b-4300-9c00-5436ee777fdd None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:38.577403 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5b382-0d8b-4300-9c00-5436ee777fdd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:38.592200 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5b382-0d8b-4300-9c00-5436ee777fdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:38.599596 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-69c5b382-0d8b-4300-9c00-5436ee777fdd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 13:41:38.601148 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 126/260] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:41:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:38.601936 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5b382-0d8b-4300-9c00-5436ee777fdd None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:38.612339 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ba147-ba6a-47b2-b212-eafd9f209f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:38.613223 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ba147-ba6a-47b2-b212-eafd9f209f4f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:38.613514 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ba147-ba6a-47b2-b212-eafd9f209f4f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:38.613792 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ba147-ba6a-47b2-b212-eafd9f209f4f None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:38.615026 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ba147-ba6a-47b2-b212-eafd9f209f4f None admin] RBAC: Authorizing `identity:get_project(project_id=63fb9340f10a4486a0c9270676f88f02)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:38.616512 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ba147-ba6a-47b2-b212-eafd9f209f4f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:38.618214 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 135/261] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:38 2022] GET /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02 => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:38.619045 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ba147-ba6a-47b2-b212-eafd9f209f4f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:38.714850 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5b382-0d8b-4300-9c00-5436ee777fdd None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:38.748103 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5cbbc-51d9-4c61-b3b0-ca6c0da0d29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:38.748971 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5cbbc-51d9-4c61-b3b0-ca6c0da0d29a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:38.749249 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5cbbc-51d9-4c61-b3b0-ca6c0da0d29a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:38.749522 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5cbbc-51d9-4c61-b3b0-ca6c0da0d29a None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:38.750732 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5cbbc-51d9-4c61-b3b0-ca6c0da0d29a None admin] RBAC: Authorizing `identity:get_project(project_id=63fb9340f10a4486a0c9270676f88f02)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:38.752254 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5cbbc-51d9-4c61-b3b0-ca6c0da0d29a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:38.753978 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 127/262] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:38 2022] GET /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:38.754729 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5cbbc-51d9-4c61-b3b0-ca6c0da0d29a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:38.827513 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ba147-ba6a-47b2-b212-eafd9f209f4f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:38.858316 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5cbbc-51d9-4c61-b3b0-ca6c0da0d29a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:38.892504 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9975f-0fba-4547-bb69-5c944d4bb992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:38.893405 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9975f-0fba-4547-bb69-5c944d4bb992 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:38.893697 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9975f-0fba-4547-bb69-5c944d4bb992 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:38.893975 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9975f-0fba-4547-bb69-5c944d4bb992 None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02/users/f47cbda85a884daca8577b3e5559dafd/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:38.895607 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2275afd-9deb-4e53-a121-ec32cf43490a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:38.896025 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9975f-0fba-4547-bb69-5c944d4bb992 None admin] RBAC: Authorizing `identity:create_grant(project_id=63fb9340f10a4486a0c9270676f88f02, user_id=f47cbda85a884daca8577b3e5559dafd, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:38.896304 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2275afd-9deb-4e53-a121-ec32cf43490a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:38.896584 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2275afd-9deb-4e53-a121-ec32cf43490a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:38.896858 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2275afd-9deb-4e53-a121-ec32cf43490a None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:38.897505 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9975f-0fba-4547-bb69-5c944d4bb992 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:38.897596 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2275afd-9deb-4e53-a121-ec32cf43490a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:38.897899 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2275afd-9deb-4e53-a121-ec32cf43490a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:38.899246 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2275afd-9deb-4e53-a121-ec32cf43490a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:38.911791 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 136/263] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:41:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:38.912699 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2275afd-9deb-4e53-a121-ec32cf43490a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:38.923222 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 128/264] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:41:38 2022] PUT /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02/users/f47cbda85a884daca8577b3e5559dafd/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:41:38.923904 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9975f-0fba-4547-bb69-5c944d4bb992 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:39.066483 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2275afd-9deb-4e53-a121-ec32cf43490a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:39.113186 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071ccb2-68db-4e65-9bd4-9bfa1b3d6de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:39.113872 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071ccb2-68db-4e65-9bd4-9bfa1b3d6de5 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:39.114158 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071ccb2-68db-4e65-9bd4-9bfa1b3d6de5 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:39.114439 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071ccb2-68db-4e65-9bd4-9bfa1b3d6de5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:39.115282 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071ccb2-68db-4e65-9bd4-9bfa1b3d6de5 None admin] RBAC: Adding query filter params (role.id=e3333fcf22b040e3a1f0bfbfe657cffa, scope.project.id=63fb9340f10a4486a0c9270676f88f02, user.id=a70223b705ec4352a13fca9a0479cad8) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:39.115598 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071ccb2-68db-4e65-9bd4-9bfa1b3d6de5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:39.117114 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071ccb2-68db-4e65-9bd4-9bfa1b3d6de5 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:39.130114 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 137/265] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:41:38 2022] GET /identity/v3/role_assignments?user.id=a70223b705ec4352a13fca9a0479cad8&scope.project.id=63fb9340f10a4486a0c9270676f88f02&role.id=e3333fcf22b040e3a1f0bfbfe657cffa => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:39.146261 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9975f-0fba-4547-bb69-5c944d4bb992 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:39.200534 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad63851-2bd9-4df7-971b-85cecc59c1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:39.201510 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad63851-2bd9-4df7-971b-85cecc59c1b4 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:39.202053 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad63851-2bd9-4df7-971b-85cecc59c1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:39.202334 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad63851-2bd9-4df7-971b-85cecc59c1b4 None admin] PATH_INFO: `/v3/users/a70223b705ec4352a13fca9a0479cad8` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:39.203772 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad63851-2bd9-4df7-971b-85cecc59c1b4 None admin] RBAC: Authorizing `identity:get_user(user_id=a70223b705ec4352a13fca9a0479cad8)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:39.205327 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad63851-2bd9-4df7-971b-85cecc59c1b4 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:39.207073 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 129/266] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:38 2022] GET /identity/v3/users/a70223b705ec4352a13fca9a0479cad8 => generated 283 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:39.213436 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071ccb2-68db-4e65-9bd4-9bfa1b3d6de5 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:39.344294 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071ccb2-68db-4e65-9bd4-9bfa1b3d6de5 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:39.397281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1665294-15e5-47cd-bb17-1a6a6611f097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:39.397281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1665294-15e5-47cd-bb17-1a6a6611f097 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:39.397281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1665294-15e5-47cd-bb17-1a6a6611f097 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:39.397281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1665294-15e5-47cd-bb17-1a6a6611f097 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:39.477451 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1665294-15e5-47cd-bb17-1a6a6611f097 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:39.479019 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1665294-15e5-47cd-bb17-1a6a6611f097 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:39.598124 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 138/267] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:41:39.603669 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad63851-2bd9-4df7-971b-85cecc59c1b4 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:39.712073 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad63851-2bd9-4df7-971b-85cecc59c1b4 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:39.753230 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9ce08-57a0-407a-8ac9-92cfb9e4c3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:39.754101 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9ce08-57a0-407a-8ac9-92cfb9e4c3fe None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:39.754385 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9ce08-57a0-407a-8ac9-92cfb9e4c3fe None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:39.754659 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9ce08-57a0-407a-8ac9-92cfb9e4c3fe None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:39.758544 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9ce08-57a0-407a-8ac9-92cfb9e4c3fe None admin] RBAC: Authorizing `identity:get_project(project_id=63fb9340f10a4486a0c9270676f88f02)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:39.760697 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9ce08-57a0-407a-8ac9-92cfb9e4c3fe None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:39.762773 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 130/268] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:39 2022] GET /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:39.768292 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1665294-15e5-47cd-bb17-1a6a6611f097 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:39.887576 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1665294-15e5-47cd-bb17-1a6a6611f097 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:39.925739 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd81627-3f89-4e9b-a723-a480b8d6c4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:39.926427 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd81627-3f89-4e9b-a723-a480b8d6c4c3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:39.926729 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd81627-3f89-4e9b-a723-a480b8d6c4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:39.926976 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd81627-3f89-4e9b-a723-a480b8d6c4c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:39.927850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd81627-3f89-4e9b-a723-a480b8d6c4c3 None admin] RBAC: Adding query filter params (role.id=fbb7398610b649859d123d0938aa8e75, scope.project.id=63fb9340f10a4486a0c9270676f88f02, user.id=a70223b705ec4352a13fca9a0479cad8) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:39.928164 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd81627-3f89-4e9b-a723-a480b8d6c4c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:39.929626 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd81627-3f89-4e9b-a723-a480b8d6c4c3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:39.938155 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 139/269] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:41:39 2022] GET /identity/v3/role_assignments?user.id=a70223b705ec4352a13fca9a0479cad8&scope.project.id=63fb9340f10a4486a0c9270676f88f02&role.id=fbb7398610b649859d123d0938aa8e75 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:40.432531 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92377e-d747-4b32-93d7-68ab198526e1 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:40.433354 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92377e-d747-4b32-93d7-68ab198526e1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:40.433771 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92377e-d747-4b32-93d7-68ab198526e1 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:40.435287 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 131/270] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:40.440767 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12e8d1-8342-42e4-b6d3-3d8acaa79fe4 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:40.441521 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12e8d1-8342-42e4-b6d3-3d8acaa79fe4 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:40.441937 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12e8d1-8342-42e4-b6d3-3d8acaa79fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:40.459884 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-6d12e8d1-8342-42e4-b6d3-3d8acaa79fe4 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:40.461267 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6d12e8d1-8342-42e4-b6d3-3d8acaa79fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:40.533176 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 140/271] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:40.559339 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92377e-d747-4b32-93d7-68ab198526e1 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:40.564433 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccb212-e168-4e2b-b0e0-6892fe681936 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:40.564729 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccb212-e168-4e2b-b0e0-6892fe681936 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:40.565013 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccb212-e168-4e2b-b0e0-6892fe681936 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:40.566721 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 141/272] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:41:40.573021 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f6b28-ac43-4e12-b122-efe9a6a3b330 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:40.573305 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f6b28-ac43-4e12-b122-efe9a6a3b330 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:40.573589 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f6b28-ac43-4e12-b122-efe9a6a3b330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:40.591523 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7c6f6b28-ac43-4e12-b122-efe9a6a3b330 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:40.592738 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7c6f6b28-ac43-4e12-b122-efe9a6a3b330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:40.666767 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 142/273] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:41:40.669526 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34693ac8-e30e-4b69-bef9-79a99ec2410e None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:40.669748 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34693ac8-e30e-4b69-bef9-79a99ec2410e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:40.670122 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34693ac8-e30e-4b69-bef9-79a99ec2410e None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:40.670593 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92377e-d747-4b32-93d7-68ab198526e1 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:40.671618 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 143/274] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:40.676857 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91544bc-0443-42ab-ae2c-a15aab879b58 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:40.677215 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91544bc-0443-42ab-ae2c-a15aab879b58 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:40.677569 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91544bc-0443-42ab-ae2c-a15aab879b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:40.695693 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e91544bc-0443-42ab-ae2c-a15aab879b58 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:40.697716 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e91544bc-0443-42ab-ae2c-a15aab879b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:40.713945 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cb4c8-6cdb-4664-a330-0a790ee4e7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:40.715015 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cb4c8-6cdb-4664-a330-0a790ee4e7e4 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:40.715464 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cb4c8-6cdb-4664-a330-0a790ee4e7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:40.715926 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cb4c8-6cdb-4664-a330-0a790ee4e7e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:40.726318 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cb4c8-6cdb-4664-a330-0a790ee4e7e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:40.733470 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-719cb4c8-6cdb-4664-a330-0a790ee4e7e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 13:41:40.734692 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 132/275] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:40.739406 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cb4c8-6cdb-4664-a330-0a790ee4e7e4 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:40.764273 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 144/276] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:41:40.772690 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91544bc-0443-42ab-ae2c-a15aab879b58 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:40.838533 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cb4c8-6cdb-4664-a330-0a790ee4e7e4 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:40.870335 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc64ac-8b53-4f4e-a5f8-c731965e8440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:40.871127 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc64ac-8b53-4f4e-a5f8-c731965e8440 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:40.871410 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc64ac-8b53-4f4e-a5f8-c731965e8440 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:40.871710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc64ac-8b53-4f4e-a5f8-c731965e8440 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:40.881632 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc64ac-8b53-4f4e-a5f8-c731965e8440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:40.888576 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91544bc-0443-42ab-ae2c-a15aab879b58 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:40.889351 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-4ccc64ac-8b53-4f4e-a5f8-c731965e8440 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 13:41:40.895194 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 133/277] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:40.895194 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc64ac-8b53-4f4e-a5f8-c731965e8440 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:40.927649 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299837a4-3c92-4b7c-9730-a8891292687b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:40.928259 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299837a4-3c92-4b7c-9730-a8891292687b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:40.928546 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299837a4-3c92-4b7c-9730-a8891292687b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:40.928825 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299837a4-3c92-4b7c-9730-a8891292687b None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:40.929576 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299837a4-3c92-4b7c-9730-a8891292687b None admin] RBAC: Adding query filter params (name=member) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:40.929884 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299837a4-3c92-4b7c-9730-a8891292687b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:40.931873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299837a4-3c92-4b7c-9730-a8891292687b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:40.944298 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 145/278] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:40.944298 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299837a4-3c92-4b7c-9730-a8891292687b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:40.995330 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc64ac-8b53-4f4e-a5f8-c731965e8440 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:41.028609 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc6dc7-29b2-4d8a-a83a-f44e75cb2603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:41.029686 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc6dc7-29b2-4d8a-a83a-f44e75cb2603 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:41.030150 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc6dc7-29b2-4d8a-a83a-f44e75cb2603 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:41.030615 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc6dc7-29b2-4d8a-a83a-f44e75cb2603 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:41.031834 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc6dc7-29b2-4d8a-a83a-f44e75cb2603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:41.033305 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc6dc7-29b2-4d8a-a83a-f44e75cb2603 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:41.034933 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 134/279] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:41:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:41.039412 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc6dc7-29b2-4d8a-a83a-f44e75cb2603 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:41.042561 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299837a4-3c92-4b7c-9730-a8891292687b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:41.077744 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d794092-43a7-4c3b-8bf2-0bfd396947be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:41.078412 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d794092-43a7-4c3b-8bf2-0bfd396947be None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:41.078701 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d794092-43a7-4c3b-8bf2-0bfd396947be None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:41.078985 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d794092-43a7-4c3b-8bf2-0bfd396947be None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:41.079755 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d794092-43a7-4c3b-8bf2-0bfd396947be None admin] RBAC: Adding query filter params (name=reader) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:41.080067 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d794092-43a7-4c3b-8bf2-0bfd396947be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:41.081448 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d794092-43a7-4c3b-8bf2-0bfd396947be None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:41.095983 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 146/280] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:41.095983 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d794092-43a7-4c3b-8bf2-0bfd396947be None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:41.139983 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc6dc7-29b2-4d8a-a83a-f44e75cb2603 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:41.174391 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39123379-3f82-4403-bff2-dabdc3eda1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:41.175267 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39123379-3f82-4403-bff2-dabdc3eda1a8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:41.175550 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39123379-3f82-4403-bff2-dabdc3eda1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:41.175854 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39123379-3f82-4403-bff2-dabdc3eda1a8 None admin] PATH_INFO: `/v3/users/f02e7449a7f64cd4940193e93acd517e` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:41.188851 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39123379-3f82-4403-bff2-dabdc3eda1a8 None admin] RBAC: Authorizing `identity:get_user(user_id=f02e7449a7f64cd4940193e93acd517e)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:41.190265 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39123379-3f82-4403-bff2-dabdc3eda1a8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:41.196582 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 135/281] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:41 2022] GET /identity/v3/users/f02e7449a7f64cd4940193e93acd517e => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:41.196582 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39123379-3f82-4403-bff2-dabdc3eda1a8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:41.202162 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d794092-43a7-4c3b-8bf2-0bfd396947be None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:41.235105 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394215f-1662-4f69-a049-3b04a814b800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:41.235911 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394215f-1662-4f69-a049-3b04a814b800 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:41.236201 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394215f-1662-4f69-a049-3b04a814b800 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:41.236481 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394215f-1662-4f69-a049-3b04a814b800 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:41.237192 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394215f-1662-4f69-a049-3b04a814b800 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:41.238637 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394215f-1662-4f69-a049-3b04a814b800 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:41.271675 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 147/282] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Apr 11 13:41:41 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:41:41.271675 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394215f-1662-4f69-a049-3b04a814b800 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:41.320737 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39123379-3f82-4403-bff2-dabdc3eda1a8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:41.367584 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94209b72-cf78-452c-bfe7-5d2dab43a41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:41.368806 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94209b72-cf78-452c-bfe7-5d2dab43a41d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:41.369340 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94209b72-cf78-452c-bfe7-5d2dab43a41d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:41.369731 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94209b72-cf78-452c-bfe7-5d2dab43a41d None admin] PATH_INFO: `/v3/users/0df420bdcfc14207b7b7846bd16d4868` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:41.371196 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94209b72-cf78-452c-bfe7-5d2dab43a41d None admin] RBAC: Authorizing `identity:get_user(user_id=0df420bdcfc14207b7b7846bd16d4868)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:41.372853 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94209b72-cf78-452c-bfe7-5d2dab43a41d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:41.374715 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 136/283] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:41 2022] GET /identity/v3/users/0df420bdcfc14207b7b7846bd16d4868 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:41.376729 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394215f-1662-4f69-a049-3b04a814b800 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:41.385731 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94209b72-cf78-452c-bfe7-5d2dab43a41d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:41.415783 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee042e0d-d5aa-4792-8d71-002e4dc88acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:41.416734 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee042e0d-d5aa-4792-8d71-002e4dc88acf None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:41.417017 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee042e0d-d5aa-4792-8d71-002e4dc88acf None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:41.417296 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee042e0d-d5aa-4792-8d71-002e4dc88acf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:41.418250 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee042e0d-d5aa-4792-8d71-002e4dc88acf None admin] RBAC: Adding query filter params (role.id=3daf622d91e64ce685da6f482aa181ea, user.id=f02e7449a7f64cd4940193e93acd517e, scope.system=all) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:41.418533 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee042e0d-d5aa-4792-8d71-002e4dc88acf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:41.420121 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee042e0d-d5aa-4792-8d71-002e4dc88acf None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:41.431668 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 148/284] 10.222.0.67 () {56 vars in 1308 bytes} [Mon Apr 11 13:41:41 2022] GET /identity/v3/role_assignments?user.id=f02e7449a7f64cd4940193e93acd517e&scope.system=all&role.id=3daf622d91e64ce685da6f482aa181ea => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:41.514273 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94209b72-cf78-452c-bfe7-5d2dab43a41d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:41.556562 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a471e-bf7d-4d82-8b12-eadde5b08e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:41.557493 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a471e-bf7d-4d82-8b12-eadde5b08e8a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:41.557782 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a471e-bf7d-4d82-8b12-eadde5b08e8a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:41.558057 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a471e-bf7d-4d82-8b12-eadde5b08e8a None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:41.559328 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a471e-bf7d-4d82-8b12-eadde5b08e8a None admin] RBAC: Authorizing `identity:get_project(project_id=63fb9340f10a4486a0c9270676f88f02)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:41.560837 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a471e-bf7d-4d82-8b12-eadde5b08e8a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:41.562944 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 137/285] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:41 2022] GET /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:41.568580 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee042e0d-d5aa-4792-8d71-002e4dc88acf None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:41.679962 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee042e0d-d5aa-4792-8d71-002e4dc88acf None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:41.722254 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbbe0ee-2242-4310-95ca-b4a47f0c1bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:41.723156 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbe0ee-2242-4310-95ca-b4a47f0c1bd2 None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:41.723440 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbe0ee-2242-4310-95ca-b4a47f0c1bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:41.723739 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbe0ee-2242-4310-95ca-b4a47f0c1bd2 None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02/users/0df420bdcfc14207b7b7846bd16d4868/roles/d6ff23054a6c45d1b4e7e5da9305d7f3` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:41.725780 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbbe0ee-2242-4310-95ca-b4a47f0c1bd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=63fb9340f10a4486a0c9270676f88f02, user_id=0df420bdcfc14207b7b7846bd16d4868, role_id=d6ff23054a6c45d1b4e7e5da9305d7f3)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:41.727245 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbbe0ee-2242-4310-95ca-b4a47f0c1bd2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:41.755076 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 149/286] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:41:41 2022] PUT /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02/users/0df420bdcfc14207b7b7846bd16d4868/roles/d6ff23054a6c45d1b4e7e5da9305d7f3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:41:41.935532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de270693-8296-48f3-b6d6-aa779482b591 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:41.935962 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de270693-8296-48f3-b6d6-aa779482b591 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:41.936140 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de270693-8296-48f3-b6d6-aa779482b591 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:41.937850 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 138/287] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:41.943869 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f566d-422f-49e7-b9fc-d2f6ecc2ea97 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:41.944220 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f566d-422f-49e7-b9fc-d2f6ecc2ea97 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:41.944476 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f566d-422f-49e7-b9fc-d2f6ecc2ea97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:41.968736 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e05f566d-422f-49e7-b9fc-d2f6ecc2ea97 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:41.969985 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e05f566d-422f-49e7-b9fc-d2f6ecc2ea97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:42.177281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 150/288] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:42.226808 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de270693-8296-48f3-b6d6-aa779482b591 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:42.361020 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de270693-8296-48f3-b6d6-aa779482b591 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:42.407169 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4b7b4-52e5-4c6e-b95d-1302e3b78d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:42.408011 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4b7b4-52e5-4c6e-b95d-1302e3b78d29 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:42.408294 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4b7b4-52e5-4c6e-b95d-1302e3b78d29 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:42.408567 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4b7b4-52e5-4c6e-b95d-1302e3b78d29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:42.422586 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4b7b4-52e5-4c6e-b95d-1302e3b78d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:42.429803 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-7ab4b7b4-52e5-4c6e-b95d-1302e3b78d29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 13:41:42.431276 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 139/289] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:42.437207 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f566d-422f-49e7-b9fc-d2f6ecc2ea97 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:42.596920 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f566d-422f-49e7-b9fc-d2f6ecc2ea97 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:42.641206 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e00952-ca0e-4c78-9ab2-6fd0fc9cda19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:42.642240 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e00952-ca0e-4c78-9ab2-6fd0fc9cda19 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:42.642748 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e00952-ca0e-4c78-9ab2-6fd0fc9cda19 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:42.643219 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e00952-ca0e-4c78-9ab2-6fd0fc9cda19 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:42.644332 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e00952-ca0e-4c78-9ab2-6fd0fc9cda19 None admin] RBAC: Adding query filter params (name=member) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:42.644839 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e00952-ca0e-4c78-9ab2-6fd0fc9cda19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:42.646394 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e00952-ca0e-4c78-9ab2-6fd0fc9cda19 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:42.659051 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 151/290] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:42.664241 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4b7b4-52e5-4c6e-b95d-1302e3b78d29 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:42.815323 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4b7b4-52e5-4c6e-b95d-1302e3b78d29 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:42.860433 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545339a-0b13-49c2-be10-9f15ff4416cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:42.861247 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545339a-0b13-49c2-be10-9f15ff4416cd None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:42.861537 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545339a-0b13-49c2-be10-9f15ff4416cd None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:42.861815 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545339a-0b13-49c2-be10-9f15ff4416cd None admin] PATH_INFO: `/v3/users/f47cbda85a884daca8577b3e5559dafd` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:42.863158 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545339a-0b13-49c2-be10-9f15ff4416cd None admin] RBAC: Authorizing `identity:get_user(user_id=f47cbda85a884daca8577b3e5559dafd)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:42.864749 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545339a-0b13-49c2-be10-9f15ff4416cd None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:42.866755 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 140/291] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:42 2022] GET /identity/v3/users/f47cbda85a884daca8577b3e5559dafd => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:42.873054 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e00952-ca0e-4c78-9ab2-6fd0fc9cda19 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:43.018716 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e00952-ca0e-4c78-9ab2-6fd0fc9cda19 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:43.064587 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88998a68-66ad-46bd-bb39-952aae227f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:43.065241 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88998a68-66ad-46bd-bb39-952aae227f78 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:43.065526 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88998a68-66ad-46bd-bb39-952aae227f78 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:43.065804 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88998a68-66ad-46bd-bb39-952aae227f78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:43.151594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88998a68-66ad-46bd-bb39-952aae227f78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:43.153071 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88998a68-66ad-46bd-bb39-952aae227f78 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:43.279777 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 152/292] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:41:43.285073 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545339a-0b13-49c2-be10-9f15ff4416cd None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:43.408124 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545339a-0b13-49c2-be10-9f15ff4416cd None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:43.448422 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb552b2d-d8cd-42fd-9dd9-48b6d06ee3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:43.449300 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb552b2d-d8cd-42fd-9dd9-48b6d06ee3b4 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:43.449587 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb552b2d-d8cd-42fd-9dd9-48b6d06ee3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:43.449862 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb552b2d-d8cd-42fd-9dd9-48b6d06ee3b4 None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:43.454795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb552b2d-d8cd-42fd-9dd9-48b6d06ee3b4 None admin] RBAC: Authorizing `identity:get_project(project_id=63fb9340f10a4486a0c9270676f88f02)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:43.456313 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb552b2d-d8cd-42fd-9dd9-48b6d06ee3b4 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:43.458041 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 141/293] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:43 2022] GET /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:43.464049 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88998a68-66ad-46bd-bb39-952aae227f78 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:43.595925 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88998a68-66ad-46bd-bb39-952aae227f78 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:43.642745 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113460f-2e52-4041-a719-2b32904fcc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:43.643388 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113460f-2e52-4041-a719-2b32904fcc9b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:43.643699 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113460f-2e52-4041-a719-2b32904fcc9b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:43.643979 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113460f-2e52-4041-a719-2b32904fcc9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:43.644826 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113460f-2e52-4041-a719-2b32904fcc9b None admin] RBAC: Adding query filter params (role.id=3daf622d91e64ce685da6f482aa181ea, scope.project.id=63fb9340f10a4486a0c9270676f88f02, user.id=f47cbda85a884daca8577b3e5559dafd) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:43.645138 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113460f-2e52-4041-a719-2b32904fcc9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:43.646563 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113460f-2e52-4041-a719-2b32904fcc9b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:43.656258 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 153/294] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:41:43 2022] GET /identity/v3/role_assignments?user.id=f47cbda85a884daca8577b3e5559dafd&scope.project.id=63fb9340f10a4486a0c9270676f88f02&role.id=3daf622d91e64ce685da6f482aa181ea => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:44.188851 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84aa3f8-3b09-4111-82f6-72d2df1381aa None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:44.189863 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84aa3f8-3b09-4111-82f6-72d2df1381aa None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:44.190347 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84aa3f8-3b09-4111-82f6-72d2df1381aa None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:44.192233 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 142/295] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:44.198317 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979458b-0aa8-403e-8a20-4daa5cb1e440 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:44.198601 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979458b-0aa8-403e-8a20-4daa5cb1e440 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:44.198879 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979458b-0aa8-403e-8a20-4daa5cb1e440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:44.215956 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-8979458b-0aa8-403e-8a20-4daa5cb1e440 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:44.217123 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8979458b-0aa8-403e-8a20-4daa5cb1e440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:44.237015 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec583a-ec76-414a-98c1-b5baffec4db4 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:44.237627 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec583a-ec76-414a-98c1-b5baffec4db4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:44.238130 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec583a-ec76-414a-98c1-b5baffec4db4 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:44.239981 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 143/296] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:44.245300 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fe884-94c1-45e4-a4eb-36ae35994f96 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:44.245840 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fe884-94c1-45e4-a4eb-36ae35994f96 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:44.246319 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fe884-94c1-45e4-a4eb-36ae35994f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:44.269448 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-f56fe884-94c1-45e4-a4eb-36ae35994f96 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:44.270976 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f56fe884-94c1-45e4-a4eb-36ae35994f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:44.289805 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 154/297] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:44.301492 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d7d38-69ea-4b1c-b63d-b4c4418aafba None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:44.302036 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d7d38-69ea-4b1c-b63d-b4c4418aafba None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:44.302482 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d7d38-69ea-4b1c-b63d-b4c4418aafba None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:44.304045 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 155/298] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:41:44.310285 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013e615-6fe0-4c24-a84e-5716286d9032 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:44.310571 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013e615-6fe0-4c24-a84e-5716286d9032 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:44.310843 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013e615-6fe0-4c24-a84e-5716286d9032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:44.332338 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-6013e615-6fe0-4c24-a84e-5716286d9032 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:44.333840 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6013e615-6fe0-4c24-a84e-5716286d9032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:44.349543 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 144/299] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:41:44.350381 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fe884-94c1-45e4-a4eb-36ae35994f96 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:44.407262 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 156/300] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:44.408330 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013e615-6fe0-4c24-a84e-5716286d9032 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:44.461440 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fe884-94c1-45e4-a4eb-36ae35994f96 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:44.496182 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03144d5a-38d8-456a-b5c1-97dc50ea5456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:44.496981 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03144d5a-38d8-456a-b5c1-97dc50ea5456 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:44.497262 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03144d5a-38d8-456a-b5c1-97dc50ea5456 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:44.497541 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03144d5a-38d8-456a-b5c1-97dc50ea5456 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:44.507165 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03144d5a-38d8-456a-b5c1-97dc50ea5456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:44.514217 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-03144d5a-38d8-456a-b5c1-97dc50ea5456 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 13:41:44.514346 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013e615-6fe0-4c24-a84e-5716286d9032 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:44.515604 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 145/301] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:44.516255 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03144d5a-38d8-456a-b5c1-97dc50ea5456 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:44.552601 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc304a-3ab3-4501-a9e1-1e5f93bcd14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:44.553414 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc304a-3ab3-4501-a9e1-1e5f93bcd14b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:44.553693 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc304a-3ab3-4501-a9e1-1e5f93bcd14b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:44.553992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc304a-3ab3-4501-a9e1-1e5f93bcd14b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:44.555193 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc304a-3ab3-4501-a9e1-1e5f93bcd14b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:44.557576 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc304a-3ab3-4501-a9e1-1e5f93bcd14b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:44.563954 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 157/302] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:41:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:44.564702 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc304a-3ab3-4501-a9e1-1e5f93bcd14b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:44.621529 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03144d5a-38d8-456a-b5c1-97dc50ea5456 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:44.657467 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d0f24-00eb-48bd-8601-746790afa02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:44.658346 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d0f24-00eb-48bd-8601-746790afa02e None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:44.658634 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d0f24-00eb-48bd-8601-746790afa02e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:44.658903 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d0f24-00eb-48bd-8601-746790afa02e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:44.664142 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc304a-3ab3-4501-a9e1-1e5f93bcd14b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:44.669817 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d0f24-00eb-48bd-8601-746790afa02e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:44.676757 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-023d0f24-00eb-48bd-8601-746790afa02e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 13:41:44.679667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 146/303] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:44.679667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d0f24-00eb-48bd-8601-746790afa02e None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:44.703661 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8acbf6-76b2-48e9-badd-df394e02d32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:44.704335 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8acbf6-76b2-48e9-badd-df394e02d32e None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:44.704623 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8acbf6-76b2-48e9-badd-df394e02d32e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:44.704884 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8acbf6-76b2-48e9-badd-df394e02d32e None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:44.705623 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8acbf6-76b2-48e9-badd-df394e02d32e None admin] RBAC: Adding query filter params (name=member) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:44.705925 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8acbf6-76b2-48e9-badd-df394e02d32e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:44.707282 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8acbf6-76b2-48e9-badd-df394e02d32e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:44.715342 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 158/304] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:44.719382 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8acbf6-76b2-48e9-badd-df394e02d32e None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:44.777703 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d0f24-00eb-48bd-8601-746790afa02e None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:44.810350 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f0221-3e10-43ea-8a63-e7d62327c541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:44.811011 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f0221-3e10-43ea-8a63-e7d62327c541 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:44.811291 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f0221-3e10-43ea-8a63-e7d62327c541 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:44.811564 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f0221-3e10-43ea-8a63-e7d62327c541 None admin] PATH_INFO: `/v3/groups` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:44.812280 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f0221-3e10-43ea-8a63-e7d62327c541 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:44.813724 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f0221-3e10-43ea-8a63-e7d62327c541 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:44.817942 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8acbf6-76b2-48e9-badd-df394e02d32e None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:44.830570 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 147/305] 10.222.0.67 () {60 vars in 1134 bytes} [Mon Apr 11 13:41:44 2022] POST /identity/v3/groups => generated 229 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:41:44.832570 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f0221-3e10-43ea-8a63-e7d62327c541 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:44.870629 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166c0de-2b4f-4a58-a4bb-4c520c8c5af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:44.871896 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166c0de-2b4f-4a58-a4bb-4c520c8c5af8 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:44.872380 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166c0de-2b4f-4a58-a4bb-4c520c8c5af8 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:44.872887 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166c0de-2b4f-4a58-a4bb-4c520c8c5af8 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:44.873930 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166c0de-2b4f-4a58-a4bb-4c520c8c5af8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:44.874441 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166c0de-2b4f-4a58-a4bb-4c520c8c5af8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:44.876855 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166c0de-2b4f-4a58-a4bb-4c520c8c5af8 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:44.889498 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 159/306] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:44.895684 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166c0de-2b4f-4a58-a4bb-4c520c8c5af8 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:44.949451 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f0221-3e10-43ea-8a63-e7d62327c541 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:44.985797 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a251910-7485-4367-a5a8-e0647c3988b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:44.986599 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a251910-7485-4367-a5a8-e0647c3988b0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:44.986884 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a251910-7485-4367-a5a8-e0647c3988b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:44.987160 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a251910-7485-4367-a5a8-e0647c3988b0 None admin] PATH_INFO: `/v3/users/f02e7449a7f64cd4940193e93acd517e` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:44.988441 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a251910-7485-4367-a5a8-e0647c3988b0 None admin] RBAC: Authorizing `identity:get_user(user_id=f02e7449a7f64cd4940193e93acd517e)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:44.989909 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a251910-7485-4367-a5a8-e0647c3988b0 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:44.996738 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 148/307] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:44 2022] GET /identity/v3/users/f02e7449a7f64cd4940193e93acd517e => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:44.996738 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e156ae-f5d4-4c37-a40e-8551e6e8be1a None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:44.996738 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e156ae-f5d4-4c37-a40e-8551e6e8be1a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:44.996738 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e156ae-f5d4-4c37-a40e-8551e6e8be1a None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:44.996738 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 149/308] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:44.998325 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e156ae-f5d4-4c37-a40e-8551e6e8be1a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:45.007687 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166c0de-2b4f-4a58-a4bb-4c520c8c5af8 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:45.046873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6c756-3bb7-4aef-9a72-87c7a16acf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:45.047457 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6c756-3bb7-4aef-9a72-87c7a16acf35 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:45.047792 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6c756-3bb7-4aef-9a72-87c7a16acf35 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:45.048071 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6c756-3bb7-4aef-9a72-87c7a16acf35 None admin] PATH_INFO: `/v3/users/114f9b84a89341baa98001b5e0a7e8f3` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:45.062992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6c756-3bb7-4aef-9a72-87c7a16acf35 None admin] RBAC: Authorizing `identity:get_user(user_id=114f9b84a89341baa98001b5e0a7e8f3)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:45.064476 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6c756-3bb7-4aef-9a72-87c7a16acf35 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:45.066260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 160/309] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:44 2022] GET /identity/v3/users/114f9b84a89341baa98001b5e0a7e8f3 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:45.067473 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3eb0ea-b430-4533-b364-b1bd637a21c5 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:45.069002 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3eb0ea-b430-4533-b364-b1bd637a21c5 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:45.069002 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3eb0ea-b430-4533-b364-b1bd637a21c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:45.086019 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-9e3eb0ea-b430-4533-b364-b1bd637a21c5 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:45.087245 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9e3eb0ea-b430-4533-b364-b1bd637a21c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:45.113541 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e156ae-f5d4-4c37-a40e-8551e6e8be1a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:45.147211 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689f9e5-b724-4d10-b592-bb8b04684ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:45.148098 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689f9e5-b724-4d10-b592-bb8b04684ce8 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:45.148387 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689f9e5-b724-4d10-b592-bb8b04684ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:45.148664 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689f9e5-b724-4d10-b592-bb8b04684ce8 None admin] PATH_INFO: `/v3/system/users/f02e7449a7f64cd4940193e93acd517e/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:45.150196 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689f9e5-b724-4d10-b592-bb8b04684ce8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f02e7449a7f64cd4940193e93acd517e, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:45.151571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689f9e5-b724-4d10-b592-bb8b04684ce8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:45.153736 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 161/310] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:45.154812 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3eb0ea-b430-4533-b364-b1bd637a21c5 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:45.170241 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 150/311] 10.222.0.67 () {58 vars in 1334 bytes} [Mon Apr 11 13:41:44 2022] PUT /identity/v3/system/users/f02e7449a7f64cd4940193e93acd517e/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:41:45.184810 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689f9e5-b724-4d10-b592-bb8b04684ce8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:45.281993 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3eb0ea-b430-4533-b364-b1bd637a21c5 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:45.324703 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a35eb-01a4-4863-bdbf-cf25b9cbe444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:45.325382 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a35eb-01a4-4863-bdbf-cf25b9cbe444 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:45.325662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a35eb-01a4-4863-bdbf-cf25b9cbe444 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:45.325943 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689f9e5-b724-4d10-b592-bb8b04684ce8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:45.326376 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a35eb-01a4-4863-bdbf-cf25b9cbe444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:45.327235 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a35eb-01a4-4863-bdbf-cf25b9cbe444 None admin] RBAC: Adding query filter params (role.id=d6ff23054a6c45d1b4e7e5da9305d7f3, user.id=114f9b84a89341baa98001b5e0a7e8f3, scope.system=all) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:45.327999 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a35eb-01a4-4863-bdbf-cf25b9cbe444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:45.330619 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a35eb-01a4-4863-bdbf-cf25b9cbe444 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:45.337950 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 162/312] 10.222.0.67 () {56 vars in 1308 bytes} [Mon Apr 11 13:41:45 2022] GET /identity/v3/role_assignments?user.id=114f9b84a89341baa98001b5e0a7e8f3&scope.system=all&role.id=d6ff23054a6c45d1b4e7e5da9305d7f3 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:45.374496 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719567e-0f7c-447e-96be-ac0bc992fdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:45.375670 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719567e-0f7c-447e-96be-ac0bc992fdc5 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:45.376041 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719567e-0f7c-447e-96be-ac0bc992fdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:45.376318 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719567e-0f7c-447e-96be-ac0bc992fdc5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:45.389410 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719567e-0f7c-447e-96be-ac0bc992fdc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:45.396593 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-3719567e-0f7c-447e-96be-ac0bc992fdc5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 13:41:45.398114 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 151/313] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:45.405307 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a35eb-01a4-4863-bdbf-cf25b9cbe444 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:45.519228 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a35eb-01a4-4863-bdbf-cf25b9cbe444 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:45.554763 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971d6ea-9780-4fec-a3b4-64452767f5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:45.555367 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971d6ea-9780-4fec-a3b4-64452767f5c5 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:45.555818 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971d6ea-9780-4fec-a3b4-64452767f5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:45.556093 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971d6ea-9780-4fec-a3b4-64452767f5c5 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:45.557029 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971d6ea-9780-4fec-a3b4-64452767f5c5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:45.557334 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971d6ea-9780-4fec-a3b4-64452767f5c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:45.558918 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971d6ea-9780-4fec-a3b4-64452767f5c5 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:45.567717 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 163/314] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:45.573239 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719567e-0f7c-447e-96be-ac0bc992fdc5 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:45.679087 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719567e-0f7c-447e-96be-ac0bc992fdc5 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:45.714671 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6b9ea-0e37-421d-8279-b87d64caa6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:45.715934 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6b9ea-0e37-421d-8279-b87d64caa6d9 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:45.716438 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6b9ea-0e37-421d-8279-b87d64caa6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:45.716918 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6b9ea-0e37-421d-8279-b87d64caa6d9 None admin] PATH_INFO: `/v3/users/0df420bdcfc14207b7b7846bd16d4868` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:45.718760 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6b9ea-0e37-421d-8279-b87d64caa6d9 None admin] RBAC: Authorizing `identity:get_user(user_id=0df420bdcfc14207b7b7846bd16d4868)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:45.720717 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6b9ea-0e37-421d-8279-b87d64caa6d9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:45.723430 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 152/315] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:45 2022] GET /identity/v3/users/0df420bdcfc14207b7b7846bd16d4868 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:45.729639 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971d6ea-9780-4fec-a3b4-64452767f5c5 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:45.842191 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971d6ea-9780-4fec-a3b4-64452767f5c5 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:45.881086 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b33a4-e973-4724-945d-600189cf9c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:45.882461 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b33a4-e973-4724-945d-600189cf9c24 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:45.882966 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b33a4-e973-4724-945d-600189cf9c24 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:45.883436 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b33a4-e973-4724-945d-600189cf9c24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:45.964613 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b33a4-e973-4724-945d-600189cf9c24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:45.967245 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b33a4-e973-4724-945d-600189cf9c24 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:46.090287 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 164/316] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 13:41:46.098246 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6b9ea-0e37-421d-8279-b87d64caa6d9 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:46.213409 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6b9ea-0e37-421d-8279-b87d64caa6d9 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:46.251528 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09594686-8736-41ac-a7e7-9148eb3dc3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:46.252762 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09594686-8736-41ac-a7e7-9148eb3dc3dd None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:46.253241 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09594686-8736-41ac-a7e7-9148eb3dc3dd None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:46.253730 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09594686-8736-41ac-a7e7-9148eb3dc3dd None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:46.255374 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09594686-8736-41ac-a7e7-9148eb3dc3dd None admin] RBAC: Authorizing `identity:get_project(project_id=63fb9340f10a4486a0c9270676f88f02)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:46.257764 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09594686-8736-41ac-a7e7-9148eb3dc3dd None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:46.260498 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 153/317] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:46 2022] GET /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:46.267101 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b33a4-e973-4724-945d-600189cf9c24 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:46.383322 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b33a4-e973-4724-945d-600189cf9c24 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:46.425878 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3d22f-cd14-4f92-a7e0-45d0ae7e52f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:46.426757 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3d22f-cd14-4f92-a7e0-45d0ae7e52f8 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:46.427041 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3d22f-cd14-4f92-a7e0-45d0ae7e52f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:46.427315 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3d22f-cd14-4f92-a7e0-45d0ae7e52f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:46.428181 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3d22f-cd14-4f92-a7e0-45d0ae7e52f8 None admin] RBAC: Adding query filter params (role.id=d6ff23054a6c45d1b4e7e5da9305d7f3, scope.project.id=63fb9340f10a4486a0c9270676f88f02, user.id=0df420bdcfc14207b7b7846bd16d4868) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:46.428497 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3d22f-cd14-4f92-a7e0-45d0ae7e52f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:46.429933 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3d22f-cd14-4f92-a7e0-45d0ae7e52f8 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:46.440170 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 165/318] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:41:46 2022] GET /identity/v3/role_assignments?user.id=0df420bdcfc14207b7b7846bd16d4868&scope.project.id=63fb9340f10a4486a0c9270676f88f02&role.id=d6ff23054a6c45d1b4e7e5da9305d7f3 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:47.251196 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e295a8-e55e-434a-b2fb-5afe64238a14 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:47.251726 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e295a8-e55e-434a-b2fb-5afe64238a14 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:47.251802 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e295a8-e55e-434a-b2fb-5afe64238a14 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:47.253269 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 154/319] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:47.259524 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fd15d-e29c-42ea-a059-fba9c42407eb None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:47.260054 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fd15d-e29c-42ea-a059-fba9c42407eb None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:47.260160 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fd15d-e29c-42ea-a059-fba9c42407eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:47.277467 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-fb3fd15d-e29c-42ea-a059-fba9c42407eb None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:47.278663 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-fb3fd15d-e29c-42ea-a059-fba9c42407eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:47.348613 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 166/320] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:47.373225 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e295a8-e55e-434a-b2fb-5afe64238a14 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:47.477748 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e295a8-e55e-434a-b2fb-5afe64238a14 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:47.510267 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e4641-98f0-4d30-b713-507132f283d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:47.510982 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e4641-98f0-4d30-b713-507132f283d4 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:47.511253 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e4641-98f0-4d30-b713-507132f283d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:47.511529 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e4641-98f0-4d30-b713-507132f283d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:47.512714 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e4641-98f0-4d30-b713-507132f283d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:47.514149 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e4641-98f0-4d30-b713-507132f283d4 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:47.515977 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 155/321] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:41:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:47.521438 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fd15d-e29c-42ea-a059-fba9c42407eb None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:47.616222 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fd15d-e29c-42ea-a059-fba9c42407eb None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:47.648305 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b89051-1914-4f0e-b242-7a572de90722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:47.648977 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b89051-1914-4f0e-b242-7a572de90722 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:47.649355 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b89051-1914-4f0e-b242-7a572de90722 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:47.649632 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b89051-1914-4f0e-b242-7a572de90722 None admin] PATH_INFO: `/v3/groups` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:47.650325 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b89051-1914-4f0e-b242-7a572de90722 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:47.651885 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b89051-1914-4f0e-b242-7a572de90722 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:47.653302 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddf6c9-01e1-40ff-8ea3-fcabb3c40eca None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:47.653595 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddf6c9-01e1-40ff-8ea3-fcabb3c40eca None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:47.653876 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddf6c9-01e1-40ff-8ea3-fcabb3c40eca None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:47.655225 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 156/322] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:41:47.660510 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe90151-23de-45ce-b9c6-f51c5faeb973 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:47.660844 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe90151-23de-45ce-b9c6-f51c5faeb973 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:47.661202 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe90151-23de-45ce-b9c6-f51c5faeb973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:47.674113 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 167/323] 10.222.0.67 () {60 vars in 1134 bytes} [Mon Apr 11 13:41:47 2022] POST /identity/v3/groups => generated 226 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:41:47.678697 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-cbe90151-23de-45ce-b9c6-f51c5faeb973 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:47.679940 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-cbe90151-23de-45ce-b9c6-f51c5faeb973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:47.695787 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143c7d0-dd15-4648-b00c-56390ea7305b None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:47.696271 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143c7d0-dd15-4648-b00c-56390ea7305b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:47.696515 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143c7d0-dd15-4648-b00c-56390ea7305b None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:47.698127 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 168/324] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:41:47.704273 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbcce9-2dba-4e97-842c-94d2b86f016a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:47.704575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbcce9-2dba-4e97-842c-94d2b86f016a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:47.704825 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbcce9-2dba-4e97-842c-94d2b86f016a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:47.722288 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-48cbcce9-2dba-4e97-842c-94d2b86f016a None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:47.723560 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-48cbcce9-2dba-4e97-842c-94d2b86f016a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:47.751712 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 157/325] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:47.777448 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe90151-23de-45ce-b9c6-f51c5faeb973 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:47.795159 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 169/326] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:41:47.818217 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbcce9-2dba-4e97-842c-94d2b86f016a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:47.878707 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe90151-23de-45ce-b9c6-f51c5faeb973 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:47.914181 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5477d4e-0b9c-4bca-be38-3ef75fbe2d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:47.915529 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5477d4e-0b9c-4bca-be38-3ef75fbe2d1b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:47.915841 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5477d4e-0b9c-4bca-be38-3ef75fbe2d1b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:47.916112 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5477d4e-0b9c-4bca-be38-3ef75fbe2d1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:47.926455 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5477d4e-0b9c-4bca-be38-3ef75fbe2d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:47.933571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-e5477d4e-0b9c-4bca-be38-3ef75fbe2d1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 13:41:47.935383 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 158/327] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:41:47.941188 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5477d4e-0b9c-4bca-be38-3ef75fbe2d1b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:47.949617 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbcce9-2dba-4e97-842c-94d2b86f016a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:47.991859 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d9230-dd42-404c-a524-757e603beecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:47.993701 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d9230-dd42-404c-a524-757e603beecc None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:47.994220 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d9230-dd42-404c-a524-757e603beecc None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:47.994674 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d9230-dd42-404c-a524-757e603beecc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:48.007611 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d9230-dd42-404c-a524-757e603beecc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:48.016142 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-da6d9230-dd42-404c-a524-757e603beecc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 13:41:48.022315 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 170/328] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:41:48.023931 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d9230-dd42-404c-a524-757e603beecc None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:48.043908 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5477d4e-0b9c-4bca-be38-3ef75fbe2d1b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:48.077821 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0553ad-3af6-4a01-bfe5-d6b654b7a46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:48.078506 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0553ad-3af6-4a01-bfe5-d6b654b7a46a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:48.078772 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0553ad-3af6-4a01-bfe5-d6b654b7a46a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:48.079044 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0553ad-3af6-4a01-bfe5-d6b654b7a46a None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:48.079929 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0553ad-3af6-4a01-bfe5-d6b654b7a46a None admin] RBAC: Adding query filter params (name=member) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:48.080236 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0553ad-3af6-4a01-bfe5-d6b654b7a46a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:48.081627 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0553ad-3af6-4a01-bfe5-d6b654b7a46a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:48.095241 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 159/329] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:48.096614 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0553ad-3af6-4a01-bfe5-d6b654b7a46a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:48.142589 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d9230-dd42-404c-a524-757e603beecc None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:48.177884 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c67528-f931-4c81-a4aa-20819a702844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:48.178559 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c67528-f931-4c81-a4aa-20819a702844 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:48.178847 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c67528-f931-4c81-a4aa-20819a702844 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:48.179124 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c67528-f931-4c81-a4aa-20819a702844 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:48.179903 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c67528-f931-4c81-a4aa-20819a702844 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:48.180726 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c67528-f931-4c81-a4aa-20819a702844 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:48.182130 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c67528-f931-4c81-a4aa-20819a702844 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:48.196925 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 171/330] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:48.207776 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0553ad-3af6-4a01-bfe5-d6b654b7a46a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:48.208691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c67528-f931-4c81-a4aa-20819a702844 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:48.243823 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542a817-bb4f-4703-8093-a2b2fb2954e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:48.244709 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542a817-bb4f-4703-8093-a2b2fb2954e0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:48.244992 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542a817-bb4f-4703-8093-a2b2fb2954e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:48.245263 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542a817-bb4f-4703-8093-a2b2fb2954e0 None admin] PATH_INFO: `/v3/users/f02e7449a7f64cd4940193e93acd517e` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:48.246478 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542a817-bb4f-4703-8093-a2b2fb2954e0 None admin] RBAC: Authorizing `identity:get_user(user_id=f02e7449a7f64cd4940193e93acd517e)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:48.247978 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542a817-bb4f-4703-8093-a2b2fb2954e0 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:48.249917 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 160/331] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:48 2022] GET /identity/v3/users/f02e7449a7f64cd4940193e93acd517e => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:48.255856 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542a817-bb4f-4703-8093-a2b2fb2954e0 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:48.318375 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c67528-f931-4c81-a4aa-20819a702844 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:48.351534 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938db623-8410-418f-b7fe-f45423547880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:48.352981 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938db623-8410-418f-b7fe-f45423547880 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:48.353261 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938db623-8410-418f-b7fe-f45423547880 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:48.353509 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938db623-8410-418f-b7fe-f45423547880 None admin] PATH_INFO: `/v3/users/114f9b84a89341baa98001b5e0a7e8f3` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:48.354722 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938db623-8410-418f-b7fe-f45423547880 None admin] RBAC: Authorizing `identity:get_user(user_id=114f9b84a89341baa98001b5e0a7e8f3)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:48.356282 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938db623-8410-418f-b7fe-f45423547880 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:48.358251 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 172/332] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:48 2022] GET /identity/v3/users/114f9b84a89341baa98001b5e0a7e8f3 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:48.358520 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542a817-bb4f-4703-8093-a2b2fb2954e0 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:48.369191 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938db623-8410-418f-b7fe-f45423547880 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:48.398983 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4621f5-27ee-4b37-b6f3-0c999c12dbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:48.400292 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4621f5-27ee-4b37-b6f3-0c999c12dbda None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:48.400763 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4621f5-27ee-4b37-b6f3-0c999c12dbda None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:48.401040 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4621f5-27ee-4b37-b6f3-0c999c12dbda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:48.402033 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4621f5-27ee-4b37-b6f3-0c999c12dbda None admin] RBAC: Adding query filter params (role.id=3daf622d91e64ce685da6f482aa181ea, user.id=f02e7449a7f64cd4940193e93acd517e, scope.system=all) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:48.402379 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4621f5-27ee-4b37-b6f3-0c999c12dbda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:48.403981 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4621f5-27ee-4b37-b6f3-0c999c12dbda None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:48.423658 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 161/333] 10.222.0.67 () {56 vars in 1308 bytes} [Mon Apr 11 13:41:48 2022] GET /identity/v3/role_assignments?user.id=f02e7449a7f64cd4940193e93acd517e&scope.system=all&role.id=3daf622d91e64ce685da6f482aa181ea => generated 510 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:48.504924 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938db623-8410-418f-b7fe-f45423547880 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:48.543454 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39655511-e858-45f9-afca-567a968c6d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:48.544370 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39655511-e858-45f9-afca-567a968c6d02 None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:48.544653 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39655511-e858-45f9-afca-567a968c6d02 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:48.544933 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39655511-e858-45f9-afca-567a968c6d02 None admin] PATH_INFO: `/v3/system/users/114f9b84a89341baa98001b5e0a7e8f3/roles/d6ff23054a6c45d1b4e7e5da9305d7f3` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:48.546439 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39655511-e858-45f9-afca-567a968c6d02 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=114f9b84a89341baa98001b5e0a7e8f3, role_id=d6ff23054a6c45d1b4e7e5da9305d7f3)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:48.547849 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39655511-e858-45f9-afca-567a968c6d02 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:48.559767 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 173/334] 10.222.0.67 () {58 vars in 1334 bytes} [Mon Apr 11 13:41:48 2022] PUT /identity/v3/system/users/114f9b84a89341baa98001b5e0a7e8f3/roles/d6ff23054a6c45d1b4e7e5da9305d7f3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:41:50.882299 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc05b1-3707-45bc-8507-7a9b2b933969 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:50.882781 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc05b1-3707-45bc-8507-7a9b2b933969 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:50.882875 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc05b1-3707-45bc-8507-7a9b2b933969 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:50.884633 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 162/335] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:50.890192 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763a72b-fc3c-48b1-8783-1c78cbea5046 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:50.890603 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763a72b-fc3c-48b1-8783-1c78cbea5046 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:50.890784 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763a72b-fc3c-48b1-8783-1c78cbea5046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:50.912685 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e763a72b-fc3c-48b1-8783-1c78cbea5046 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:50.913894 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e763a72b-fc3c-48b1-8783-1c78cbea5046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:51.002290 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 174/336] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:51.050072 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53275225-2cf8-4826-83cd-8f841a39c182 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:51.050389 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53275225-2cf8-4826-83cd-8f841a39c182 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:51.050678 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53275225-2cf8-4826-83cd-8f841a39c182 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:51.052310 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 163/337] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:51.054915 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763a72b-fc3c-48b1-8783-1c78cbea5046 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:51.058227 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46a51b-20c9-4771-80b3-0173d0d4a3d0 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:51.058732 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46a51b-20c9-4771-80b3-0173d0d4a3d0 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:51.059185 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46a51b-20c9-4771-80b3-0173d0d4a3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:51.083230 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-2a46a51b-20c9-4771-80b3-0173d0d4a3d0 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:51.084465 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2a46a51b-20c9-4771-80b3-0173d0d4a3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:51.175725 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763a72b-fc3c-48b1-8783-1c78cbea5046 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:51.225992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e64e86-ad87-4cd2-ae3e-35e7ded44d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:51.227909 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e64e86-ad87-4cd2-ae3e-35e7ded44d43 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:51.228382 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e64e86-ad87-4cd2-ae3e-35e7ded44d43 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:51.228860 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e64e86-ad87-4cd2-ae3e-35e7ded44d43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:51.246209 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e64e86-ad87-4cd2-ae3e-35e7ded44d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:51.259667 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-71e64e86-ad87-4cd2-ae3e-35e7ded44d43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 13:41:51.261839 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 175/338] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:51.267971 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e64e86-ad87-4cd2-ae3e-35e7ded44d43 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:51.313014 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 164/339] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:51.332808 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78a8b3-af39-4b56-bbe5-4719a1c1c7b0 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:51.333117 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78a8b3-af39-4b56-bbe5-4719a1c1c7b0 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:51.333420 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78a8b3-af39-4b56-bbe5-4719a1c1c7b0 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:51.334706 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 165/340] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:41:51.341046 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab457d-42d7-4e14-988f-8b2b1bd9183a None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:51.341322 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab457d-42d7-4e14-988f-8b2b1bd9183a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:51.341597 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab457d-42d7-4e14-988f-8b2b1bd9183a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:51.365016 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-eeab457d-42d7-4e14-988f-8b2b1bd9183a None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:51.366226 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-eeab457d-42d7-4e14-988f-8b2b1bd9183a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:51.443343 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e64e86-ad87-4cd2-ae3e-35e7ded44d43 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:51.458324 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 166/341] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:41:51.459311 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab457d-42d7-4e14-988f-8b2b1bd9183a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:51.564378 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ba375-3cfc-43ac-a616-320d5571720d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:51.565442 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ba375-3cfc-43ac-a616-320d5571720d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:51.565942 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ba375-3cfc-43ac-a616-320d5571720d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:51.566425 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ba375-3cfc-43ac-a616-320d5571720d None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:51.567381 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ba375-3cfc-43ac-a616-320d5571720d None admin] RBAC: Adding query filter params (name=member) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:51.567904 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ba375-3cfc-43ac-a616-320d5571720d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:51.569487 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ba375-3cfc-43ac-a616-320d5571720d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:51.596261 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 176/342] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:51.597523 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ba375-3cfc-43ac-a616-320d5571720d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:51.603761 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab457d-42d7-4e14-988f-8b2b1bd9183a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:51.649697 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af8770-fe32-4c81-972c-8f94f3d20e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:51.650430 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af8770-fe32-4c81-972c-8f94f3d20e74 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:51.650714 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af8770-fe32-4c81-972c-8f94f3d20e74 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:51.650980 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af8770-fe32-4c81-972c-8f94f3d20e74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:51.662727 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af8770-fe32-4c81-972c-8f94f3d20e74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:51.675969 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-24af8770-fe32-4c81-972c-8f94f3d20e74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 13:41:51.675969 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 167/343] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:41:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:51.676595 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af8770-fe32-4c81-972c-8f94f3d20e74 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:51.764068 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ba375-3cfc-43ac-a616-320d5571720d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:51.785425 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af8770-fe32-4c81-972c-8f94f3d20e74 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:51.820913 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd91462-b61d-4193-a7ce-f47c08416501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:51.821595 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd91462-b61d-4193-a7ce-f47c08416501 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:51.821875 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd91462-b61d-4193-a7ce-f47c08416501 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:51.822150 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd91462-b61d-4193-a7ce-f47c08416501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:51.844346 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885ea47-34fb-42d4-b85e-6147edc10a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:51.845526 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885ea47-34fb-42d4-b85e-6147edc10a1d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:51.846027 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885ea47-34fb-42d4-b85e-6147edc10a1d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:51.846506 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885ea47-34fb-42d4-b85e-6147edc10a1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:51.871276 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885ea47-34fb-42d4-b85e-6147edc10a1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:51.886982 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-3885ea47-34fb-42d4-b85e-6147edc10a1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 13:41:51.893096 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 177/344] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:51.894596 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885ea47-34fb-42d4-b85e-6147edc10a1d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:51.894975 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd91462-b61d-4193-a7ce-f47c08416501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:51.896649 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd91462-b61d-4193-a7ce-f47c08416501 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:52.016323 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 168/345] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:41:52.017483 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd91462-b61d-4193-a7ce-f47c08416501 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:52.121733 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885ea47-34fb-42d4-b85e-6147edc10a1d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:52.127364 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd91462-b61d-4193-a7ce-f47c08416501 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:52.162921 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d47ca-5ade-4db8-9efc-3903e39715de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:52.163996 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d47ca-5ade-4db8-9efc-3903e39715de None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:52.165031 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d47ca-5ade-4db8-9efc-3903e39715de None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:52.165517 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d47ca-5ade-4db8-9efc-3903e39715de None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:52.166534 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d47ca-5ade-4db8-9efc-3903e39715de None admin] RBAC: Adding query filter params (name=member) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:52.167037 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d47ca-5ade-4db8-9efc-3903e39715de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:52.168656 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d47ca-5ade-4db8-9efc-3903e39715de None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:52.178607 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 169/346] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:52.180009 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d47ca-5ade-4db8-9efc-3903e39715de None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:52.230194 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d41a0-b02e-4ef7-af25-0b442c347e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:52.230949 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d41a0-b02e-4ef7-af25-0b442c347e06 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:52.231238 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d41a0-b02e-4ef7-af25-0b442c347e06 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:52.231516 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d41a0-b02e-4ef7-af25-0b442c347e06 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:52.232314 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d41a0-b02e-4ef7-af25-0b442c347e06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:52.232784 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d41a0-b02e-4ef7-af25-0b442c347e06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:52.234418 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d41a0-b02e-4ef7-af25-0b442c347e06 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:52.248117 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 178/347] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:41:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:52.249226 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d41a0-b02e-4ef7-af25-0b442c347e06 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:52.295852 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d47ca-5ade-4db8-9efc-3903e39715de None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:52.330109 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e603a2e-31b5-4292-84f0-8cc18f953e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:52.331122 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e603a2e-31b5-4292-84f0-8cc18f953e6a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:52.331499 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e603a2e-31b5-4292-84f0-8cc18f953e6a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:52.331895 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e603a2e-31b5-4292-84f0-8cc18f953e6a None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:52.333166 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e603a2e-31b5-4292-84f0-8cc18f953e6a None admin] RBAC: Authorizing `identity:get_project(project_id=029a84f386ce4e48b750a76626f65b2d)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:52.334754 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e603a2e-31b5-4292-84f0-8cc18f953e6a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:52.337536 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 170/348] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:52 2022] GET /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:52.338535 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e603a2e-31b5-4292-84f0-8cc18f953e6a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:52.383475 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d41a0-b02e-4ef7-af25-0b442c347e06 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:52.419038 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7a24b-c21a-4ecd-ba9c-6dc4a6fdcfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:52.420161 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7a24b-c21a-4ecd-ba9c-6dc4a6fdcfd2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:52.420830 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7a24b-c21a-4ecd-ba9c-6dc4a6fdcfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:52.421468 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7a24b-c21a-4ecd-ba9c-6dc4a6fdcfd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:52.451917 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e603a2e-31b5-4292-84f0-8cc18f953e6a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:52.488984 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ebf9d-199f-4444-8bf0-874ee005b399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:52.490134 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ebf9d-199f-4444-8bf0-874ee005b399 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:52.490570 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ebf9d-199f-4444-8bf0-874ee005b399 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:52.491605 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ebf9d-199f-4444-8bf0-874ee005b399 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:52.495623 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7a24b-c21a-4ecd-ba9c-6dc4a6fdcfd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:52.498520 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7a24b-c21a-4ecd-ba9c-6dc4a6fdcfd2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:52.583423 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ebf9d-199f-4444-8bf0-874ee005b399 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:52.585740 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ebf9d-199f-4444-8bf0-874ee005b399 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:52.626476 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 179/349] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:41:52.632271 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6b75a-98b9-48f1-8f2b-90618afbc372 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:52.632832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6b75a-98b9-48f1-8f2b-90618afbc372 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:52.633401 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6b75a-98b9-48f1-8f2b-90618afbc372 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:52.635439 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 180/350] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:52.639652 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6b75a-98b9-48f1-8f2b-90618afbc372 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:52.710457 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 171/351] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:41:52.712582 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1308e-17a9-43ab-9020-3146d8bddfe4 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:52.712582 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1308e-17a9-43ab-9020-3146d8bddfe4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:52.712582 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1308e-17a9-43ab-9020-3146d8bddfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:52.732821 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-94f1308e-17a9-43ab-9020-3146d8bddfe4 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:52.734013 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-94f1308e-17a9-43ab-9020-3146d8bddfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:52.758647 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f6b75a-98b9-48f1-8f2b-90618afbc372 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:52.803689 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c6cb3-3e15-485f-ba0c-bcd4db76f4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:52.804595 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c6cb3-3e15-485f-ba0c-bcd4db76f4e2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:52.804920 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c6cb3-3e15-485f-ba0c-bcd4db76f4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:52.805324 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c6cb3-3e15-485f-ba0c-bcd4db76f4e2 None admin] PATH_INFO: `/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:52.812046 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c6cb3-3e15-485f-ba0c-bcd4db76f4e2 None admin] RBAC: Authorizing `identity:get_group(group_id=a7c69ded5bbe411485cb6dcc8d215f5e)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:52.813499 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c6cb3-3e15-485f-ba0c-bcd4db76f4e2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:52.815515 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 181/352] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Apr 11 13:41:52 2022] GET /identity/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:52.816427 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c6cb3-3e15-485f-ba0c-bcd4db76f4e2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:52.824480 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 172/353] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:52.826387 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b77e77-26ad-4caf-8c58-238c434d4d39 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:52.826890 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b77e77-26ad-4caf-8c58-238c434d4d39 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:52.827313 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b77e77-26ad-4caf-8c58-238c434d4d39 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:52.828800 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 173/354] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:52.829661 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b77e77-26ad-4caf-8c58-238c434d4d39 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:52.951494 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c6cb3-3e15-485f-ba0c-bcd4db76f4e2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:52.955175 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b77e77-26ad-4caf-8c58-238c434d4d39 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:52.990941 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105247c3-a0ff-4056-ab21-c7bd6d58bad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:52.991410 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ed819-0970-4792-b317-52a30e4bbc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:52.991858 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105247c3-a0ff-4056-ab21-c7bd6d58bad8 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:52.992147 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105247c3-a0ff-4056-ab21-c7bd6d58bad8 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:52.992382 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ed819-0970-4792-b317-52a30e4bbc2a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:52.992487 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105247c3-a0ff-4056-ab21-c7bd6d58bad8 None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:52.992679 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ed819-0970-4792-b317-52a30e4bbc2a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:52.993939 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ed819-0970-4792-b317-52a30e4bbc2a None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:52.994289 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ed819-0970-4792-b317-52a30e4bbc2a None admin] RBAC: Authorizing `identity:get_project(project_id=029a84f386ce4e48b750a76626f65b2d)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:52.994652 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105247c3-a0ff-4056-ab21-c7bd6d58bad8 None admin] RBAC: Authorizing `identity:get_project(project_id=63fb9340f10a4486a0c9270676f88f02)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:52.996493 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ed819-0970-4792-b317-52a30e4bbc2a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:52.996617 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105247c3-a0ff-4056-ab21-c7bd6d58bad8 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:52.997986 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 174/355] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:52 2022] GET /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:52.998093 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 182/356] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:52 2022] GET /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:52.999377 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ed819-0970-4792-b317-52a30e4bbc2a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:52.999502 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1bad4-26b3-43a9-8afc-dc42f3465c49 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:52.999502 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1bad4-26b3-43a9-8afc-dc42f3465c49 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:52.999719 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1bad4-26b3-43a9-8afc-dc42f3465c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:53.017852 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-43b1bad4-26b3-43a9-8afc-dc42f3465c49 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:53.019254 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-43b1bad4-26b3-43a9-8afc-dc42f3465c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:53.099737 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 183/357] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:53.100582 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1bad4-26b3-43a9-8afc-dc42f3465c49 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:53.105256 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ed819-0970-4792-b317-52a30e4bbc2a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:53.142166 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d61881-b1d8-4407-8519-284f55f95c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:53.142821 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d61881-b1d8-4407-8519-284f55f95c68 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:53.143103 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d61881-b1d8-4407-8519-284f55f95c68 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:53.143378 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d61881-b1d8-4407-8519-284f55f95c68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:53.144242 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d61881-b1d8-4407-8519-284f55f95c68 None admin] RBAC: Adding query filter params (group.id=a7c69ded5bbe411485cb6dcc8d215f5e, role.id=3daf622d91e64ce685da6f482aa181ea, scope.project.id=029a84f386ce4e48b750a76626f65b2d) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:53.144550 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d61881-b1d8-4407-8519-284f55f95c68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:53.145990 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d61881-b1d8-4407-8519-284f55f95c68 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:53.152960 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 175/358] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Apr 11 13:41:52 2022] GET /identity/v3/role_assignments?group.id=a7c69ded5bbe411485cb6dcc8d215f5e&scope.project.id=029a84f386ce4e48b750a76626f65b2d&role.id=3daf622d91e64ce685da6f482aa181ea => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:53.154055 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aeb869-f065-443d-83b5-743a37ae5b20 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:53.154341 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aeb869-f065-443d-83b5-743a37ae5b20 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:53.154610 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aeb869-f065-443d-83b5-743a37ae5b20 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:53.155891 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 176/359] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:53.156618 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aeb869-f065-443d-83b5-743a37ae5b20 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:53.236708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1bad4-26b3-43a9-8afc-dc42f3465c49 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:53.282633 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344354b9-868a-4bf1-9b1d-ce953e999a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:53.283454 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344354b9-868a-4bf1-9b1d-ce953e999a9a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:53.283767 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344354b9-868a-4bf1-9b1d-ce953e999a9a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:53.284045 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344354b9-868a-4bf1-9b1d-ce953e999a9a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:53.299133 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344354b9-868a-4bf1-9b1d-ce953e999a9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:53.306207 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aeb869-f065-443d-83b5-743a37ae5b20 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:53.307984 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-344354b9-868a-4bf1-9b1d-ce953e999a9a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 13:41:53.310008 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 184/360] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:53.310192 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344354b9-868a-4bf1-9b1d-ce953e999a9a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:53.343948 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd60ec9-88a0-4275-93cd-43855972cfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:53.344960 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd60ec9-88a0-4275-93cd-43855972cfbb None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:53.345306 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd60ec9-88a0-4275-93cd-43855972cfbb None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:53.345660 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd60ec9-88a0-4275-93cd-43855972cfbb None admin] PATH_INFO: `/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:53.346980 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd60ec9-88a0-4275-93cd-43855972cfbb None admin] RBAC: Authorizing `identity:get_group(group_id=a7c69ded5bbe411485cb6dcc8d215f5e)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:53.348537 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd60ec9-88a0-4275-93cd-43855972cfbb None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:53.350550 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 177/361] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Apr 11 13:41:53 2022] GET /identity/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:53.351391 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd60ec9-88a0-4275-93cd-43855972cfbb None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:53.440560 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344354b9-868a-4bf1-9b1d-ce953e999a9a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:53.476113 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd60ec9-88a0-4275-93cd-43855972cfbb None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:53.485312 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719161ba-1ec0-4a44-b1a6-c841dae8dc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:53.485922 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719161ba-1ec0-4a44-b1a6-c841dae8dc42 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:53.486213 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719161ba-1ec0-4a44-b1a6-c841dae8dc42 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:53.486491 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719161ba-1ec0-4a44-b1a6-c841dae8dc42 None admin] PATH_INFO: `/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:53.488409 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719161ba-1ec0-4a44-b1a6-c841dae8dc42 None admin] RBAC: Authorizing `identity:get_group(group_id=a7c69ded5bbe411485cb6dcc8d215f5e)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:53.490103 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719161ba-1ec0-4a44-b1a6-c841dae8dc42 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:53.492344 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 185/362] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Apr 11 13:41:53 2022] GET /identity/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:53.494214 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d702dc2-9e0f-4b3d-bb21-2e830de0a310 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:53.494499 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d702dc2-9e0f-4b3d-bb21-2e830de0a310 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:53.494775 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d702dc2-9e0f-4b3d-bb21-2e830de0a310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:53.518092 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-5d702dc2-9e0f-4b3d-bb21-2e830de0a310 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:53.519283 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5d702dc2-9e0f-4b3d-bb21-2e830de0a310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:53.524382 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014187a8-0be0-4557-8600-789385bd86dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:53.525616 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014187a8-0be0-4557-8600-789385bd86dc None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:53.525908 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014187a8-0be0-4557-8600-789385bd86dc None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:53.526185 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014187a8-0be0-4557-8600-789385bd86dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:53.542303 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014187a8-0be0-4557-8600-789385bd86dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:53.549959 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-014187a8-0be0-4557-8600-789385bd86dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 13:41:53.551204 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 178/363] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:41:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:53.556637 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014187a8-0be0-4557-8600-789385bd86dc None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:53.603498 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 186/364] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:53.604867 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d702dc2-9e0f-4b3d-bb21-2e830de0a310 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:53.691878 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014187a8-0be0-4557-8600-789385bd86dc None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:53.723203 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d702dc2-9e0f-4b3d-bb21-2e830de0a310 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:53.729330 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9f0df-022b-46f1-9498-a88c7f6369d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:53.730008 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9f0df-022b-46f1-9498-a88c7f6369d5 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:53.730292 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9f0df-022b-46f1-9498-a88c7f6369d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:53.730568 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9f0df-022b-46f1-9498-a88c7f6369d5 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:53.731323 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9f0df-022b-46f1-9498-a88c7f6369d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:53.731710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9f0df-022b-46f1-9498-a88c7f6369d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:53.733945 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9f0df-022b-46f1-9498-a88c7f6369d5 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:53.744016 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 179/365] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:53.744792 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9f0df-022b-46f1-9498-a88c7f6369d5 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:53.766307 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e9dac-ab40-4764-b62a-d90869c85984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:53.767316 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e9dac-ab40-4764-b62a-d90869c85984 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:53.767862 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e9dac-ab40-4764-b62a-d90869c85984 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:53.768356 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e9dac-ab40-4764-b62a-d90869c85984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:53.769200 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e9dac-ab40-4764-b62a-d90869c85984 None admin] RBAC: Adding query filter params (group.id=a7c69ded5bbe411485cb6dcc8d215f5e, role.id=fbb7398610b649859d123d0938aa8e75, scope.project.id=029a84f386ce4e48b750a76626f65b2d) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:53.769521 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e9dac-ab40-4764-b62a-d90869c85984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:53.770961 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e9dac-ab40-4764-b62a-d90869c85984 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:53.776804 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 187/366] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Apr 11 13:41:53 2022] GET /identity/v3/role_assignments?group.id=a7c69ded5bbe411485cb6dcc8d215f5e&scope.project.id=029a84f386ce4e48b750a76626f65b2d&role.id=fbb7398610b649859d123d0938aa8e75 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:53.777830 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e9dac-ab40-4764-b62a-d90869c85984 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:53.861628 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9f0df-022b-46f1-9498-a88c7f6369d5 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:53.902092 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4f471-4f22-473f-96cb-607448a24ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:53.902878 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4f471-4f22-473f-96cb-607448a24ce0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:53.903234 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4f471-4f22-473f-96cb-607448a24ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:53.903511 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4f471-4f22-473f-96cb-607448a24ce0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:53.904418 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4f471-4f22-473f-96cb-607448a24ce0 None admin] RBAC: Adding query filter params (group.id=a7c69ded5bbe411485cb6dcc8d215f5e, role.id=3daf622d91e64ce685da6f482aa181ea, scope.project.id=63fb9340f10a4486a0c9270676f88f02) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:53.904732 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4f471-4f22-473f-96cb-607448a24ce0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:53.906190 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4f471-4f22-473f-96cb-607448a24ce0 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:53.913177 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 180/367] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Apr 11 13:41:53 2022] GET /identity/v3/role_assignments?group.id=a7c69ded5bbe411485cb6dcc8d215f5e&scope.project.id=63fb9340f10a4486a0c9270676f88f02&role.id=3daf622d91e64ce685da6f482aa181ea => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:53.913905 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4f471-4f22-473f-96cb-607448a24ce0 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:53.920704 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e9dac-ab40-4764-b62a-d90869c85984 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:53.966359 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecfcf3-a3aa-43c5-bbd2-41c015c75dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:53.967086 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecfcf3-a3aa-43c5-bbd2-41c015c75dfb None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:53.967334 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecfcf3-a3aa-43c5-bbd2-41c015c75dfb None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:53.967614 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecfcf3-a3aa-43c5-bbd2-41c015c75dfb None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:53.968676 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecfcf3-a3aa-43c5-bbd2-41c015c75dfb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:53.968991 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecfcf3-a3aa-43c5-bbd2-41c015c75dfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:53.971380 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecfcf3-a3aa-43c5-bbd2-41c015c75dfb None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:53.987908 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 188/368] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:41:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:53.987908 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecfcf3-a3aa-43c5-bbd2-41c015c75dfb None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:54.033602 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4f471-4f22-473f-96cb-607448a24ce0 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:54.072284 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6781a-ec44-47d7-ad2e-5ae0b56d5040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:54.073448 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6781a-ec44-47d7-ad2e-5ae0b56d5040 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:54.073928 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6781a-ec44-47d7-ad2e-5ae0b56d5040 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:54.074377 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6781a-ec44-47d7-ad2e-5ae0b56d5040 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:54.086753 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec6781a-ec44-47d7-ad2e-5ae0b56d5040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:54.095467 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-6ec6781a-ec44-47d7-ad2e-5ae0b56d5040 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:41:54.097089 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 181/369] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:41:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:54.098245 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6781a-ec44-47d7-ad2e-5ae0b56d5040 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:54.098638 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecfcf3-a3aa-43c5-bbd2-41c015c75dfb None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:54.141204 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7e06e-aa4e-4cfc-a45d-7483065f07c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:54.142124 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7e06e-aa4e-4cfc-a45d-7483065f07c0 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:54.142410 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7e06e-aa4e-4cfc-a45d-7483065f07c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:54.142688 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7e06e-aa4e-4cfc-a45d-7483065f07c0 None admin] PATH_INFO: `/v3/users/114f9b84a89341baa98001b5e0a7e8f3` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:54.144075 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7e06e-aa4e-4cfc-a45d-7483065f07c0 None admin] RBAC: Authorizing `identity:get_user(user_id=114f9b84a89341baa98001b5e0a7e8f3)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:54.145556 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7e06e-aa4e-4cfc-a45d-7483065f07c0 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:54.147386 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 189/370] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:41:53 2022] GET /identity/v3/users/114f9b84a89341baa98001b5e0a7e8f3 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:54.148256 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7e06e-aa4e-4cfc-a45d-7483065f07c0 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:54.210032 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6781a-ec44-47d7-ad2e-5ae0b56d5040 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:54.248391 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d0911-db8b-4b73-bb3f-1f5d7c81f920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:54.249874 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d0911-db8b-4b73-bb3f-1f5d7c81f920 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:54.250361 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d0911-db8b-4b73-bb3f-1f5d7c81f920 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:54.250862 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d0911-db8b-4b73-bb3f-1f5d7c81f920 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:54.262533 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7e06e-aa4e-4cfc-a45d-7483065f07c0 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:54.299370 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e82ff-7aac-496d-9aec-4578d0d8de60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:54.300017 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e82ff-7aac-496d-9aec-4578d0d8de60 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:54.300302 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e82ff-7aac-496d-9aec-4578d0d8de60 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:54.300583 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e82ff-7aac-496d-9aec-4578d0d8de60 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:54.301455 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e82ff-7aac-496d-9aec-4578d0d8de60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:54.301630 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e82ff-7aac-496d-9aec-4578d0d8de60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:54.303005 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e82ff-7aac-496d-9aec-4578d0d8de60 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:54.312348 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 190/371] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:54.313268 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e82ff-7aac-496d-9aec-4578d0d8de60 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:54.336860 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d0911-db8b-4b73-bb3f-1f5d7c81f920 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:54.338967 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d0911-db8b-4b73-bb3f-1f5d7c81f920 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:54.477783 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 182/372] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:41:54.479089 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d0911-db8b-4b73-bb3f-1f5d7c81f920 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:54.498609 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e82ff-7aac-496d-9aec-4578d0d8de60 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:54.572628 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858525c-ce12-4c7b-b473-1bb7b3967575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:54.573231 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858525c-ce12-4c7b-b473-1bb7b3967575 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:54.573520 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858525c-ce12-4c7b-b473-1bb7b3967575 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:54.573802 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858525c-ce12-4c7b-b473-1bb7b3967575 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:54.574651 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858525c-ce12-4c7b-b473-1bb7b3967575 None admin] RBAC: Adding query filter params (role.id=d6ff23054a6c45d1b4e7e5da9305d7f3, user.id=114f9b84a89341baa98001b5e0a7e8f3, scope.system=all) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:54.575010 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858525c-ce12-4c7b-b473-1bb7b3967575 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:54.576694 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858525c-ce12-4c7b-b473-1bb7b3967575 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:54.592189 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d0911-db8b-4b73-bb3f-1f5d7c81f920 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:54.607225 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 191/373] 10.222.0.67 () {56 vars in 1308 bytes} [Mon Apr 11 13:41:54 2022] GET /identity/v3/role_assignments?user.id=114f9b84a89341baa98001b5e0a7e8f3&scope.system=all&role.id=d6ff23054a6c45d1b4e7e5da9305d7f3 => generated 510 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:54.608113 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858525c-ce12-4c7b-b473-1bb7b3967575 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:54.638044 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa18fa-0dea-4310-82e3-a89f4676c8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:54.639084 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa18fa-0dea-4310-82e3-a89f4676c8f3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:54.640074 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa18fa-0dea-4310-82e3-a89f4676c8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:54.640366 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa18fa-0dea-4310-82e3-a89f4676c8f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:54.743876 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858525c-ce12-4c7b-b473-1bb7b3967575 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:54.790435 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cf812-18cd-42bc-bf40-10130a017dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:54.791883 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cf812-18cd-42bc-bf40-10130a017dc3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:54.792503 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cf812-18cd-42bc-bf40-10130a017dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:54.793257 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cf812-18cd-42bc-bf40-10130a017dc3 None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:54.796921 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74cf812-18cd-42bc-bf40-10130a017dc3 None admin] RBAC: Authorizing `identity:get_project(project_id=63fb9340f10a4486a0c9270676f88f02)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:54.799098 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74cf812-18cd-42bc-bf40-10130a017dc3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:54.801318 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 192/374] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:54 2022] GET /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:54.808053 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cf812-18cd-42bc-bf40-10130a017dc3 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:54.810881 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa18fa-0dea-4310-82e3-a89f4676c8f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:54.812543 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa18fa-0dea-4310-82e3-a89f4676c8f3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:54.928840 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 183/375] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:41:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:41:54.934857 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa18fa-0dea-4310-82e3-a89f4676c8f3 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:55.057812 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cf812-18cd-42bc-bf40-10130a017dc3 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:55.064261 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa18fa-0dea-4310-82e3-a89f4676c8f3 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:55.103056 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ec997-775c-4711-9968-f42b53b2e95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:55.104422 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ec997-775c-4711-9968-f42b53b2e95f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:55.104707 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ec997-775c-4711-9968-f42b53b2e95f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:55.104982 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ec997-775c-4711-9968-f42b53b2e95f None admin] PATH_INFO: `/v3/projects/8ea005f626c8456495dc1d10183dc603` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:55.106249 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ec997-775c-4711-9968-f42b53b2e95f None admin] RBAC: Authorizing `identity:get_project(project_id=8ea005f626c8456495dc1d10183dc603)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:55.108042 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ec997-775c-4711-9968-f42b53b2e95f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:55.110230 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 184/376] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:54 2022] GET /identity/v3/projects/8ea005f626c8456495dc1d10183dc603 => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:55.120247 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ec997-775c-4711-9968-f42b53b2e95f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:55.135794 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a89ae-0f09-4df2-8c7a-6b07077587e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:55.136702 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a89ae-0f09-4df2-8c7a-6b07077587e7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:55.136956 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a89ae-0f09-4df2-8c7a-6b07077587e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:55.137240 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a89ae-0f09-4df2-8c7a-6b07077587e7 None admin] PATH_INFO: `/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:55.144368 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a89ae-0f09-4df2-8c7a-6b07077587e7 None admin] RBAC: Authorizing `identity:get_group(group_id=a7c69ded5bbe411485cb6dcc8d215f5e)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:55.145843 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a89ae-0f09-4df2-8c7a-6b07077587e7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:55.147844 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 193/377] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Apr 11 13:41:54 2022] GET /identity/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e => generated 226 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:55.167529 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a89ae-0f09-4df2-8c7a-6b07077587e7 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:55.271030 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ec997-775c-4711-9968-f42b53b2e95f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:55.326541 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76832b4-de3f-48cf-9264-0f7893affead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:55.327415 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76832b4-de3f-48cf-9264-0f7893affead None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:55.327720 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76832b4-de3f-48cf-9264-0f7893affead None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:55.327998 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76832b4-de3f-48cf-9264-0f7893affead None admin] PATH_INFO: `/v3/groups/2e8e301ce2974644a5c4cc856be0712a` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:55.334321 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76832b4-de3f-48cf-9264-0f7893affead None admin] RBAC: Authorizing `identity:get_group(group_id=2e8e301ce2974644a5c4cc856be0712a)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:55.336843 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76832b4-de3f-48cf-9264-0f7893affead None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:55.338926 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 185/378] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Apr 11 13:41:55 2022] GET /identity/v3/groups/2e8e301ce2974644a5c4cc856be0712a => generated 229 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:55.344588 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76832b4-de3f-48cf-9264-0f7893affead None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:55.374511 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a89ae-0f09-4df2-8c7a-6b07077587e7 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:55.461443 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589529a-fcd9-4cc9-b588-c0e0c69f069d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:55.462102 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589529a-fcd9-4cc9-b588-c0e0c69f069d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:55.462430 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589529a-fcd9-4cc9-b588-c0e0c69f069d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:55.462718 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589529a-fcd9-4cc9-b588-c0e0c69f069d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:55.463552 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589529a-fcd9-4cc9-b588-c0e0c69f069d None admin] RBAC: Adding query filter params (group.id=a7c69ded5bbe411485cb6dcc8d215f5e, role.id=fbb7398610b649859d123d0938aa8e75, scope.project.id=63fb9340f10a4486a0c9270676f88f02) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:55.463880 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589529a-fcd9-4cc9-b588-c0e0c69f069d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:55.465324 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589529a-fcd9-4cc9-b588-c0e0c69f069d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:55.476300 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76832b4-de3f-48cf-9264-0f7893affead None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:55.476494 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 194/379] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Apr 11 13:41:55 2022] GET /identity/v3/role_assignments?group.id=a7c69ded5bbe411485cb6dcc8d215f5e&scope.project.id=63fb9340f10a4486a0c9270676f88f02&role.id=fbb7398610b649859d123d0938aa8e75 => generated 260 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:55.523131 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db9b3b-c927-405c-8f19-fdb9d3a4c105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:55.523798 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db9b3b-c927-405c-8f19-fdb9d3a4c105 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:55.524092 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db9b3b-c927-405c-8f19-fdb9d3a4c105 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:55.524369 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db9b3b-c927-405c-8f19-fdb9d3a4c105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:55.525351 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db9b3b-c927-405c-8f19-fdb9d3a4c105 None admin] RBAC: Adding query filter params (group.id=2e8e301ce2974644a5c4cc856be0712a, role.id=e3333fcf22b040e3a1f0bfbfe657cffa, scope.project.id=8ea005f626c8456495dc1d10183dc603) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:55.525666 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db9b3b-c927-405c-8f19-fdb9d3a4c105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:55.527168 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db9b3b-c927-405c-8f19-fdb9d3a4c105 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:55.533818 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 186/380] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Apr 11 13:41:55 2022] GET /identity/v3/role_assignments?group.id=2e8e301ce2974644a5c4cc856be0712a&scope.project.id=8ea005f626c8456495dc1d10183dc603&role.id=e3333fcf22b040e3a1f0bfbfe657cffa => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:55.901531 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09780205-c2f8-441f-b9c8-0e736ef299ac None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:55.901893 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09780205-c2f8-441f-b9c8-0e736ef299ac None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:55.902096 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09780205-c2f8-441f-b9c8-0e736ef299ac None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:55.903726 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 195/381] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:55.909120 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a6409-b3a5-40f8-a0df-5d486750a41d None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:55.909412 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a6409-b3a5-40f8-a0df-5d486750a41d None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:55.909693 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a6409-b3a5-40f8-a0df-5d486750a41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:55.927211 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-383a6409-b3a5-40f8-a0df-5d486750a41d None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:55.928439 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-383a6409-b3a5-40f8-a0df-5d486750a41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:55.996962 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 187/382] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:56.019649 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09780205-c2f8-441f-b9c8-0e736ef299ac None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:56.122585 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09780205-c2f8-441f-b9c8-0e736ef299ac None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:56.157284 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742aab16-ad97-4bec-a273-a8fad44eb422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:56.158007 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742aab16-ad97-4bec-a273-a8fad44eb422 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:56.158295 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742aab16-ad97-4bec-a273-a8fad44eb422 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:56.158572 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742aab16-ad97-4bec-a273-a8fad44eb422 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:56.168986 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742aab16-ad97-4bec-a273-a8fad44eb422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:56.176088 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-742aab16-ad97-4bec-a273-a8fad44eb422 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 13:41:56.177629 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 196/383] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:56.184134 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a6409-b3a5-40f8-a0df-5d486750a41d None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:56.322643 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a6409-b3a5-40f8-a0df-5d486750a41d None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:56.372275 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e128eb-4a47-4d48-8915-cc466eb16591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:56.372950 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e128eb-4a47-4d48-8915-cc466eb16591 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:56.373236 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e128eb-4a47-4d48-8915-cc466eb16591 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:56.373512 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e128eb-4a47-4d48-8915-cc466eb16591 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:56.374268 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e128eb-4a47-4d48-8915-cc466eb16591 None admin] RBAC: Adding query filter params (name=member) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:56.374574 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e128eb-4a47-4d48-8915-cc466eb16591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:56.375974 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e128eb-4a47-4d48-8915-cc466eb16591 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:56.387345 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 188/384] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:56.395723 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742aab16-ad97-4bec-a273-a8fad44eb422 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:56.522384 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742aab16-ad97-4bec-a273-a8fad44eb422 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:56.565386 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3501b-f48f-485e-bb3f-9bab0cf27b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:56.566279 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3501b-f48f-485e-bb3f-9bab0cf27b23 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:56.566562 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3501b-f48f-485e-bb3f-9bab0cf27b23 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:56.566890 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3501b-f48f-485e-bb3f-9bab0cf27b23 None admin] PATH_INFO: `/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:56.568135 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3501b-f48f-485e-bb3f-9bab0cf27b23 None admin] RBAC: Authorizing `identity:get_group(group_id=a7c69ded5bbe411485cb6dcc8d215f5e)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:56.569596 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3501b-f48f-485e-bb3f-9bab0cf27b23 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:56.572205 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 197/385] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Apr 11 13:41:56 2022] GET /identity/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:56.580758 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e128eb-4a47-4d48-8915-cc466eb16591 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:56.706296 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e128eb-4a47-4d48-8915-cc466eb16591 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:56.743284 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeef81f-fc72-4f69-b8c2-040eb75eadae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:56.744188 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeef81f-fc72-4f69-b8c2-040eb75eadae None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:56.744473 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeef81f-fc72-4f69-b8c2-040eb75eadae None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:56.744751 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeef81f-fc72-4f69-b8c2-040eb75eadae None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:56.748042 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeef81f-fc72-4f69-b8c2-040eb75eadae None admin] RBAC: Authorizing `identity:get_project(project_id=029a84f386ce4e48b750a76626f65b2d)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:56.749608 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeef81f-fc72-4f69-b8c2-040eb75eadae None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:56.751593 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 189/386] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:56 2022] GET /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:56.757594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3501b-f48f-485e-bb3f-9bab0cf27b23 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:56.876728 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3501b-f48f-485e-bb3f-9bab0cf27b23 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:56.921749 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2970fd-15d8-4e71-b681-546978a7e1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:56.922679 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2970fd-15d8-4e71-b681-546978a7e1e3 None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:56.922967 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2970fd-15d8-4e71-b681-546978a7e1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:56.923249 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2970fd-15d8-4e71-b681-546978a7e1e3 None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d/groups/a7c69ded5bbe411485cb6dcc8d215f5e/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:56.925448 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2970fd-15d8-4e71-b681-546978a7e1e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=029a84f386ce4e48b750a76626f65b2d, group_id=a7c69ded5bbe411485cb6dcc8d215f5e, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:56.926940 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2970fd-15d8-4e71-b681-546978a7e1e3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:56.951691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 198/387] 10.222.0.67 () {58 vars in 1442 bytes} [Mon Apr 11 13:41:56 2022] PUT /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d/groups/a7c69ded5bbe411485cb6dcc8d215f5e/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:41:57.312897 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bfc43-a943-45b3-9fee-e49066299fbe None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:57.313580 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bfc43-a943-45b3-9fee-e49066299fbe None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:57.313580 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bfc43-a943-45b3-9fee-e49066299fbe None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:57.315003 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 190/388] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:57.320050 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1ef1b-63b5-4408-9591-5c36750cd53a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:57.321242 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1ef1b-63b5-4408-9591-5c36750cd53a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:57.321242 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1ef1b-63b5-4408-9591-5c36750cd53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:57.338803 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-9bd1ef1b-63b5-4408-9591-5c36750cd53a None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:57.339439 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee26b65-4160-4dd0-acb2-72dc42862187 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:57.339759 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee26b65-4160-4dd0-acb2-72dc42862187 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:57.340026 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9bd1ef1b-63b5-4408-9591-5c36750cd53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:57.340228 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee26b65-4160-4dd0-acb2-72dc42862187 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:57.341637 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 191/389] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:57.346238 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29f186-24f9-4c5e-9fdb-f434be040863 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:57.346529 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29f186-24f9-4c5e-9fdb-f434be040863 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:57.346814 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29f186-24f9-4c5e-9fdb-f434be040863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:57.374841 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-5c29f186-24f9-4c5e-9fdb-f434be040863 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:57.376071 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5c29f186-24f9-4c5e-9fdb-f434be040863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:57.409249 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 199/390] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:57.451641 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1ef1b-63b5-4408-9591-5c36750cd53a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:57.469946 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 192/391] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:41:57.502621 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29f186-24f9-4c5e-9fdb-f434be040863 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:57.628810 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1ef1b-63b5-4408-9591-5c36750cd53a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:57.654294 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29f186-24f9-4c5e-9fdb-f434be040863 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:57.693626 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529dcf5-22d6-43fa-982e-7056a22ff117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:57.694998 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529dcf5-22d6-43fa-982e-7056a22ff117 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:57.695668 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529dcf5-22d6-43fa-982e-7056a22ff117 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:57.696156 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529dcf5-22d6-43fa-982e-7056a22ff117 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:57.706658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e936780-5397-4634-9e42-c8c6d688cf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:57.707473 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e936780-5397-4634-9e42-c8c6d688cf1a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:57.707962 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e936780-5397-4634-9e42-c8c6d688cf1a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:57.708384 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e936780-5397-4634-9e42-c8c6d688cf1a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:57.708610 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529dcf5-22d6-43fa-982e-7056a22ff117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:57.716851 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-e529dcf5-22d6-43fa-982e-7056a22ff117 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 13:41:57.718584 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 193/392] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:41:57.723864 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529dcf5-22d6-43fa-982e-7056a22ff117 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:57.744532 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e936780-5397-4634-9e42-c8c6d688cf1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:57.760091 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-9e936780-5397-4634-9e42-c8c6d688cf1a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 13:41:57.761685 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 200/393] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:41:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:57.766834 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e936780-5397-4634-9e42-c8c6d688cf1a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:57.831924 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529dcf5-22d6-43fa-982e-7056a22ff117 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:57.869858 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f38bd-a734-4caf-84b4-dcf845b4e651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:57.870780 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f38bd-a734-4caf-84b4-dcf845b4e651 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:57.871230 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f38bd-a734-4caf-84b4-dcf845b4e651 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:57.871676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f38bd-a734-4caf-84b4-dcf845b4e651 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:57.873026 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f38bd-a734-4caf-84b4-dcf845b4e651 None admin] RBAC: Adding query filter params (name=member) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:57.873484 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f38bd-a734-4caf-84b4-dcf845b4e651 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:57.875049 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f38bd-a734-4caf-84b4-dcf845b4e651 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:57.884538 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 194/394] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:41:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:57.892941 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f38bd-a734-4caf-84b4-dcf845b4e651 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:57.995615 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e936780-5397-4634-9e42-c8c6d688cf1a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:58.045153 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f38bd-a734-4caf-84b4-dcf845b4e651 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:58.058278 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e133cc4-0b1b-49e3-aaba-cf8b5e6334d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:58.058967 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e133cc4-0b1b-49e3-aaba-cf8b5e6334d2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:58.059249 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e133cc4-0b1b-49e3-aaba-cf8b5e6334d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:58.059527 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e133cc4-0b1b-49e3-aaba-cf8b5e6334d2 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:58.060322 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e133cc4-0b1b-49e3-aaba-cf8b5e6334d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:58.060634 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e133cc4-0b1b-49e3-aaba-cf8b5e6334d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:58.062011 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e133cc4-0b1b-49e3-aaba-cf8b5e6334d2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:58.077097 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 201/395] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:41:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:58.084033 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e133cc4-0b1b-49e3-aaba-cf8b5e6334d2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:58.102695 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb1361-4651-4a56-96ce-6d185877025c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:58.104005 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb1361-4651-4a56-96ce-6d185877025c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:58.104430 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb1361-4651-4a56-96ce-6d185877025c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:58.104845 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb1361-4651-4a56-96ce-6d185877025c None admin] PATH_INFO: `/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:58.108867 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb1361-4651-4a56-96ce-6d185877025c None admin] RBAC: Authorizing `identity:get_group(group_id=a7c69ded5bbe411485cb6dcc8d215f5e)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:58.110584 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb1361-4651-4a56-96ce-6d185877025c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:58.112564 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 195/396] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Apr 11 13:41:57 2022] GET /identity/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:58.118655 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb1361-4651-4a56-96ce-6d185877025c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:58.216937 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e133cc4-0b1b-49e3-aaba-cf8b5e6334d2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:58.283184 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200eb5b-02b2-434b-81e0-b6e9fb2c16c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:58.284339 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200eb5b-02b2-434b-81e0-b6e9fb2c16c2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:58.284760 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200eb5b-02b2-434b-81e0-b6e9fb2c16c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:58.285228 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200eb5b-02b2-434b-81e0-b6e9fb2c16c2 None admin] PATH_INFO: `/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:58.287411 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200eb5b-02b2-434b-81e0-b6e9fb2c16c2 None admin] RBAC: Authorizing `identity:get_group(group_id=a7c69ded5bbe411485cb6dcc8d215f5e)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:58.290147 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200eb5b-02b2-434b-81e0-b6e9fb2c16c2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:58.293128 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 202/397] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Apr 11 13:41:58 2022] GET /identity/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:58.299754 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200eb5b-02b2-434b-81e0-b6e9fb2c16c2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:58.317228 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb1361-4651-4a56-96ce-6d185877025c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:58.380862 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446164eb-9364-4b43-95bf-a504a40c22cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:58.382075 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446164eb-9364-4b43-95bf-a504a40c22cc None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:58.382498 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446164eb-9364-4b43-95bf-a504a40c22cc None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:58.383002 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446164eb-9364-4b43-95bf-a504a40c22cc None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:58.384730 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446164eb-9364-4b43-95bf-a504a40c22cc None admin] RBAC: Authorizing `identity:get_project(project_id=63fb9340f10a4486a0c9270676f88f02)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:58.387427 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446164eb-9364-4b43-95bf-a504a40c22cc None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:58.389350 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 196/398] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:58 2022] GET /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:58.390689 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fb0e4-eb57-4eef-ba1c-fb55cc197e0b None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:58.391114 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fb0e4-eb57-4eef-ba1c-fb55cc197e0b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:58.391524 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fb0e4-eb57-4eef-ba1c-fb55cc197e0b None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:58.393106 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 197/399] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:58.395894 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fb0e4-eb57-4eef-ba1c-fb55cc197e0b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:58.463588 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200eb5b-02b2-434b-81e0-b6e9fb2c16c2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:58.509137 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f00a3f-462c-4494-b51d-9c2b1741b7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:58.509923 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f00a3f-462c-4494-b51d-9c2b1741b7ea None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:58.510199 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f00a3f-462c-4494-b51d-9c2b1741b7ea None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:58.510469 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f00a3f-462c-4494-b51d-9c2b1741b7ea None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:58.511688 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f00a3f-462c-4494-b51d-9c2b1741b7ea None admin] RBAC: Authorizing `identity:get_project(project_id=029a84f386ce4e48b750a76626f65b2d)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:58.513123 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f00a3f-462c-4494-b51d-9c2b1741b7ea None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:58.514820 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 203/400] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:58 2022] GET /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:58.520680 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ab5ef-6b33-48e7-b09e-ecd082affd41 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:58.520968 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ab5ef-6b33-48e7-b09e-ecd082affd41 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:58.521063 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fb0e4-eb57-4eef-ba1c-fb55cc197e0b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:58.521243 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ab5ef-6b33-48e7-b09e-ecd082affd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:58.537025 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7d3ab5ef-6b33-48e7-b09e-ecd082affd41 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:58.538239 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7d3ab5ef-6b33-48e7-b09e-ecd082affd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:58.553501 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78517f-e553-4971-9b9b-ab7ba83ceb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:58.554390 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78517f-e553-4971-9b9b-ab7ba83ceb9e None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:58.555204 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78517f-e553-4971-9b9b-ab7ba83ceb9e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:58.555650 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78517f-e553-4971-9b9b-ab7ba83ceb9e None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02/groups/a7c69ded5bbe411485cb6dcc8d215f5e/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:58.557701 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78517f-e553-4971-9b9b-ab7ba83ceb9e None admin] RBAC: Authorizing `identity:create_grant(project_id=63fb9340f10a4486a0c9270676f88f02, group_id=a7c69ded5bbe411485cb6dcc8d215f5e, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:58.559153 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78517f-e553-4971-9b9b-ab7ba83ceb9e None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:58.583654 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 198/401] 10.222.0.67 () {58 vars in 1442 bytes} [Mon Apr 11 13:41:58 2022] PUT /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02/groups/a7c69ded5bbe411485cb6dcc8d215f5e/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:41:58.583654 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8963843-1362-4c8b-936f-97d46b16f870 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:58.583654 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8963843-1362-4c8b-936f-97d46b16f870 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:58.583654 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8963843-1362-4c8b-936f-97d46b16f870 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:58.583654 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 199/402] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:58.583654 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8963843-1362-4c8b-936f-97d46b16f870 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:58.631772 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 204/403] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:58.633878 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff981b5-231b-4f8c-b82c-1010975bc37a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:58.634262 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff981b5-231b-4f8c-b82c-1010975bc37a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:58.634595 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff981b5-231b-4f8c-b82c-1010975bc37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:58.653778 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-bff981b5-231b-4f8c-b82c-1010975bc37a None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:58.654991 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-bff981b5-231b-4f8c-b82c-1010975bc37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:41:58.721670 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8963843-1362-4c8b-936f-97d46b16f870 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:58.730691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 205/404] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:41:58.740700 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff981b5-231b-4f8c-b82c-1010975bc37a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:58.763069 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcd69e-3307-4047-ae2b-d2a6f380091f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:58.764741 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcd69e-3307-4047-ae2b-d2a6f380091f None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:58.764741 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcd69e-3307-4047-ae2b-d2a6f380091f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:58.764920 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcd69e-3307-4047-ae2b-d2a6f380091f None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d/groups/a7c69ded5bbe411485cb6dcc8d215f5e/roles/fbb7398610b649859d123d0938aa8e75` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:58.767966 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdcd69e-3307-4047-ae2b-d2a6f380091f None admin] RBAC: Authorizing `identity:create_grant(project_id=029a84f386ce4e48b750a76626f65b2d, group_id=a7c69ded5bbe411485cb6dcc8d215f5e, role_id=fbb7398610b649859d123d0938aa8e75)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:58.769600 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdcd69e-3307-4047-ae2b-d2a6f380091f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:58.787838 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 200/405] 10.222.0.67 () {58 vars in 1442 bytes} [Mon Apr 11 13:41:58 2022] PUT /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d/groups/a7c69ded5bbe411485cb6dcc8d215f5e/roles/fbb7398610b649859d123d0938aa8e75 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:41:58.788619 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcd69e-3307-4047-ae2b-d2a6f380091f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:58.884377 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff981b5-231b-4f8c-b82c-1010975bc37a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:58.904834 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcd69e-3307-4047-ae2b-d2a6f380091f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:58.921225 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c03cd-2f7f-49d0-9833-020ad9181576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:58.922031 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c03cd-2f7f-49d0-9833-020ad9181576 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:58.922316 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c03cd-2f7f-49d0-9833-020ad9181576 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:58.922592 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c03cd-2f7f-49d0-9833-020ad9181576 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:58.934527 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c03cd-2f7f-49d0-9833-020ad9181576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:58.941610 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1883f2-4dde-4c65-9404-14af3f746d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:58.941813 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-875c03cd-2f7f-49d0-9833-020ad9181576 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:41:58.942439 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1883f2-4dde-4c65-9404-14af3f746d60 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:58.942724 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1883f2-4dde-4c65-9404-14af3f746d60 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:58.943001 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1883f2-4dde-4c65-9404-14af3f746d60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:58.943382 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 206/406] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:41:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:58.950021 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c03cd-2f7f-49d0-9833-020ad9181576 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:58.956526 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1883f2-4dde-4c65-9404-14af3f746d60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:41:58.965034 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-9a1883f2-4dde-4c65-9404-14af3f746d60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 13:41:58.966312 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 201/407] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:41:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:41:58.972443 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1883f2-4dde-4c65-9404-14af3f746d60 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:59.057502 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c03cd-2f7f-49d0-9833-020ad9181576 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:59.079608 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1883f2-4dde-4c65-9404-14af3f746d60 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:59.094357 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d58c34-7b87-4ef1-ae34-f6c4ff0d4280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:59.095033 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d58c34-7b87-4ef1-ae34-f6c4ff0d4280 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:59.095320 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d58c34-7b87-4ef1-ae34-f6c4ff0d4280 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:59.095599 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d58c34-7b87-4ef1-ae34-f6c4ff0d4280 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:59.096392 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d58c34-7b87-4ef1-ae34-f6c4ff0d4280 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:59.096703 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d58c34-7b87-4ef1-ae34-f6c4ff0d4280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:59.098083 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d58c34-7b87-4ef1-ae34-f6c4ff0d4280 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:59.107833 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 207/408] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:41:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:59.113693 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2dff4b-ecd7-4802-9772-609a737058d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:59.114377 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dff4b-ecd7-4802-9772-609a737058d9 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:59.114658 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dff4b-ecd7-4802-9772-609a737058d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:59.114933 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2dff4b-ecd7-4802-9772-609a737058d9 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:59.115477 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d58c34-7b87-4ef1-ae34-f6c4ff0d4280 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:59.115718 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2dff4b-ecd7-4802-9772-609a737058d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:41:59.116026 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2dff4b-ecd7-4802-9772-609a737058d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:59.118171 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2dff4b-ecd7-4802-9772-609a737058d9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:59.131769 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 202/409] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:41:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:59.136013 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2dff4b-ecd7-4802-9772-609a737058d9 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:59.217771 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d58c34-7b87-4ef1-ae34-f6c4ff0d4280 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:59.236804 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2dff4b-ecd7-4802-9772-609a737058d9 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:59.252172 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f256e-55bd-4ec5-9481-1fc0efb07687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:59.253757 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f256e-55bd-4ec5-9481-1fc0efb07687 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:59.254231 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f256e-55bd-4ec5-9481-1fc0efb07687 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:59.254684 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f256e-55bd-4ec5-9481-1fc0efb07687 None admin] PATH_INFO: `/v3/groups/2e8e301ce2974644a5c4cc856be0712a` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:59.256542 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f256e-55bd-4ec5-9481-1fc0efb07687 None admin] RBAC: Authorizing `identity:get_group(group_id=2e8e301ce2974644a5c4cc856be0712a)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:59.258544 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f256e-55bd-4ec5-9481-1fc0efb07687 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:59.261146 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 208/410] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Apr 11 13:41:59 2022] GET /identity/v3/groups/2e8e301ce2974644a5c4cc856be0712a => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:59.266552 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f256e-55bd-4ec5-9481-1fc0efb07687 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:59.272508 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eefd42-531f-4a0f-9a36-a36f6b06f79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:59.274067 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eefd42-531f-4a0f-9a36-a36f6b06f79b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:59.274358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eefd42-531f-4a0f-9a36-a36f6b06f79b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:59.274689 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eefd42-531f-4a0f-9a36-a36f6b06f79b None admin] PATH_INFO: `/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:59.275935 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eefd42-531f-4a0f-9a36-a36f6b06f79b None admin] RBAC: Authorizing `identity:get_group(group_id=a7c69ded5bbe411485cb6dcc8d215f5e)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:59.277411 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eefd42-531f-4a0f-9a36-a36f6b06f79b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:59.283475 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 203/411] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Apr 11 13:41:59 2022] GET /identity/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:59.284641 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eefd42-531f-4a0f-9a36-a36f6b06f79b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:59.390830 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eefd42-531f-4a0f-9a36-a36f6b06f79b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:59.440246 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14546b58-e235-49ed-9994-013617c3fe6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:59.441166 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14546b58-e235-49ed-9994-013617c3fe6d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:59.441489 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14546b58-e235-49ed-9994-013617c3fe6d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:59.441768 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14546b58-e235-49ed-9994-013617c3fe6d None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:59.442956 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14546b58-e235-49ed-9994-013617c3fe6d None admin] RBAC: Authorizing `identity:get_project(project_id=63fb9340f10a4486a0c9270676f88f02)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:59.444438 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14546b58-e235-49ed-9994-013617c3fe6d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:59.451335 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 204/412] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:59 2022] GET /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:41:59.453046 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14546b58-e235-49ed-9994-013617c3fe6d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:59.478440 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f256e-55bd-4ec5-9481-1fc0efb07687 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:59.557839 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14546b58-e235-49ed-9994-013617c3fe6d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:59.576599 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332645ab-bcdc-45e4-9521-cb01eed0fde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:59.577753 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332645ab-bcdc-45e4-9521-cb01eed0fde7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:59.578262 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332645ab-bcdc-45e4-9521-cb01eed0fde7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:59.578728 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332645ab-bcdc-45e4-9521-cb01eed0fde7 None admin] PATH_INFO: `/v3/projects/8ea005f626c8456495dc1d10183dc603` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:59.587119 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332645ab-bcdc-45e4-9521-cb01eed0fde7 None admin] RBAC: Authorizing `identity:get_project(project_id=8ea005f626c8456495dc1d10183dc603)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:59.588893 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332645ab-bcdc-45e4-9521-cb01eed0fde7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:59.590872 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 209/413] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:41:59 2022] GET /identity/v3/projects/8ea005f626c8456495dc1d10183dc603 => generated 344 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:41:59.596561 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332645ab-bcdc-45e4-9521-cb01eed0fde7 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:41:59.598851 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70169396-de2f-4082-b230-2ab154ce3035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:59.600092 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70169396-de2f-4082-b230-2ab154ce3035 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:59.600568 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70169396-de2f-4082-b230-2ab154ce3035 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:59.601003 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70169396-de2f-4082-b230-2ab154ce3035 None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02/groups/a7c69ded5bbe411485cb6dcc8d215f5e/roles/fbb7398610b649859d123d0938aa8e75` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:59.604186 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70169396-de2f-4082-b230-2ab154ce3035 None admin] RBAC: Authorizing `identity:create_grant(project_id=63fb9340f10a4486a0c9270676f88f02, group_id=a7c69ded5bbe411485cb6dcc8d215f5e, role_id=fbb7398610b649859d123d0938aa8e75)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:59.605919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70169396-de2f-4082-b230-2ab154ce3035 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:59.625310 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 205/414] 10.222.0.67 () {58 vars in 1442 bytes} [Mon Apr 11 13:41:59 2022] PUT /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02/groups/a7c69ded5bbe411485cb6dcc8d215f5e/roles/fbb7398610b649859d123d0938aa8e75 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:41:59.766194 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332645ab-bcdc-45e4-9521-cb01eed0fde7 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:41:59.819092 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832402a-8d0b-48d1-8bc6-eba775add99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:41:59.820054 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832402a-8d0b-48d1-8bc6-eba775add99a None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:59.820878 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832402a-8d0b-48d1-8bc6-eba775add99a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:59.821363 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832402a-8d0b-48d1-8bc6-eba775add99a None admin] PATH_INFO: `/v3/projects/8ea005f626c8456495dc1d10183dc603/groups/2e8e301ce2974644a5c4cc856be0712a/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:59.823504 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832402a-8d0b-48d1-8bc6-eba775add99a None admin] RBAC: Authorizing `identity:create_grant(project_id=8ea005f626c8456495dc1d10183dc603, group_id=2e8e301ce2974644a5c4cc856be0712a, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:41:59.825000 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832402a-8d0b-48d1-8bc6-eba775add99a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:41:59.844273 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 210/415] 10.222.0.67 () {58 vars in 1442 bytes} [Mon Apr 11 13:41:59 2022] PUT /identity/v3/projects/8ea005f626c8456495dc1d10183dc603/groups/2e8e301ce2974644a5c4cc856be0712a/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:41:59.953714 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce15383-9703-4f55-a014-c75b792ca8ee None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:59.954363 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce15383-9703-4f55-a014-c75b792ca8ee None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:59.954870 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce15383-9703-4f55-a014-c75b792ca8ee None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:59.957082 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 206/416] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:41:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:41:59.963314 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a62b37-6c97-47f7-aad2-d6761e0dabf1 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:41:59.963605 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a62b37-6c97-47f7-aad2-d6761e0dabf1 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:41:59.963894 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a62b37-6c97-47f7-aad2-d6761e0dabf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:41:59.985176 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-46a62b37-6c97-47f7-aad2-d6761e0dabf1 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:41:59.986716 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-46a62b37-6c97-47f7-aad2-d6761e0dabf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:00.063328 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 211/417] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:00.089477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce15383-9703-4f55-a014-c75b792ca8ee None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:00.200037 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce15383-9703-4f55-a014-c75b792ca8ee None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:00.252868 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48d74c-062a-41b7-8b5b-64e17e959dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:00.254043 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48d74c-062a-41b7-8b5b-64e17e959dde None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:00.254529 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48d74c-062a-41b7-8b5b-64e17e959dde None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:00.255000 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48d74c-062a-41b7-8b5b-64e17e959dde None admin] PATH_INFO: `/v3/roles/member` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:00.268353 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48d74c-062a-41b7-8b5b-64e17e959dde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:00.275840 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-3b48d74c-062a-41b7-8b5b-64e17e959dde None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 13:42:00.277292 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 207/418] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:42:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:00.283543 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a62b37-6c97-47f7-aad2-d6761e0dabf1 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:00.388613 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a62b37-6c97-47f7-aad2-d6761e0dabf1 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:00.435234 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985fb00-418b-40e2-8084-f16ac6b39930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:00.436314 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985fb00-418b-40e2-8084-f16ac6b39930 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:00.436797 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985fb00-418b-40e2-8084-f16ac6b39930 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:00.437265 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985fb00-418b-40e2-8084-f16ac6b39930 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:00.438213 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985fb00-418b-40e2-8084-f16ac6b39930 None admin] RBAC: Adding query filter params (name=member) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:00.438733 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985fb00-418b-40e2-8084-f16ac6b39930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:00.440334 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985fb00-418b-40e2-8084-f16ac6b39930 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:00.450322 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 212/419] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:42:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:00.455571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48d74c-062a-41b7-8b5b-64e17e959dde None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:00.560693 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48d74c-062a-41b7-8b5b-64e17e959dde None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:00.599036 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e3a79-f6f7-49dd-93d5-1e291e01ca2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:00.600047 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e3a79-f6f7-49dd-93d5-1e291e01ca2e None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:00.600531 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e3a79-f6f7-49dd-93d5-1e291e01ca2e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:00.600999 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e3a79-f6f7-49dd-93d5-1e291e01ca2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:00.668607 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e3a79-f6f7-49dd-93d5-1e291e01ca2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:00.670400 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e3a79-f6f7-49dd-93d5-1e291e01ca2e None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:00.795793 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 208/420] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:42:00.801281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985fb00-418b-40e2-8084-f16ac6b39930 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:00.962325 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985fb00-418b-40e2-8084-f16ac6b39930 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:01.008488 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b0fd5-19f5-4be5-b71e-0f32653f2bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:01.009539 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b0fd5-19f5-4be5-b71e-0f32653f2bc3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:01.009823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b0fd5-19f5-4be5-b71e-0f32653f2bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:01.010099 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b0fd5-19f5-4be5-b71e-0f32653f2bc3 None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:01.011305 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b0fd5-19f5-4be5-b71e-0f32653f2bc3 None admin] RBAC: Authorizing `identity:get_project(project_id=029a84f386ce4e48b750a76626f65b2d)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:01.014798 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b0fd5-19f5-4be5-b71e-0f32653f2bc3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:01.016605 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 213/421] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:42:00 2022] GET /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:01.021964 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e3a79-f6f7-49dd-93d5-1e291e01ca2e None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:01.181020 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e3a79-f6f7-49dd-93d5-1e291e01ca2e None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:01.227784 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e84943-1bc0-4897-8897-8f9005d75505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:01.229094 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e84943-1bc0-4897-8897-8f9005d75505 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:01.229596 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e84943-1bc0-4897-8897-8f9005d75505 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:01.230066 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e84943-1bc0-4897-8897-8f9005d75505 None admin] PATH_INFO: `/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:01.236308 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e84943-1bc0-4897-8897-8f9005d75505 None admin] RBAC: Authorizing `identity:get_group(group_id=a7c69ded5bbe411485cb6dcc8d215f5e)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:01.237987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e84943-1bc0-4897-8897-8f9005d75505 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:01.239962 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 209/422] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Apr 11 13:42:01 2022] GET /identity/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:01.246530 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b0fd5-19f5-4be5-b71e-0f32653f2bc3 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:01.369893 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b0fd5-19f5-4be5-b71e-0f32653f2bc3 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:01.436136 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c522f9-2f12-4c5e-b2ed-dee29e5f0cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:01.436796 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c522f9-2f12-4c5e-b2ed-dee29e5f0cd7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:01.437079 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c522f9-2f12-4c5e-b2ed-dee29e5f0cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:01.437353 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c522f9-2f12-4c5e-b2ed-dee29e5f0cd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:01.438177 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c522f9-2f12-4c5e-b2ed-dee29e5f0cd7 None admin] RBAC: Adding query filter params (group.id=a7c69ded5bbe411485cb6dcc8d215f5e, role.id=3daf622d91e64ce685da6f482aa181ea, scope.project.id=029a84f386ce4e48b750a76626f65b2d) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:01.438485 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c522f9-2f12-4c5e-b2ed-dee29e5f0cd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:01.439930 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c522f9-2f12-4c5e-b2ed-dee29e5f0cd7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:01.452585 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 214/423] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Apr 11 13:42:01 2022] GET /identity/v3/role_assignments?group.id=a7c69ded5bbe411485cb6dcc8d215f5e&scope.project.id=029a84f386ce4e48b750a76626f65b2d&role.id=3daf622d91e64ce685da6f482aa181ea => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:01.535386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e9adc-bb8c-4ab2-9373-4c15d8490af8 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:01.535386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e9adc-bb8c-4ab2-9373-4c15d8490af8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:01.535386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e9adc-bb8c-4ab2-9373-4c15d8490af8 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:01.535386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 210/424] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:01.552654 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec84b8-7bde-4b43-86a9-ee63f5813dee None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:01.552939 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec84b8-7bde-4b43-86a9-ee63f5813dee None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:01.553378 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec84b8-7bde-4b43-86a9-ee63f5813dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:01.579200 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-39ec84b8-7bde-4b43-86a9-ee63f5813dee None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:01.580694 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-39ec84b8-7bde-4b43-86a9-ee63f5813dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:01.666834 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 215/425] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:01.693983 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e9adc-bb8c-4ab2-9373-4c15d8490af8 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:01.812372 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e9adc-bb8c-4ab2-9373-4c15d8490af8 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:01.854756 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853175d-bf3e-40eb-b472-514c2763f9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:01.855571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853175d-bf3e-40eb-b472-514c2763f9e8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:01.855882 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853175d-bf3e-40eb-b472-514c2763f9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:01.856155 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853175d-bf3e-40eb-b472-514c2763f9e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:01.870190 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853175d-bf3e-40eb-b472-514c2763f9e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:01.877323 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-d853175d-bf3e-40eb-b472-514c2763f9e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 13:42:01.878863 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 211/426] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:42:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:01.884655 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec84b8-7bde-4b43-86a9-ee63f5813dee None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:01.905039 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7f66d-4f3a-432c-8fca-8433b99a1683 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:01.905331 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7f66d-4f3a-432c-8fca-8433b99a1683 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:01.905602 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7f66d-4f3a-432c-8fca-8433b99a1683 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:01.907222 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 212/427] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:42:01.913250 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9b425-e3c3-4160-899e-f5f163a1ea4b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:01.913541 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9b425-e3c3-4160-899e-f5f163a1ea4b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:01.914471 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9b425-e3c3-4160-899e-f5f163a1ea4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:01.933892 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-09b9b425-e3c3-4160-899e-f5f163a1ea4b None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:01.935089 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-09b9b425-e3c3-4160-899e-f5f163a1ea4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:02.012812 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec84b8-7bde-4b43-86a9-ee63f5813dee None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:02.033888 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 213/428] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:42:02.060956 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9b425-e3c3-4160-899e-f5f163a1ea4b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:02.064670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cefc5-2097-45e0-b956-90d84f63bf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:02.065341 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cefc5-2097-45e0-b956-90d84f63bf28 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:02.065623 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cefc5-2097-45e0-b956-90d84f63bf28 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:02.065898 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cefc5-2097-45e0-b956-90d84f63bf28 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:02.066761 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cefc5-2097-45e0-b956-90d84f63bf28 None admin] RBAC: Adding query filter params (name=member) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:02.067068 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cefc5-2097-45e0-b956-90d84f63bf28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:02.068543 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cefc5-2097-45e0-b956-90d84f63bf28 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:02.078763 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 216/429] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:42:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:02.084047 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cefc5-2097-45e0-b956-90d84f63bf28 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:02.190107 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9b425-e3c3-4160-899e-f5f163a1ea4b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:02.202126 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cefc5-2097-45e0-b956-90d84f63bf28 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:02.227594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247c44e-b8ee-4fd3-ab0b-fd398bb0ac08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:02.228442 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247c44e-b8ee-4fd3-ab0b-fd398bb0ac08 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:02.228728 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247c44e-b8ee-4fd3-ab0b-fd398bb0ac08 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:02.229002 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247c44e-b8ee-4fd3-ab0b-fd398bb0ac08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:02.236973 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1d6f5-cf8a-4e2e-ba85-f5e046696ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:02.237626 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1d6f5-cf8a-4e2e-ba85-f5e046696ea7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:02.237907 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1d6f5-cf8a-4e2e-ba85-f5e046696ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:02.238184 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1d6f5-cf8a-4e2e-ba85-f5e046696ea7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:02.241010 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247c44e-b8ee-4fd3-ab0b-fd398bb0ac08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:02.249893 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-5247c44e-b8ee-4fd3-ab0b-fd398bb0ac08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 13:42:02.251133 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 214/430] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:42:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:02.257021 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247c44e-b8ee-4fd3-ab0b-fd398bb0ac08 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:02.332168 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1d6f5-cf8a-4e2e-ba85-f5e046696ea7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:02.333924 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1d6f5-cf8a-4e2e-ba85-f5e046696ea7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:02.397902 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247c44e-b8ee-4fd3-ab0b-fd398bb0ac08 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:02.434107 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fa090-781d-414b-9e0a-25c3717b83c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:02.435073 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fa090-781d-414b-9e0a-25c3717b83c5 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:02.435538 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fa090-781d-414b-9e0a-25c3717b83c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:02.435992 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fa090-781d-414b-9e0a-25c3717b83c5 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:02.436883 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21fa090-781d-414b-9e0a-25c3717b83c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:02.437354 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21fa090-781d-414b-9e0a-25c3717b83c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:02.438882 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21fa090-781d-414b-9e0a-25c3717b83c5 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:02.453008 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 215/431] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:02.454496 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fa090-781d-414b-9e0a-25c3717b83c5 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:02.463147 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 217/432] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 13:42:02.472580 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1d6f5-cf8a-4e2e-ba85-f5e046696ea7 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:02.575978 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fa090-781d-414b-9e0a-25c3717b83c5 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:02.577342 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1d6f5-cf8a-4e2e-ba85-f5e046696ea7 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:02.609508 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bb6cd-f331-4cf0-a326-13280ac9031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:02.610238 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bb6cd-f331-4cf0-a326-13280ac9031f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:02.610617 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bb6cd-f331-4cf0-a326-13280ac9031f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:02.610989 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bb6cd-f331-4cf0-a326-13280ac9031f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:02.618244 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac591e27-d55b-453c-b670-86ffcf908721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:02.619154 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac591e27-d55b-453c-b670-86ffcf908721 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:02.619439 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac591e27-d55b-453c-b670-86ffcf908721 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:02.619739 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac591e27-d55b-453c-b670-86ffcf908721 None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:02.621382 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac591e27-d55b-453c-b670-86ffcf908721 None admin] RBAC: Authorizing `identity:get_project(project_id=63fb9340f10a4486a0c9270676f88f02)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:02.623195 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac591e27-d55b-453c-b670-86ffcf908721 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:02.627813 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 218/433] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:42:02 2022] GET /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:02.631546 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac591e27-d55b-453c-b670-86ffcf908721 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:02.684800 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bb6cd-f331-4cf0-a326-13280ac9031f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:02.686369 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bb6cd-f331-4cf0-a326-13280ac9031f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:02.732980 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac591e27-d55b-453c-b670-86ffcf908721 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:02.764588 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2ae53-6fa2-45b7-a563-229b2d70df41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:02.765446 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ae53-6fa2-45b7-a563-229b2d70df41 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:02.765725 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ae53-6fa2-45b7-a563-229b2d70df41 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:02.766001 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ae53-6fa2-45b7-a563-229b2d70df41 None admin] PATH_INFO: `/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:02.767324 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2ae53-6fa2-45b7-a563-229b2d70df41 None admin] RBAC: Authorizing `identity:get_group(group_id=a7c69ded5bbe411485cb6dcc8d215f5e)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:02.768782 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2ae53-6fa2-45b7-a563-229b2d70df41 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:02.770385 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 219/434] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Apr 11 13:42:02 2022] GET /identity/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:02.775337 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905625c8-2e07-4a25-8632-fc4e14de707d None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:02.775337 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905625c8-2e07-4a25-8632-fc4e14de707d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:02.775337 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905625c8-2e07-4a25-8632-fc4e14de707d None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:02.775337 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 220/435] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:02.775337 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdbb4d-cdf8-4364-b19b-11ebb1e816a1 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:02.775337 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdbb4d-cdf8-4364-b19b-11ebb1e816a1 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:02.775850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcdbb4d-cdf8-4364-b19b-11ebb1e816a1 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:02.776832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 221/436] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:02.777668 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdbb4d-cdf8-4364-b19b-11ebb1e816a1 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:02.792844 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 216/437] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:42:02.792844 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f97de-3d1a-4d39-b73b-41bc47848682 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:02.792844 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f97de-3d1a-4d39-b73b-41bc47848682 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:02.792844 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f97de-3d1a-4d39-b73b-41bc47848682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:02.806836 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-446f97de-3d1a-4d39-b73b-41bc47848682 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:02.808070 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-446f97de-3d1a-4d39-b73b-41bc47848682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:02.871035 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 217/438] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:02.873344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c21346-260a-439d-9318-abc169ed188a None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:02.873344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c21346-260a-439d-9318-abc169ed188a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:02.873344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c21346-260a-439d-9318-abc169ed188a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:02.875109 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcdbb4d-cdf8-4364-b19b-11ebb1e816a1 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:02.888376 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-57c21346-260a-439d-9318-abc169ed188a None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:02.889555 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-57c21346-260a-439d-9318-abc169ed188a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:02.908763 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9317e76-658f-4303-bce9-b24fe78af54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:02.909427 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9317e76-658f-4303-bce9-b24fe78af54a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:02.909712 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9317e76-658f-4303-bce9-b24fe78af54a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:02.909989 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9317e76-658f-4303-bce9-b24fe78af54a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:02.910887 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9317e76-658f-4303-bce9-b24fe78af54a None admin] RBAC: Adding query filter params (group.id=a7c69ded5bbe411485cb6dcc8d215f5e, role.id=3daf622d91e64ce685da6f482aa181ea, scope.project.id=63fb9340f10a4486a0c9270676f88f02) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:02.911265 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9317e76-658f-4303-bce9-b24fe78af54a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:02.912760 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9317e76-658f-4303-bce9-b24fe78af54a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:02.918901 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 222/439] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Apr 11 13:42:02 2022] GET /identity/v3/role_assignments?group.id=a7c69ded5bbe411485cb6dcc8d215f5e&scope.project.id=63fb9340f10a4486a0c9270676f88f02&role.id=3daf622d91e64ce685da6f482aa181ea => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:02.919768 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9317e76-658f-4303-bce9-b24fe78af54a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:02.971663 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 218/440] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:02.971663 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c21346-260a-439d-9318-abc169ed188a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:03.025732 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9317e76-658f-4303-bce9-b24fe78af54a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:03.061545 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715c3d8-7ab9-4e84-b332-d4a2fb860fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:03.062437 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715c3d8-7ab9-4e84-b332-d4a2fb860fd9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:03.062723 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715c3d8-7ab9-4e84-b332-d4a2fb860fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:03.062999 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715c3d8-7ab9-4e84-b332-d4a2fb860fd9 None admin] PATH_INFO: `/v3/projects/029a84f386ce4e48b750a76626f65b2d` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:03.064305 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715c3d8-7ab9-4e84-b332-d4a2fb860fd9 None admin] RBAC: Authorizing `identity:get_project(project_id=029a84f386ce4e48b750a76626f65b2d)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:03.065764 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715c3d8-7ab9-4e84-b332-d4a2fb860fd9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:03.072873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 223/441] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:42:02 2022] GET /identity/v3/projects/029a84f386ce4e48b750a76626f65b2d => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:03.072873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715c3d8-7ab9-4e84-b332-d4a2fb860fd9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:03.086012 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c21346-260a-439d-9318-abc169ed188a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:03.125075 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96635c-e6e8-460a-9c65-0bf1eede25d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:03.126179 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96635c-e6e8-460a-9c65-0bf1eede25d0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:03.126468 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96635c-e6e8-460a-9c65-0bf1eede25d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:03.126747 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96635c-e6e8-460a-9c65-0bf1eede25d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:03.140260 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96635c-e6e8-460a-9c65-0bf1eede25d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:03.147102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-ed96635c-e6e8-460a-9c65-0bf1eede25d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:42:03.148497 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 219/442] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:42:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:03.149277 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96635c-e6e8-460a-9c65-0bf1eede25d0 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:03.183979 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715c3d8-7ab9-4e84-b332-d4a2fb860fd9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:03.215695 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc39dc-3fa3-4367-8e09-6a9abca6b81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:03.216489 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc39dc-3fa3-4367-8e09-6a9abca6b81b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:03.216768 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc39dc-3fa3-4367-8e09-6a9abca6b81b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:03.217035 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc39dc-3fa3-4367-8e09-6a9abca6b81b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:03.227086 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc39dc-3fa3-4367-8e09-6a9abca6b81b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:03.234231 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-facc39dc-3fa3-4367-8e09-6a9abca6b81b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 13:42:03.235411 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 224/443] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:42:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:03.236186 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc39dc-3fa3-4367-8e09-6a9abca6b81b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:03.244292 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96635c-e6e8-460a-9c65-0bf1eede25d0 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:03.275011 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382c6f5-95af-44e6-a9e0-ac7068b1ccb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:03.275887 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382c6f5-95af-44e6-a9e0-ac7068b1ccb2 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:03.276164 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382c6f5-95af-44e6-a9e0-ac7068b1ccb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:03.276434 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382c6f5-95af-44e6-a9e0-ac7068b1ccb2 None admin] PATH_INFO: `/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:03.277592 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382c6f5-95af-44e6-a9e0-ac7068b1ccb2 None admin] RBAC: Authorizing `identity:get_group(group_id=a7c69ded5bbe411485cb6dcc8d215f5e)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:03.279025 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382c6f5-95af-44e6-a9e0-ac7068b1ccb2 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:03.280645 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 220/444] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Apr 11 13:42:03 2022] GET /identity/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e => generated 226 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:03.281390 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382c6f5-95af-44e6-a9e0-ac7068b1ccb2 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:03.339767 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc39dc-3fa3-4367-8e09-6a9abca6b81b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:03.372508 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46b18e-2b48-458a-adf2-464871bec594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:03.373169 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46b18e-2b48-458a-adf2-464871bec594 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:03.373453 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46b18e-2b48-458a-adf2-464871bec594 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:03.373732 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46b18e-2b48-458a-adf2-464871bec594 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:03.374475 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46b18e-2b48-458a-adf2-464871bec594 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:03.374780 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46b18e-2b48-458a-adf2-464871bec594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:03.376194 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382c6f5-95af-44e6-a9e0-ac7068b1ccb2 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:03.376298 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46b18e-2b48-458a-adf2-464871bec594 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:03.384285 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 225/445] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:42:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:03.385092 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46b18e-2b48-458a-adf2-464871bec594 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:03.412187 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79e466-c647-4d9b-8020-c67529145c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:03.412847 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79e466-c647-4d9b-8020-c67529145c32 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:03.413123 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79e466-c647-4d9b-8020-c67529145c32 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:03.413393 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79e466-c647-4d9b-8020-c67529145c32 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:03.414774 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79e466-c647-4d9b-8020-c67529145c32 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:03.415085 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79e466-c647-4d9b-8020-c67529145c32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:03.416480 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79e466-c647-4d9b-8020-c67529145c32 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:03.423944 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 221/446] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:03.424717 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79e466-c647-4d9b-8020-c67529145c32 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:03.490417 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46b18e-2b48-458a-adf2-464871bec594 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:03.518338 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79e466-c647-4d9b-8020-c67529145c32 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:03.521826 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e68c2f-ce16-4587-b8a2-e6e2e744f4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:03.522475 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e68c2f-ce16-4587-b8a2-e6e2e744f4d9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:03.522756 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e68c2f-ce16-4587-b8a2-e6e2e744f4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:03.523769 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e68c2f-ce16-4587-b8a2-e6e2e744f4d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:03.524723 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e68c2f-ce16-4587-b8a2-e6e2e744f4d9 None admin] RBAC: Adding query filter params (group.id=a7c69ded5bbe411485cb6dcc8d215f5e, role.id=fbb7398610b649859d123d0938aa8e75, scope.project.id=029a84f386ce4e48b750a76626f65b2d) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:03.525035 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e68c2f-ce16-4587-b8a2-e6e2e744f4d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:03.526477 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e68c2f-ce16-4587-b8a2-e6e2e744f4d9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:03.532085 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 226/447] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Apr 11 13:42:03 2022] GET /identity/v3/role_assignments?group.id=a7c69ded5bbe411485cb6dcc8d215f5e&scope.project.id=029a84f386ce4e48b750a76626f65b2d&role.id=fbb7398610b649859d123d0938aa8e75 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:03.532857 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e68c2f-ce16-4587-b8a2-e6e2e744f4d9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:03.564698 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c398688-db35-46cc-95bf-165b29767bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:03.565363 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c398688-db35-46cc-95bf-165b29767bf7 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:03.565645 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c398688-db35-46cc-95bf-165b29767bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:03.565916 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c398688-db35-46cc-95bf-165b29767bf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:03.638947 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c398688-db35-46cc-95bf-165b29767bf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:03.640506 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e68c2f-ce16-4587-b8a2-e6e2e744f4d9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:03.641271 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c398688-db35-46cc-95bf-165b29767bf7 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:03.675227 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ca867-a9d0-42e8-88e1-ac189d76dd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:03.676060 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ca867-a9d0-42e8-88e1-ac189d76dd34 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:03.676406 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ca867-a9d0-42e8-88e1-ac189d76dd34 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:03.676753 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ca867-a9d0-42e8-88e1-ac189d76dd34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:03.746618 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 222/448] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:42:03.748535 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ca867-a9d0-42e8-88e1-ac189d76dd34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:03.750010 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ca867-a9d0-42e8-88e1-ac189d76dd34 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:03.752175 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c398688-db35-46cc-95bf-165b29767bf7 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:03.865008 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 227/449] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:42:03.866643 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c398688-db35-46cc-95bf-165b29767bf7 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:03.870670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ca867-a9d0-42e8-88e1-ac189d76dd34 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:03.905684 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396480e0-43f4-4987-91c4-745c9d0b1654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:03.906472 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396480e0-43f4-4987-91c4-745c9d0b1654 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:03.906752 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396480e0-43f4-4987-91c4-745c9d0b1654 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:03.907030 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396480e0-43f4-4987-91c4-745c9d0b1654 None admin] PATH_INFO: `/v3/projects/8ea005f626c8456495dc1d10183dc603` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:03.908244 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396480e0-43f4-4987-91c4-745c9d0b1654 None admin] RBAC: Authorizing `identity:get_project(project_id=8ea005f626c8456495dc1d10183dc603)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:03.909692 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396480e0-43f4-4987-91c4-745c9d0b1654 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:03.915548 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 223/450] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:42:03 2022] GET /identity/v3/projects/8ea005f626c8456495dc1d10183dc603 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:03.917520 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396480e0-43f4-4987-91c4-745c9d0b1654 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:03.984984 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ca867-a9d0-42e8-88e1-ac189d76dd34 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:04.020953 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce831e-c125-407a-8a9e-bd98d9a847d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:04.022093 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce831e-c125-407a-8a9e-bd98d9a847d6 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:04.022369 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce831e-c125-407a-8a9e-bd98d9a847d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:04.022646 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce831e-c125-407a-8a9e-bd98d9a847d6 None admin] PATH_INFO: `/v3/projects/63fb9340f10a4486a0c9270676f88f02` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:04.024005 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce831e-c125-407a-8a9e-bd98d9a847d6 None admin] RBAC: Authorizing `identity:get_project(project_id=63fb9340f10a4486a0c9270676f88f02)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:04.025440 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce831e-c125-407a-8a9e-bd98d9a847d6 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:04.027318 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 228/451] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:42:03 2022] GET /identity/v3/projects/63fb9340f10a4486a0c9270676f88f02 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:04.029258 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396480e0-43f4-4987-91c4-745c9d0b1654 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:04.032850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce831e-c125-407a-8a9e-bd98d9a847d6 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:04.072878 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76578d31-223a-439a-ac69-5d72d1bf6f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:04.074891 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76578d31-223a-439a-ac69-5d72d1bf6f36 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:04.075332 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76578d31-223a-439a-ac69-5d72d1bf6f36 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:04.076017 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76578d31-223a-439a-ac69-5d72d1bf6f36 None admin] PATH_INFO: `/v3/groups/2e8e301ce2974644a5c4cc856be0712a` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:04.077422 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76578d31-223a-439a-ac69-5d72d1bf6f36 None admin] RBAC: Authorizing `identity:get_group(group_id=2e8e301ce2974644a5c4cc856be0712a)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:04.078870 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76578d31-223a-439a-ac69-5d72d1bf6f36 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:04.080532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 224/452] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Apr 11 13:42:03 2022] GET /identity/v3/groups/2e8e301ce2974644a5c4cc856be0712a => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:04.086247 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76578d31-223a-439a-ac69-5d72d1bf6f36 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:04.132696 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce831e-c125-407a-8a9e-bd98d9a847d6 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:04.164793 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852adddb-5074-4be8-8a93-189a8cdbdd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:04.165566 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852adddb-5074-4be8-8a93-189a8cdbdd82 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:04.165845 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852adddb-5074-4be8-8a93-189a8cdbdd82 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:04.166120 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852adddb-5074-4be8-8a93-189a8cdbdd82 None admin] PATH_INFO: `/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:04.167294 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852adddb-5074-4be8-8a93-189a8cdbdd82 None admin] RBAC: Authorizing `identity:get_group(group_id=a7c69ded5bbe411485cb6dcc8d215f5e)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:04.168765 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852adddb-5074-4be8-8a93-189a8cdbdd82 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:04.170368 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 229/453] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Apr 11 13:42:04 2022] GET /identity/v3/groups/a7c69ded5bbe411485cb6dcc8d215f5e => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:04.175972 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852adddb-5074-4be8-8a93-189a8cdbdd82 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:04.177699 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76578d31-223a-439a-ac69-5d72d1bf6f36 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:04.209893 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ac4ab-9a01-4d0e-bb04-72f7a61589af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:04.210582 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ac4ab-9a01-4d0e-bb04-72f7a61589af None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:04.210854 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ac4ab-9a01-4d0e-bb04-72f7a61589af None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:04.211125 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ac4ab-9a01-4d0e-bb04-72f7a61589af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:04.212054 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ac4ab-9a01-4d0e-bb04-72f7a61589af None admin] RBAC: Adding query filter params (group.id=2e8e301ce2974644a5c4cc856be0712a, role.id=e3333fcf22b040e3a1f0bfbfe657cffa, scope.project.id=8ea005f626c8456495dc1d10183dc603) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:04.212362 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ac4ab-9a01-4d0e-bb04-72f7a61589af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:04.213788 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ac4ab-9a01-4d0e-bb04-72f7a61589af None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:04.231695 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 225/454] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Apr 11 13:42:04 2022] GET /identity/v3/role_assignments?group.id=2e8e301ce2974644a5c4cc856be0712a&scope.project.id=8ea005f626c8456495dc1d10183dc603&role.id=e3333fcf22b040e3a1f0bfbfe657cffa => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:04.272250 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852adddb-5074-4be8-8a93-189a8cdbdd82 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:04.307886 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f765e9-f3a7-4da1-af4e-ffc2ac830d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:04.308548 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f765e9-f3a7-4da1-af4e-ffc2ac830d0f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:04.308832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f765e9-f3a7-4da1-af4e-ffc2ac830d0f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:04.309105 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f765e9-f3a7-4da1-af4e-ffc2ac830d0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:04.309943 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f765e9-f3a7-4da1-af4e-ffc2ac830d0f None admin] RBAC: Adding query filter params (group.id=a7c69ded5bbe411485cb6dcc8d215f5e, role.id=fbb7398610b649859d123d0938aa8e75, scope.project.id=63fb9340f10a4486a0c9270676f88f02) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:04.310253 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f765e9-f3a7-4da1-af4e-ffc2ac830d0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:04.311710 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f765e9-f3a7-4da1-af4e-ffc2ac830d0f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:04.318200 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 230/455] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Apr 11 13:42:04 2022] GET /identity/v3/role_assignments?group.id=a7c69ded5bbe411485cb6dcc8d215f5e&scope.project.id=63fb9340f10a4486a0c9270676f88f02&role.id=fbb7398610b649859d123d0938aa8e75 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:07.322995 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837775b-3705-4a33-9950-f373c571306b None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:07.324067 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837775b-3705-4a33-9950-f373c571306b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:07.324553 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837775b-3705-4a33-9950-f373c571306b None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:07.326750 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 226/456] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:07.348567 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829ef27-ea6f-446c-b291-a866ce68055f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:07.349077 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829ef27-ea6f-446c-b291-a866ce68055f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:07.349152 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829ef27-ea6f-446c-b291-a866ce68055f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:07.374875 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-5829ef27-ea6f-446c-b291-a866ce68055f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:07.376079 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5829ef27-ea6f-446c-b291-a866ce68055f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:07.470506 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 231/457] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:07.509350 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837775b-3705-4a33-9950-f373c571306b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:07.537325 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b0738-b5d5-4b83-bd12-1f1d892f9c30 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:07.537965 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b0738-b5d5-4b83-bd12-1f1d892f9c30 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:07.538492 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b0738-b5d5-4b83-bd12-1f1d892f9c30 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:07.540616 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 232/458] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:42:07.545691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2142a-1f02-4759-95e5-57949f394991 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:07.546227 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2142a-1f02-4759-95e5-57949f394991 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:07.546692 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2142a-1f02-4759-95e5-57949f394991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:07.564562 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a7e2142a-1f02-4759-95e5-57949f394991 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:07.566069 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a7e2142a-1f02-4759-95e5-57949f394991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:07.636110 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 233/459] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:07.661677 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2142a-1f02-4759-95e5-57949f394991 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:07.704317 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837775b-3705-4a33-9950-f373c571306b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:07.759840 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594803f-bf82-4723-a1fb-fd9a0facc422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:07.760641 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594803f-bf82-4723-a1fb-fd9a0facc422 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:07.760919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594803f-bf82-4723-a1fb-fd9a0facc422 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:07.761187 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594803f-bf82-4723-a1fb-fd9a0facc422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:07.761359 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2142a-1f02-4759-95e5-57949f394991 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:07.776219 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594803f-bf82-4723-a1fb-fd9a0facc422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:07.777954 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594803f-bf82-4723-a1fb-fd9a0facc422 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:07.795598 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-5594803f-bf82-4723-a1fb-fd9a0facc422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:07.797547 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 227/460] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:07.799206 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e89c7-74cf-4e3d-ab1a-653b48b61745 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:07.799910 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e89c7-74cf-4e3d-ab1a-653b48b61745 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:07.800405 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e89c7-74cf-4e3d-ab1a-653b48b61745 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:07.801961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 228/461] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:07.804500 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e89c7-74cf-4e3d-ab1a-653b48b61745 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:07.806932 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bc0bb-632f-4420-9f48-a0e6708d5148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:07.807787 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bc0bb-632f-4420-9f48-a0e6708d5148 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:07.808072 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bc0bb-632f-4420-9f48-a0e6708d5148 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:07.808348 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bc0bb-632f-4420-9f48-a0e6708d5148 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:07.818722 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3bc0bb-632f-4420-9f48-a0e6708d5148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:07.820730 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3bc0bb-632f-4420-9f48-a0e6708d5148 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:07.838092 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-8d3bc0bb-632f-4420-9f48-a0e6708d5148 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:07.839329 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 234/462] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:07.840577 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd4aaa-6a7f-48c4-a601-3ffb1847e4cc None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:07.840838 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd4aaa-6a7f-48c4-a601-3ffb1847e4cc None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:07.841119 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd4aaa-6a7f-48c4-a601-3ffb1847e4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:07.858870 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-61bd4aaa-6a7f-48c4-a601-3ffb1847e4cc None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:07.860144 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-61bd4aaa-6a7f-48c4-a601-3ffb1847e4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:07.931954 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 235/463] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:07.933219 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd4aaa-6a7f-48c4-a601-3ffb1847e4cc None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:07.952267 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e89c7-74cf-4e3d-ab1a-653b48b61745 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:07.989139 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c3125-b218-4d79-9fcb-c89e7c8e9856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:07.989897 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c3125-b218-4d79-9fcb-c89e7c8e9856 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:07.990345 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c3125-b218-4d79-9fcb-c89e7c8e9856 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:07.990767 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c3125-b218-4d79-9fcb-c89e7c8e9856 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:07.992264 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c3125-b218-4d79-9fcb-c89e7c8e9856 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:07.992743 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c3125-b218-4d79-9fcb-c89e7c8e9856 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:07.994270 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c3125-b218-4d79-9fcb-c89e7c8e9856 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:08.012285 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 229/464] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:08.013302 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c3125-b218-4d79-9fcb-c89e7c8e9856 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:08.050692 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd4aaa-6a7f-48c4-a601-3ffb1847e4cc None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:08.087903 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca954b-de5e-402f-a983-a91b2b33a63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:08.088571 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca954b-de5e-402f-a983-a91b2b33a63b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:08.088852 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca954b-de5e-402f-a983-a91b2b33a63b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:08.089126 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca954b-de5e-402f-a983-a91b2b33a63b None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:08.089851 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca954b-de5e-402f-a983-a91b2b33a63b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:08.090154 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca954b-de5e-402f-a983-a91b2b33a63b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:08.091513 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca954b-de5e-402f-a983-a91b2b33a63b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:08.102491 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 236/465] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:08.103787 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f413f2-52c3-40d6-ab4a-329db615bf54 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:08.104073 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f413f2-52c3-40d6-ab4a-329db615bf54 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:08.104346 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f413f2-52c3-40d6-ab4a-329db615bf54 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:08.105545 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 237/466] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:08.106402 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f413f2-52c3-40d6-ab4a-329db615bf54 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:08.119117 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c3125-b218-4d79-9fcb-c89e7c8e9856 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:08.152092 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a0395-8966-4ccd-9a60-2c3f0a937ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:08.152887 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a0395-8966-4ccd-9a60-2c3f0a937ab0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:08.153178 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a0395-8966-4ccd-9a60-2c3f0a937ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:08.153454 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a0395-8966-4ccd-9a60-2c3f0a937ab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:08.163239 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a0395-8966-4ccd-9a60-2c3f0a937ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:08.164745 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a0395-8966-4ccd-9a60-2c3f0a937ab0 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:08.182807 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-9d4a0395-8966-4ccd-9a60-2c3f0a937ab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:08.188595 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 230/467] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:08.188595 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a0395-8966-4ccd-9a60-2c3f0a937ab0 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:08.213275 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f413f2-52c3-40d6-ab4a-329db615bf54 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:08.249555 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f5f20-0416-46a6-a051-13f357764bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:08.250237 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f5f20-0416-46a6-a051-13f357764bd3 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:08.250526 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f5f20-0416-46a6-a051-13f357764bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:08.250805 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f5f20-0416-46a6-a051-13f357764bd3 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:08.251516 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f5f20-0416-46a6-a051-13f357764bd3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:08.252987 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f5f20-0416-46a6-a051-13f357764bd3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:08.283664 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 238/468] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Apr 11 13:42:08 2022] POST /identity/v3/users => generated 248 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:42:08.283664 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525830c-c459-4f1e-98a5-dd329ee80b5e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:08.283664 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525830c-c459-4f1e-98a5-dd329ee80b5e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:08.283664 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525830c-c459-4f1e-98a5-dd329ee80b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:08.300681 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-b525830c-c459-4f1e-98a5-dd329ee80b5e None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:08.301919 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b525830c-c459-4f1e-98a5-dd329ee80b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:08.305149 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a0395-8966-4ccd-9a60-2c3f0a937ab0 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:08.352462 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63721d60-28c7-44d3-9bbb-ee140f9b6498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:08.354009 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63721d60-28c7-44d3-9bbb-ee140f9b6498 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:08.354498 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63721d60-28c7-44d3-9bbb-ee140f9b6498 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:08.354992 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63721d60-28c7-44d3-9bbb-ee140f9b6498 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:08.355951 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63721d60-28c7-44d3-9bbb-ee140f9b6498 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:08.357638 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63721d60-28c7-44d3-9bbb-ee140f9b6498 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:08.384049 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 239/469] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:08.385052 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525830c-c459-4f1e-98a5-dd329ee80b5e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:08.386667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 231/470] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Apr 11 13:42:08 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:42:08.424077 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63721d60-28c7-44d3-9bbb-ee140f9b6498 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:08.542378 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63721d60-28c7-44d3-9bbb-ee140f9b6498 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:08.567219 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525830c-c459-4f1e-98a5-dd329ee80b5e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:08.577666 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59adaa9-5515-4b33-8540-d61bcffe7741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:08.578484 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59adaa9-5515-4b33-8540-d61bcffe7741 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:08.578764 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59adaa9-5515-4b33-8540-d61bcffe7741 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:08.579037 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59adaa9-5515-4b33-8540-d61bcffe7741 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:08.590597 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59adaa9-5515-4b33-8540-d61bcffe7741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:08.592114 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59adaa9-5515-4b33-8540-d61bcffe7741 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:08.609722 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3674103-aaa8-487f-9a39-18afe4c4308f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:08.610755 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3674103-aaa8-487f-9a39-18afe4c4308f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:08.610862 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-d59adaa9-5515-4b33-8540-d61bcffe7741 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:08.611330 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3674103-aaa8-487f-9a39-18afe4c4308f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:08.611993 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3674103-aaa8-487f-9a39-18afe4c4308f None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:08.612378 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 232/471] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:08.613282 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3674103-aaa8-487f-9a39-18afe4c4308f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:08.613662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3674103-aaa8-487f-9a39-18afe4c4308f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:08.615215 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3674103-aaa8-487f-9a39-18afe4c4308f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:08.618384 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59adaa9-5515-4b33-8540-d61bcffe7741 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:08.628188 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 240/472] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:08.631576 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432314c-7ec4-4858-b9c9-3331effd7ae7 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:08.632622 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432314c-7ec4-4858-b9c9-3331effd7ae7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:08.633319 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432314c-7ec4-4858-b9c9-3331effd7ae7 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:08.634924 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 241/473] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:08.636690 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432314c-7ec4-4858-b9c9-3331effd7ae7 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:08.740748 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59adaa9-5515-4b33-8540-d61bcffe7741 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:08.762823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432314c-7ec4-4858-b9c9-3331effd7ae7 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:08.783318 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65617b2-5173-4f4d-b4e8-903c4e8d1230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:08.784710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65617b2-5173-4f4d-b4e8-903c4e8d1230 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:08.785402 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65617b2-5173-4f4d-b4e8-903c4e8d1230 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:08.785841 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65617b2-5173-4f4d-b4e8-903c4e8d1230 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:08.786866 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65617b2-5173-4f4d-b4e8-903c4e8d1230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:08.787602 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65617b2-5173-4f4d-b4e8-903c4e8d1230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:08.789639 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65617b2-5173-4f4d-b4e8-903c4e8d1230 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:08.798105 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866f70a-273f-47a5-acd9-0b67c58eff23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:08.798771 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866f70a-273f-47a5-acd9-0b67c58eff23 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:08.799354 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866f70a-273f-47a5-acd9-0b67c58eff23 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:08.799469 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866f70a-273f-47a5-acd9-0b67c58eff23 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:08.800145 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866f70a-273f-47a5-acd9-0b67c58eff23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:08.801699 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866f70a-273f-47a5-acd9-0b67c58eff23 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:08.805845 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 233/474] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:08.807264 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1e7b1-8c91-48f5-ac66-0af7ce0818d0 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:08.807721 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1e7b1-8c91-48f5-ac66-0af7ce0818d0 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:08.808233 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1e7b1-8c91-48f5-ac66-0af7ce0818d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:08.828120 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-99d1e7b1-8c91-48f5-ac66-0af7ce0818d0 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:08.829771 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-99d1e7b1-8c91-48f5-ac66-0af7ce0818d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:08.831454 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 242/475] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Apr 11 13:42:08 2022] POST /identity/v3/users => generated 246 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:42:08.832536 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866f70a-273f-47a5-acd9-0b67c58eff23 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:08.903262 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 234/476] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:08.951312 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1e7b1-8c91-48f5-ac66-0af7ce0818d0 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:08.958803 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866f70a-273f-47a5-acd9-0b67c58eff23 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:08.998832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9b364-2ea3-4086-8e3a-51513107141c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:08.999524 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9b364-2ea3-4086-8e3a-51513107141c None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:08.999837 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9b364-2ea3-4086-8e3a-51513107141c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:09.000120 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9b364-2ea3-4086-8e3a-51513107141c None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:09.001211 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9b364-2ea3-4086-8e3a-51513107141c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:09.002857 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b9b364-2ea3-4086-8e3a-51513107141c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:09.036519 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 243/477] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Apr 11 13:42:08 2022] POST /identity/v3/users => generated 249 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:42:09.115573 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1e7b1-8c91-48f5-ac66-0af7ce0818d0 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:09.155078 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd3daa-8dc5-46c9-bf9a-5bd418fa8647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:09.155787 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd3daa-8dc5-46c9-bf9a-5bd418fa8647 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:09.156069 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd3daa-8dc5-46c9-bf9a-5bd418fa8647 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:09.156340 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd3daa-8dc5-46c9-bf9a-5bd418fa8647 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:09.157092 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd3daa-8dc5-46c9-bf9a-5bd418fa8647 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:09.158501 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dd3daa-8dc5-46c9-bf9a-5bd418fa8647 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:09.168843 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.sql.core [None req-d8dd3daa-8dc5-46c9-bf9a-5bd418fa8647 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 11 13:42:09.168843 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 11 13:42:09.168843 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [parameters: {'id': '80f3a52d4d6f4b23a2a0b1f102906c05', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 11 13:42:09.168843 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79786) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 11 13:42:09.183571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-d8dd3daa-8dc5-46c9-bf9a-5bd418fa8647 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 11 13:42:09.185358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 235/478] 10.222.0.67 () {60 vars in 1131 bytes} [Mon Apr 11 13:42:08 2022] POST /identity/v3/roles => generated 144 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:09.190899 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9b364-2ea3-4086-8e3a-51513107141c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:09.308641 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9b364-2ea3-4086-8e3a-51513107141c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:09.345963 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5dea32-71c5-4b77-975f-702ec85577fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:09.346796 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dea32-71c5-4b77-975f-702ec85577fa None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:09.347076 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dea32-71c5-4b77-975f-702ec85577fa None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:09.347351 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dea32-71c5-4b77-975f-702ec85577fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:09.363161 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5dea32-71c5-4b77-975f-702ec85577fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:09.371841 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-2b5dea32-71c5-4b77-975f-702ec85577fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 13:42:09.373327 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 244/479] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:42:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:09.384343 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd3daa-8dc5-46c9-bf9a-5bd418fa8647 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:09.500420 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dd3daa-8dc5-46c9-bf9a-5bd418fa8647 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:09.538633 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f7197-ffab-45a4-a4eb-effc2b8ab62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:09.539519 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f7197-ffab-45a4-a4eb-effc2b8ab62e None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:09.539825 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f7197-ffab-45a4-a4eb-effc2b8ab62e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:09.540099 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f7197-ffab-45a4-a4eb-effc2b8ab62e None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:09.540860 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f7197-ffab-45a4-a4eb-effc2b8ab62e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:09.541165 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f7197-ffab-45a4-a4eb-effc2b8ab62e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:09.542554 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f7197-ffab-45a4-a4eb-effc2b8ab62e None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:09.551965 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 236/480] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:11.137768 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1dde7-a327-4d03-adeb-712847cd2ef2 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:11.138793 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1dde7-a327-4d03-adeb-712847cd2ef2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:11.139277 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1dde7-a327-4d03-adeb-712847cd2ef2 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:11.141500 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353053b-2129-4dc8-9416-5bb3e431fc6c None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:11.141876 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353053b-2129-4dc8-9416-5bb3e431fc6c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:11.142065 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353053b-2129-4dc8-9416-5bb3e431fc6c None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:11.142259 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 245/481] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:11.143615 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 237/482] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:11.146026 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb031c-6182-49b7-abfc-fd44898a03b8 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:11.146310 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb031c-6182-49b7-abfc-fd44898a03b8 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:11.146588 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb031c-6182-49b7-abfc-fd44898a03b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:11.151324 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0eb62-a0d3-4d8e-ac70-929515cacd26 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:11.151612 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0eb62-a0d3-4d8e-ac70-929515cacd26 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:11.151921 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0eb62-a0d3-4d8e-ac70-929515cacd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:11.164445 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-0fdb031c-6182-49b7-abfc-fd44898a03b8 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:11.165730 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0fdb031c-6182-49b7-abfc-fd44898a03b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:11.176647 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-25a0eb62-a0d3-4d8e-ac70-929515cacd26 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:11.177862 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-25a0eb62-a0d3-4d8e-ac70-929515cacd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:11.234057 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 246/483] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:42:11.271829 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 238/484] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:42:11.280280 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb031c-6182-49b7-abfc-fd44898a03b8 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:11.320540 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0eb62-a0d3-4d8e-ac70-929515cacd26 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:11.458978 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb031c-6182-49b7-abfc-fd44898a03b8 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:11.517446 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0eb62-a0d3-4d8e-ac70-929515cacd26 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:11.527973 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96399c-50e7-46c8-8ab8-492415051afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:11.528795 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96399c-50e7-46c8-8ab8-492415051afe None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:11.529076 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96399c-50e7-46c8-8ab8-492415051afe None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:11.529349 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96399c-50e7-46c8-8ab8-492415051afe None admin] PATH_INFO: `/v3/roles/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:11.549144 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96399c-50e7-46c8-8ab8-492415051afe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:11.560849 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-ed96399c-50e7-46c8-8ab8-492415051afe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:42:11.567766 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 247/485] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:42:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:11.568581 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96399c-50e7-46c8-8ab8-492415051afe None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:11.587025 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8f9d5-7b2b-4c45-9fbe-bca4eac30743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:11.587869 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8f9d5-7b2b-4c45-9fbe-bca4eac30743 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:11.588155 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8f9d5-7b2b-4c45-9fbe-bca4eac30743 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:11.588431 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8f9d5-7b2b-4c45-9fbe-bca4eac30743 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:11.608876 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8f9d5-7b2b-4c45-9fbe-bca4eac30743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:11.615956 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-a8f8f9d5-7b2b-4c45-9fbe-bca4eac30743 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:42:11.617806 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 239/486] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:42:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:11.624447 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8f9d5-7b2b-4c45-9fbe-bca4eac30743 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:11.760602 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96399c-50e7-46c8-8ab8-492415051afe None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:11.783207 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8f9d5-7b2b-4c45-9fbe-bca4eac30743 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:11.798817 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ae38d-610f-4528-9d51-4b03a116d962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:11.799935 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ae38d-610f-4528-9d51-4b03a116d962 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:11.800415 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ae38d-610f-4528-9d51-4b03a116d962 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:11.800883 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ae38d-610f-4528-9d51-4b03a116d962 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:11.801839 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ae38d-610f-4528-9d51-4b03a116d962 None admin] RBAC: Adding query filter params (name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:11.802333 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ae38d-610f-4528-9d51-4b03a116d962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:11.804120 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ae38d-610f-4528-9d51-4b03a116d962 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:11.812823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 248/487] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Apr 11 13:42:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:11.814488 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20f9e9-5b12-4a38-95f8-a970912c5aad None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:11.814873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20f9e9-5b12-4a38-95f8-a970912c5aad None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:11.815243 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20f9e9-5b12-4a38-95f8-a970912c5aad None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:11.818047 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b7653-3a12-4f90-8470-677f7037d7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:11.818885 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b7653-3a12-4f90-8470-677f7037d7b5 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:11.819708 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b7653-3a12-4f90-8470-677f7037d7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:11.820319 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b7653-3a12-4f90-8470-677f7037d7b5 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:11.820969 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 249/488] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:11.821453 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b7653-3a12-4f90-8470-677f7037d7b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:11.821905 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b7653-3a12-4f90-8470-677f7037d7b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:11.822016 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20f9e9-5b12-4a38-95f8-a970912c5aad None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:11.823603 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b7653-3a12-4f90-8470-677f7037d7b5 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:11.832941 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 240/489] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Apr 11 13:42:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:11.834482 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fd85b-3db7-46fd-a6c3-0af633e9c56a None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:11.835430 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fd85b-3db7-46fd-a6c3-0af633e9c56a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:11.835931 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fd85b-3db7-46fd-a6c3-0af633e9c56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:11.853489 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-7b5fd85b-3db7-46fd-a6c3-0af633e9c56a None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:11.855010 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7b5fd85b-3db7-46fd-a6c3-0af633e9c56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:11.927064 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 241/490] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:11.929352 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fd85b-3db7-46fd-a6c3-0af633e9c56a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:11.942020 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20f9e9-5b12-4a38-95f8-a970912c5aad None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:11.993884 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4814b87-f118-4ed4-9c4b-ad2dcc0a446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:11.994685 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4814b87-f118-4ed4-9c4b-ad2dcc0a446c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:11.994965 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4814b87-f118-4ed4-9c4b-ad2dcc0a446c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:11.995278 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4814b87-f118-4ed4-9c4b-ad2dcc0a446c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:12.005879 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4814b87-f118-4ed4-9c4b-ad2dcc0a446c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:12.007394 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4814b87-f118-4ed4-9c4b-ad2dcc0a446c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:12.024528 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-f4814b87-f118-4ed4-9c4b-ad2dcc0a446c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:12.026164 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 250/491] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:12.026995 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4814b87-f118-4ed4-9c4b-ad2dcc0a446c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:12.034785 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fd85b-3db7-46fd-a6c3-0af633e9c56a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:12.073486 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec048d54-ea89-48ca-8150-cc52c372a887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:12.074645 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec048d54-ea89-48ca-8150-cc52c372a887 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:12.075383 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec048d54-ea89-48ca-8150-cc52c372a887 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:12.075892 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec048d54-ea89-48ca-8150-cc52c372a887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:12.088050 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec048d54-ea89-48ca-8150-cc52c372a887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:12.089853 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec048d54-ea89-48ca-8150-cc52c372a887 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:12.113932 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-ec048d54-ea89-48ca-8150-cc52c372a887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:12.115915 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 242/492] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:12.117212 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec048d54-ea89-48ca-8150-cc52c372a887 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:12.138720 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4814b87-f118-4ed4-9c4b-ad2dcc0a446c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:12.184175 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f27963-4ca5-48f5-ba1b-0aec3ae2cb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:12.185344 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f27963-4ca5-48f5-ba1b-0aec3ae2cb4c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:12.185992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f27963-4ca5-48f5-ba1b-0aec3ae2cb4c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:12.186942 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f27963-4ca5-48f5-ba1b-0aec3ae2cb4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:12.202587 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f27963-4ca5-48f5-ba1b-0aec3ae2cb4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:12.213243 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-25f27963-4ca5-48f5-ba1b-0aec3ae2cb4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:42:12.216024 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 251/493] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:42:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:12.217143 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f27963-4ca5-48f5-ba1b-0aec3ae2cb4c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:12.229391 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec048d54-ea89-48ca-8150-cc52c372a887 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:12.264178 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf848f-48a1-48f0-9dd0-4e9d18f2ede3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:12.264871 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf848f-48a1-48f0-9dd0-4e9d18f2ede3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:12.265152 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf848f-48a1-48f0-9dd0-4e9d18f2ede3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:12.265423 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf848f-48a1-48f0-9dd0-4e9d18f2ede3 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:12.266147 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf848f-48a1-48f0-9dd0-4e9d18f2ede3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:12.266447 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf848f-48a1-48f0-9dd0-4e9d18f2ede3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:12.267849 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf848f-48a1-48f0-9dd0-4e9d18f2ede3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:12.280787 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 243/494] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:12.281408 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf848f-48a1-48f0-9dd0-4e9d18f2ede3 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:12.331022 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f27963-4ca5-48f5-ba1b-0aec3ae2cb4c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:12.369723 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1b6cc-52ec-4c70-8234-c2bc11c433ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:12.370398 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1b6cc-52ec-4c70-8234-c2bc11c433ef None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:12.370678 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1b6cc-52ec-4c70-8234-c2bc11c433ef None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:12.370953 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1b6cc-52ec-4c70-8234-c2bc11c433ef None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:12.371689 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1b6cc-52ec-4c70-8234-c2bc11c433ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:12.371996 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1b6cc-52ec-4c70-8234-c2bc11c433ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:12.373353 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1b6cc-52ec-4c70-8234-c2bc11c433ef None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:12.380027 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf848f-48a1-48f0-9dd0-4e9d18f2ede3 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:12.391672 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 252/495] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:12.391672 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0052e-4060-468d-9008-e72a304f9d68 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:12.391672 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0052e-4060-468d-9008-e72a304f9d68 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:12.391672 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0052e-4060-468d-9008-e72a304f9d68 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:12.391672 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 253/496] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:12.392092 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0052e-4060-468d-9008-e72a304f9d68 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:12.414985 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67882b2c-303d-4650-a6b9-47f4c2b1ff98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:12.415694 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67882b2c-303d-4650-a6b9-47f4c2b1ff98 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:12.415984 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67882b2c-303d-4650-a6b9-47f4c2b1ff98 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:12.416262 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67882b2c-303d-4650-a6b9-47f4c2b1ff98 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:12.417015 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67882b2c-303d-4650-a6b9-47f4c2b1ff98 None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:12.417327 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67882b2c-303d-4650-a6b9-47f4c2b1ff98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:12.418719 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67882b2c-303d-4650-a6b9-47f4c2b1ff98 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:12.426686 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 244/497] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Apr 11 13:42:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:12.427503 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67882b2c-303d-4650-a6b9-47f4c2b1ff98 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:12.504859 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0052e-4060-468d-9008-e72a304f9d68 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:12.524459 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67882b2c-303d-4650-a6b9-47f4c2b1ff98 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:12.538557 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d3afa-c64d-4c15-952b-659a10825720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:12.539297 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d3afa-c64d-4c15-952b-659a10825720 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:12.539579 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d3afa-c64d-4c15-952b-659a10825720 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:12.539884 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d3afa-c64d-4c15-952b-659a10825720 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:12.547021 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d3afa-c64d-4c15-952b-659a10825720 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:12.548523 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37d3afa-c64d-4c15-952b-659a10825720 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:12.562844 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d487f1-aeb9-40c8-94d3-3ab8edf5c142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:12.563020 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-f37d3afa-c64d-4c15-952b-659a10825720 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 11 13:42:12.563646 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d487f1-aeb9-40c8-94d3-3ab8edf5c142 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:12.563945 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d487f1-aeb9-40c8-94d3-3ab8edf5c142 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:12.564352 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 254/498] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:42:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:12.565419 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b18b76-344b-4006-ace9-e904403b7d9e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:12.565706 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b18b76-344b-4006-ace9-e904403b7d9e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:12.565982 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b18b76-344b-4006-ace9-e904403b7d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:12.568672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d487f1-aeb9-40c8-94d3-3ab8edf5c142 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:12.577804 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d487f1-aeb9-40c8-94d3-3ab8edf5c142 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:12.579272 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d487f1-aeb9-40c8-94d3-3ab8edf5c142 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:12.582101 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-69b18b76-344b-4006-ace9-e904403b7d9e None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:12.583275 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-69b18b76-344b-4006-ace9-e904403b7d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:12.593103 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-83d487f1-aeb9-40c8-94d3-3ab8edf5c142 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 11 13:42:12.594667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 245/499] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:42:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:12.595497 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d487f1-aeb9-40c8-94d3-3ab8edf5c142 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:12.648741 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 255/500] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:12.649581 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b18b76-344b-4006-ace9-e904403b7d9e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:12.692245 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d487f1-aeb9-40c8-94d3-3ab8edf5c142 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:12.723917 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf588b-3108-436d-af82-2e68ea1858f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:12.724703 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf588b-3108-436d-af82-2e68ea1858f2 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:12.724983 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf588b-3108-436d-af82-2e68ea1858f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:12.725288 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf588b-3108-436d-af82-2e68ea1858f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:12.735889 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf588b-3108-436d-af82-2e68ea1858f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:12.737339 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf588b-3108-436d-af82-2e68ea1858f2 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:12.743522 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b18b76-344b-4006-ace9-e904403b7d9e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:12.752922 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-aedf588b-3108-436d-af82-2e68ea1858f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:12.754104 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 246/501] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:12.755277 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319d828-f252-4d1d-8ae0-1d41b50e6747 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:12.755554 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319d828-f252-4d1d-8ae0-1d41b50e6747 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:12.755845 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319d828-f252-4d1d-8ae0-1d41b50e6747 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:12.757129 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 247/502] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:12.759660 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319d828-f252-4d1d-8ae0-1d41b50e6747 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:12.776768 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce70b33-0f35-4402-9709-5dd2c4579ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:12.777442 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce70b33-0f35-4402-9709-5dd2c4579ac3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:12.777729 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce70b33-0f35-4402-9709-5dd2c4579ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:12.778008 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce70b33-0f35-4402-9709-5dd2c4579ac3 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:12.778844 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce70b33-0f35-4402-9709-5dd2c4579ac3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:12.779153 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce70b33-0f35-4402-9709-5dd2c4579ac3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:12.780623 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce70b33-0f35-4402-9709-5dd2c4579ac3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:12.816517 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 256/503] 10.222.0.67 () {56 vars in 1137 bytes} [Mon Apr 11 13:42:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:12.817530 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce70b33-0f35-4402-9709-5dd2c4579ac3 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:12.856492 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319d828-f252-4d1d-8ae0-1d41b50e6747 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:12.887382 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd3d95-3912-4af2-bdf9-1dc0661277b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:12.888068 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd3d95-3912-4af2-bdf9-1dc0661277b2 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:12.888349 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd3d95-3912-4af2-bdf9-1dc0661277b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:12.888625 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd3d95-3912-4af2-bdf9-1dc0661277b2 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:12.889447 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd3d95-3912-4af2-bdf9-1dc0661277b2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:12.889748 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd3d95-3912-4af2-bdf9-1dc0661277b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:12.891171 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd3d95-3912-4af2-bdf9-1dc0661277b2 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:12.910558 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce70b33-0f35-4402-9709-5dd2c4579ac3 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:12.926545 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 248/504] 10.222.0.67 () {56 vars in 1137 bytes} [Mon Apr 11 13:42:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:12.927357 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd3d95-3912-4af2-bdf9-1dc0661277b2 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:12.943896 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c176a-ae78-4179-96bc-7a8bbd3457a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:12.945223 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c176a-ae78-4179-96bc-7a8bbd3457a2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:12.945506 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c176a-ae78-4179-96bc-7a8bbd3457a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:12.945782 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c176a-ae78-4179-96bc-7a8bbd3457a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:12.956022 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c176a-ae78-4179-96bc-7a8bbd3457a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:12.963846 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-a74c176a-ae78-4179-96bc-7a8bbd3457a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:42:12.965034 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 257/505] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:42:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:12.966253 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca86d6-7de2-4ad6-a9e4-c2265b89979f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:12.966545 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca86d6-7de2-4ad6-a9e4-c2265b89979f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:12.966824 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca86d6-7de2-4ad6-a9e4-c2265b89979f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:12.982708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-8eca86d6-7de2-4ad6-a9e4-c2265b89979f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:12.983935 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8eca86d6-7de2-4ad6-a9e4-c2265b89979f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:13.021429 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd3d95-3912-4af2-bdf9-1dc0661277b2 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:13.047218 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 258/506] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:13.048085 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca86d6-7de2-4ad6-a9e4-c2265b89979f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:13.054052 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e90da-81a7-46b2-aa21-a166206321a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:13.054713 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e90da-81a7-46b2-aa21-a166206321a8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:13.054997 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e90da-81a7-46b2-aa21-a166206321a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:13.055274 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e90da-81a7-46b2-aa21-a166206321a8 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:13.056022 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e90da-81a7-46b2-aa21-a166206321a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:13.056336 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e90da-81a7-46b2-aa21-a166206321a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:13.057724 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e90da-81a7-46b2-aa21-a166206321a8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:13.068884 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 249/507] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:13.073002 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e90da-81a7-46b2-aa21-a166206321a8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:13.141550 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca86d6-7de2-4ad6-a9e4-c2265b89979f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:13.166777 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e90da-81a7-46b2-aa21-a166206321a8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:13.173465 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc259d-468c-4606-87ba-7e7fc01f9cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:13.174117 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc259d-468c-4606-87ba-7e7fc01f9cf4 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:13.174400 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc259d-468c-4606-87ba-7e7fc01f9cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:13.174675 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc259d-468c-4606-87ba-7e7fc01f9cf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:13.198222 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd33bc-17bc-4581-87bf-495d2b717386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:13.198859 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd33bc-17bc-4581-87bf-495d2b717386 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:13.199142 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd33bc-17bc-4581-87bf-495d2b717386 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:13.199418 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd33bc-17bc-4581-87bf-495d2b717386 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:13.238362 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc259d-468c-4606-87ba-7e7fc01f9cf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:13.239860 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc259d-468c-4606-87ba-7e7fc01f9cf4 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:13.262313 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd33bc-17bc-4581-87bf-495d2b717386 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:13.263819 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd33bc-17bc-4581-87bf-495d2b717386 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:13.333102 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 259/508] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:42:13.333857 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc259d-468c-4606-87ba-7e7fc01f9cf4 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:13.360499 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 250/509] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:42:13.361329 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd33bc-17bc-4581-87bf-495d2b717386 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:13.435260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc259d-468c-4606-87ba-7e7fc01f9cf4 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:13.456331 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd33bc-17bc-4581-87bf-495d2b717386 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:13.467010 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fdb6d-df42-499a-8cc8-e1b5909011b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:13.467703 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fdb6d-df42-499a-8cc8-e1b5909011b8 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:13.467985 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fdb6d-df42-499a-8cc8-e1b5909011b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:13.468257 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fdb6d-df42-499a-8cc8-e1b5909011b8 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:13.468989 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fdb6d-df42-499a-8cc8-e1b5909011b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:13.469287 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fdb6d-df42-499a-8cc8-e1b5909011b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:13.470671 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fdb6d-df42-499a-8cc8-e1b5909011b8 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:13.478102 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 260/510] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Apr 11 13:42:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:13.478870 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fdb6d-df42-499a-8cc8-e1b5909011b8 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:13.494144 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3b479-f7be-4c2a-83b9-d9ba78615b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:13.494936 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3b479-f7be-4c2a-83b9-d9ba78615b70 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:13.495218 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3b479-f7be-4c2a-83b9-d9ba78615b70 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:13.495491 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3b479-f7be-4c2a-83b9-d9ba78615b70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:13.509549 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3b479-f7be-4c2a-83b9-d9ba78615b70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:13.512392 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3b479-f7be-4c2a-83b9-d9ba78615b70 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:13.529642 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-04d3b479-f7be-4c2a-83b9-d9ba78615b70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:13.530840 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 251/511] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:13.531615 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3b479-f7be-4c2a-83b9-d9ba78615b70 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:13.572216 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fdb6d-df42-499a-8cc8-e1b5909011b8 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:13.603247 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8807b75-6919-4d2c-b11a-fc1aa034e141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:13.603987 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8807b75-6919-4d2c-b11a-fc1aa034e141 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:13.604272 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8807b75-6919-4d2c-b11a-fc1aa034e141 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:13.604550 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8807b75-6919-4d2c-b11a-fc1aa034e141 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:13.611655 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8807b75-6919-4d2c-b11a-fc1aa034e141 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:13.613089 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8807b75-6919-4d2c-b11a-fc1aa034e141 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:13.626844 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-a8807b75-6919-4d2c-b11a-fc1aa034e141 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 13:42:13.627328 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3b479-f7be-4c2a-83b9-d9ba78615b70 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:13.628048 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 261/512] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Apr 11 13:42:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:13.628816 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8807b75-6919-4d2c-b11a-fc1aa034e141 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:13.661350 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49702fb8-b1d5-465d-b393-85b0fdb150b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:13.662238 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49702fb8-b1d5-465d-b393-85b0fdb150b9 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:13.662592 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49702fb8-b1d5-465d-b393-85b0fdb150b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:13.662942 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49702fb8-b1d5-465d-b393-85b0fdb150b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:13.673326 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49702fb8-b1d5-465d-b393-85b0fdb150b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:13.674788 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49702fb8-b1d5-465d-b393-85b0fdb150b9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:13.691591 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-49702fb8-b1d5-465d-b393-85b0fdb150b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:13.692795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 252/513] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:13.693568 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49702fb8-b1d5-465d-b393-85b0fdb150b9 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:13.722228 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8807b75-6919-4d2c-b11a-fc1aa034e141 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:13.754371 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836a4c5-b46c-46dc-8739-1f3719484556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:13.755153 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836a4c5-b46c-46dc-8739-1f3719484556 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:13.755436 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836a4c5-b46c-46dc-8739-1f3719484556 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:13.755746 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836a4c5-b46c-46dc-8739-1f3719484556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:13.765940 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836a4c5-b46c-46dc-8739-1f3719484556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:13.767400 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836a4c5-b46c-46dc-8739-1f3719484556 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:13.783441 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-4836a4c5-b46c-46dc-8739-1f3719484556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:13.784644 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 262/514] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:13.785412 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836a4c5-b46c-46dc-8739-1f3719484556 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:13.790956 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49702fb8-b1d5-465d-b393-85b0fdb150b9 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:13.823030 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dffba-f8ff-4a0e-a690-02a648a8d450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:13.823856 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dffba-f8ff-4a0e-a690-02a648a8d450 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:13.824142 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dffba-f8ff-4a0e-a690-02a648a8d450 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:13.824416 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dffba-f8ff-4a0e-a690-02a648a8d450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:13.834137 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118dffba-f8ff-4a0e-a690-02a648a8d450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:13.835669 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118dffba-f8ff-4a0e-a690-02a648a8d450 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:13.852511 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-118dffba-f8ff-4a0e-a690-02a648a8d450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:13.853751 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 253/515] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:13.854463 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dffba-f8ff-4a0e-a690-02a648a8d450 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:13.880202 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836a4c5-b46c-46dc-8739-1f3719484556 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:13.911480 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699a92f-1e3b-454e-b040-aa490bce1a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:13.912162 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699a92f-1e3b-454e-b040-aa490bce1a43 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:13.912451 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699a92f-1e3b-454e-b040-aa490bce1a43 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:13.913252 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699a92f-1e3b-454e-b040-aa490bce1a43 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:13.913967 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699a92f-1e3b-454e-b040-aa490bce1a43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:13.914274 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699a92f-1e3b-454e-b040-aa490bce1a43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:13.915667 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699a92f-1e3b-454e-b040-aa490bce1a43 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:13.927470 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 263/516] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:13.928397 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699a92f-1e3b-454e-b040-aa490bce1a43 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:13.953043 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dffba-f8ff-4a0e-a690-02a648a8d450 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:13.985257 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e54ac6-6f2e-4c2e-9e14-5feec161d8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:13.986161 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e54ac6-6f2e-4c2e-9e14-5feec161d8ac None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:13.986445 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e54ac6-6f2e-4c2e-9e14-5feec161d8ac None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:13.986715 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e54ac6-6f2e-4c2e-9e14-5feec161d8ac None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:13.987550 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e54ac6-6f2e-4c2e-9e14-5feec161d8ac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:13.987888 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e54ac6-6f2e-4c2e-9e14-5feec161d8ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:13.989795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e54ac6-6f2e-4c2e-9e14-5feec161d8ac None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:14.007819 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 254/517] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Apr 11 13:42:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:14.008501 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e54ac6-6f2e-4c2e-9e14-5feec161d8ac None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:14.026587 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699a92f-1e3b-454e-b040-aa490bce1a43 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:14.058101 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bb557-f2b6-48ff-a724-ab6848b4e983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:14.058758 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bb557-f2b6-48ff-a724-ab6848b4e983 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:14.059040 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bb557-f2b6-48ff-a724-ab6848b4e983 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:14.059318 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bb557-f2b6-48ff-a724-ab6848b4e983 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:14.060066 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bb557-f2b6-48ff-a724-ab6848b4e983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:14.060374 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bb557-f2b6-48ff-a724-ab6848b4e983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:14.061745 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bb557-f2b6-48ff-a724-ab6848b4e983 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:14.072873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 264/518] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:14.073655 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bb557-f2b6-48ff-a724-ab6848b4e983 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:14.100744 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e54ac6-6f2e-4c2e-9e14-5feec161d8ac None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:14.133841 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e63e8-a5c5-4cd4-a249-e73695df04e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:14.134496 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e63e8-a5c5-4cd4-a249-e73695df04e4 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:14.134780 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e63e8-a5c5-4cd4-a249-e73695df04e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:14.135056 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e63e8-a5c5-4cd4-a249-e73695df04e4 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:14.135810 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e63e8-a5c5-4cd4-a249-e73695df04e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:14.136117 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e63e8-a5c5-4cd4-a249-e73695df04e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:14.137497 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e63e8-a5c5-4cd4-a249-e73695df04e4 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:14.148399 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 255/519] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:14.148990 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e63e8-a5c5-4cd4-a249-e73695df04e4 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:14.169334 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bb557-f2b6-48ff-a724-ab6848b4e983 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:14.201287 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26e3f4-cdaa-4dc9-a33d-14d395833d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:14.201942 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26e3f4-cdaa-4dc9-a33d-14d395833d0d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:14.202225 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26e3f4-cdaa-4dc9-a33d-14d395833d0d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:14.202503 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26e3f4-cdaa-4dc9-a33d-14d395833d0d None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:14.203220 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26e3f4-cdaa-4dc9-a33d-14d395833d0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:14.203527 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26e3f4-cdaa-4dc9-a33d-14d395833d0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:14.204908 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26e3f4-cdaa-4dc9-a33d-14d395833d0d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:14.215977 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 265/520] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:14.216755 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26e3f4-cdaa-4dc9-a33d-14d395833d0d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:14.243083 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e63e8-a5c5-4cd4-a249-e73695df04e4 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:14.274920 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd335e-38af-4c6b-80cd-2cea9502cad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:14.275578 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd335e-38af-4c6b-80cd-2cea9502cad6 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:14.275891 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd335e-38af-4c6b-80cd-2cea9502cad6 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:14.276168 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd335e-38af-4c6b-80cd-2cea9502cad6 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:14.276869 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd335e-38af-4c6b-80cd-2cea9502cad6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:14.278302 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd335e-38af-4c6b-80cd-2cea9502cad6 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:14.297601 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 256/521] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Apr 11 13:42:14 2022] POST /identity/v3/users => generated 247 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:42:14.298458 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd335e-38af-4c6b-80cd-2cea9502cad6 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:14.310354 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26e3f4-cdaa-4dc9-a33d-14d395833d0d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:14.347821 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49c3fb-0e37-4372-b0aa-2097ec212d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:14.348797 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49c3fb-0e37-4372-b0aa-2097ec212d48 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:14.349267 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49c3fb-0e37-4372-b0aa-2097ec212d48 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:14.349751 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49c3fb-0e37-4372-b0aa-2097ec212d48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:14.411512 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd335e-38af-4c6b-80cd-2cea9502cad6 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:14.424607 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49c3fb-0e37-4372-b0aa-2097ec212d48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:14.426417 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49c3fb-0e37-4372-b0aa-2097ec212d48 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:14.448734 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600f600-9794-493f-840f-504596bae325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:14.449552 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600f600-9794-493f-840f-504596bae325 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:14.450087 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600f600-9794-493f-840f-504596bae325 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:14.450367 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600f600-9794-493f-840f-504596bae325 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:14.457539 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600f600-9794-493f-840f-504596bae325 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:14.459033 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600f600-9794-493f-840f-504596bae325 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:14.473368 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-a600f600-9794-493f-840f-504596bae325 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:14.474654 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 257/522] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:14.475993 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600f600-9794-493f-840f-504596bae325 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:14.540646 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 266/523] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:42:14.541506 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49c3fb-0e37-4372-b0aa-2097ec212d48 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:14.587424 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600f600-9794-493f-840f-504596bae325 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:14.622136 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c42fe6-daae-4359-865d-f4b607ae00da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:14.622928 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c42fe6-daae-4359-865d-f4b607ae00da None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:14.623213 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c42fe6-daae-4359-865d-f4b607ae00da None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:14.623495 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c42fe6-daae-4359-865d-f4b607ae00da None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:14.630548 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c42fe6-daae-4359-865d-f4b607ae00da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:14.632252 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c42fe6-daae-4359-865d-f4b607ae00da None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:14.637347 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49c3fb-0e37-4372-b0aa-2097ec212d48 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:14.645418 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-b9c42fe6-daae-4359-865d-f4b607ae00da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:14.646674 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 258/524] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:14.647683 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c42fe6-daae-4359-865d-f4b607ae00da None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:14.681542 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3779c-bc77-4332-971f-995f63ab4dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:14.682607 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3779c-bc77-4332-971f-995f63ab4dbb None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:14.683038 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3779c-bc77-4332-971f-995f63ab4dbb None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:14.683479 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3779c-bc77-4332-971f-995f63ab4dbb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:14.690811 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3779c-bc77-4332-971f-995f63ab4dbb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:14.692339 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3779c-bc77-4332-971f-995f63ab4dbb None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:14.706517 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-c9d3779c-bc77-4332-971f-995f63ab4dbb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 11 13:42:14.712567 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 267/525] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:42:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:14.712567 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3779c-bc77-4332-971f-995f63ab4dbb None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:14.758127 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c42fe6-daae-4359-865d-f4b607ae00da None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:14.790230 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbe78f-4108-49c9-8b6a-8a0d56c0312b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:14.790881 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbe78f-4108-49c9-8b6a-8a0d56c0312b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:14.791161 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbe78f-4108-49c9-8b6a-8a0d56c0312b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:14.791432 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbe78f-4108-49c9-8b6a-8a0d56c0312b None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:14.792245 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbe78f-4108-49c9-8b6a-8a0d56c0312b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:14.792552 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbe78f-4108-49c9-8b6a-8a0d56c0312b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:14.793980 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbe78f-4108-49c9-8b6a-8a0d56c0312b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:14.816040 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 259/526] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:14.816040 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbe78f-4108-49c9-8b6a-8a0d56c0312b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:14.816299 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3779c-bc77-4332-971f-995f63ab4dbb None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:14.849305 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e30e6-cd92-41d5-be2a-86dc107b45c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:14.850122 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e30e6-cd92-41d5-be2a-86dc107b45c9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:14.850566 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e30e6-cd92-41d5-be2a-86dc107b45c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:14.850912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e30e6-cd92-41d5-be2a-86dc107b45c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:14.860730 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e30e6-cd92-41d5-be2a-86dc107b45c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:14.862168 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e30e6-cd92-41d5-be2a-86dc107b45c9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:14.879105 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-b78e30e6-cd92-41d5-be2a-86dc107b45c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:14.884885 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 268/527] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:14.884885 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e30e6-cd92-41d5-be2a-86dc107b45c9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:14.914993 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbe78f-4108-49c9-8b6a-8a0d56c0312b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:14.950245 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3b561-3106-401c-99e0-cffb05d3b275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:14.950823 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3b561-3106-401c-99e0-cffb05d3b275 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:14.951102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3b561-3106-401c-99e0-cffb05d3b275 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:14.951374 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3b561-3106-401c-99e0-cffb05d3b275 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:14.952187 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3b561-3106-401c-99e0-cffb05d3b275 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:14.952486 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3b561-3106-401c-99e0-cffb05d3b275 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:14.953925 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3b561-3106-401c-99e0-cffb05d3b275 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:14.966110 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 260/528] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:14.966979 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3b561-3106-401c-99e0-cffb05d3b275 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:14.985605 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e30e6-cd92-41d5-be2a-86dc107b45c9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:15.019545 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99240afb-5866-4ddc-866a-7a87914f5c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:15.020245 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99240afb-5866-4ddc-866a-7a87914f5c36 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:15.020527 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99240afb-5866-4ddc-866a-7a87914f5c36 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:15.020802 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99240afb-5866-4ddc-866a-7a87914f5c36 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:15.021669 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99240afb-5866-4ddc-866a-7a87914f5c36 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:15.022497 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99240afb-5866-4ddc-866a-7a87914f5c36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:15.023959 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99240afb-5866-4ddc-866a-7a87914f5c36 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:15.043450 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 269/529] 10.222.0.67 () {56 vars in 1139 bytes} [Mon Apr 11 13:42:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:15.044593 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99240afb-5866-4ddc-866a-7a87914f5c36 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:15.076428 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3b561-3106-401c-99e0-cffb05d3b275 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:15.108513 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d4b94-9912-4550-87f2-d37db4f41451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:15.109164 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d4b94-9912-4550-87f2-d37db4f41451 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:15.109442 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d4b94-9912-4550-87f2-d37db4f41451 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:15.109709 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d4b94-9912-4550-87f2-d37db4f41451 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:15.110538 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d4b94-9912-4550-87f2-d37db4f41451 None admin] RBAC: Adding query filter params (role.id=c190a911c52940bb9b0fc255a4f7cad3, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=08cbf69574af4e25b940ec038f9e1bd1) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:15.110844 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d4b94-9912-4550-87f2-d37db4f41451 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:15.112305 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d4b94-9912-4550-87f2-d37db4f41451 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:15.118186 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 261/530] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:42:14 2022] GET /identity/v3/role_assignments?user.id=08cbf69574af4e25b940ec038f9e1bd1&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=c190a911c52940bb9b0fc255a4f7cad3 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:15.118967 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d4b94-9912-4550-87f2-d37db4f41451 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:15.155319 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99240afb-5866-4ddc-866a-7a87914f5c36 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:15.192263 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1855976-890a-4baf-bdca-d3aac6c671e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:15.192932 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1855976-890a-4baf-bdca-d3aac6c671e3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:15.193216 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1855976-890a-4baf-bdca-d3aac6c671e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:15.193490 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1855976-890a-4baf-bdca-d3aac6c671e3 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:15.194904 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1855976-890a-4baf-bdca-d3aac6c671e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:15.195207 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1855976-890a-4baf-bdca-d3aac6c671e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:15.196631 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1855976-890a-4baf-bdca-d3aac6c671e3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:15.213584 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 270/531] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:15.213584 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1855976-890a-4baf-bdca-d3aac6c671e3 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:15.242316 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d4b94-9912-4550-87f2-d37db4f41451 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:15.278104 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24f9e0-8aa5-4488-a8ca-1aca426a3406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:15.278776 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24f9e0-8aa5-4488-a8ca-1aca426a3406 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:15.279044 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24f9e0-8aa5-4488-a8ca-1aca426a3406 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:15.279204 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24f9e0-8aa5-4488-a8ca-1aca426a3406 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:15.280083 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24f9e0-8aa5-4488-a8ca-1aca426a3406 None admin] RBAC: Adding query filter params (role.id=c190a911c52940bb9b0fc255a4f7cad3, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=af2e8f671cba49969ccf9e13778b5052) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:15.280393 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24f9e0-8aa5-4488-a8ca-1aca426a3406 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:15.281865 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24f9e0-8aa5-4488-a8ca-1aca426a3406 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:15.296015 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 262/532] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:42:15 2022] GET /identity/v3/role_assignments?user.id=af2e8f671cba49969ccf9e13778b5052&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=c190a911c52940bb9b0fc255a4f7cad3 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:15.297059 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24f9e0-8aa5-4488-a8ca-1aca426a3406 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:15.332791 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1855976-890a-4baf-bdca-d3aac6c671e3 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:15.369511 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f04f3-8104-4569-bd7c-becfe405c13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:15.370243 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f04f3-8104-4569-bd7c-becfe405c13d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:15.370534 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f04f3-8104-4569-bd7c-becfe405c13d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:15.370816 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072f04f3-8104-4569-bd7c-becfe405c13d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:15.421915 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24f9e0-8aa5-4488-a8ca-1aca426a3406 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:15.448483 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f04f3-8104-4569-bd7c-becfe405c13d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:15.450339 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072f04f3-8104-4569-bd7c-becfe405c13d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:15.459273 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a6913-2c77-49e7-bc3e-ba7a0e006eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:15.461158 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a6913-2c77-49e7-bc3e-ba7a0e006eba None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:15.461654 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a6913-2c77-49e7-bc3e-ba7a0e006eba None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:15.462124 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a6913-2c77-49e7-bc3e-ba7a0e006eba None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:15.469866 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a6913-2c77-49e7-bc3e-ba7a0e006eba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:15.471782 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a6913-2c77-49e7-bc3e-ba7a0e006eba None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:15.486736 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-070a6913-2c77-49e7-bc3e-ba7a0e006eba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:15.488714 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 263/533] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:15.495007 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a6913-2c77-49e7-bc3e-ba7a0e006eba None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:15.565495 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 271/534] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:42:15.571187 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f04f3-8104-4569-bd7c-becfe405c13d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:15.601065 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a6913-2c77-49e7-bc3e-ba7a0e006eba None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:15.638970 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fdbcc-1de4-4319-9277-837ccbf272cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:15.639916 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fdbcc-1de4-4319-9277-837ccbf272cf None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:15.640410 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fdbcc-1de4-4319-9277-837ccbf272cf None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:15.640860 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fdbcc-1de4-4319-9277-837ccbf272cf None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:15.641825 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fdbcc-1de4-4319-9277-837ccbf272cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:15.642302 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fdbcc-1de4-4319-9277-837ccbf272cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:15.643964 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fdbcc-1de4-4319-9277-837ccbf272cf None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:15.657568 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 264/535] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:15.663952 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fdbcc-1de4-4319-9277-837ccbf272cf None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:15.681963 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072f04f3-8104-4569-bd7c-becfe405c13d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:15.729376 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e78400-a0a8-4fdb-ad12-3555f0186b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:15.730087 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e78400-a0a8-4fdb-ad12-3555f0186b8f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:15.730371 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e78400-a0a8-4fdb-ad12-3555f0186b8f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:15.730648 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e78400-a0a8-4fdb-ad12-3555f0186b8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:15.751240 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e78400-a0a8-4fdb-ad12-3555f0186b8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:15.752723 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e78400-a0a8-4fdb-ad12-3555f0186b8f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:15.785296 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fdbcc-1de4-4319-9277-837ccbf272cf None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:15.786887 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-14e78400-a0a8-4fdb-ad12-3555f0186b8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:15.792547 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 272/536] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:15.799300 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e78400-a0a8-4fdb-ad12-3555f0186b8f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:15.831861 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d801c-c625-4f2a-8bab-9d767899960b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:15.832519 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d801c-c625-4f2a-8bab-9d767899960b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:15.832797 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d801c-c625-4f2a-8bab-9d767899960b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:15.833068 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d801c-c625-4f2a-8bab-9d767899960b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:15.833893 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d801c-c625-4f2a-8bab-9d767899960b None admin] RBAC: Adding query filter params (role.id=c190a911c52940bb9b0fc255a4f7cad3, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=fedd2314dc594bcba749bf7b0d1e50fb) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:15.834199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d801c-c625-4f2a-8bab-9d767899960b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:15.836233 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d801c-c625-4f2a-8bab-9d767899960b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:15.848120 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 265/537] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:42:15 2022] GET /identity/v3/role_assignments?user.id=fedd2314dc594bcba749bf7b0d1e50fb&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=c190a911c52940bb9b0fc255a4f7cad3 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:15.924401 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e78400-a0a8-4fdb-ad12-3555f0186b8f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:15.969873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e4199-cb31-42b7-83f8-e6ffffec8d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:15.970621 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e4199-cb31-42b7-83f8-e6ffffec8d04 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:15.970918 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e4199-cb31-42b7-83f8-e6ffffec8d04 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:15.971198 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e4199-cb31-42b7-83f8-e6ffffec8d04 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:15.971969 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e4199-cb31-42b7-83f8-e6ffffec8d04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:15.972281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e4199-cb31-42b7-83f8-e6ffffec8d04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:15.973678 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e4199-cb31-42b7-83f8-e6ffffec8d04 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:15.994094 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 273/538] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:15.999268 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d801c-c625-4f2a-8bab-9d767899960b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:16.116921 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d801c-c625-4f2a-8bab-9d767899960b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:16.151505 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0594f-3bd1-4044-898f-0e1fc1e91164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:16.152696 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0594f-3bd1-4044-898f-0e1fc1e91164 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:16.153200 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0594f-3bd1-4044-898f-0e1fc1e91164 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:16.153669 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0594f-3bd1-4044-898f-0e1fc1e91164 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:16.160545 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0594f-3bd1-4044-898f-0e1fc1e91164 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:16.162227 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c0594f-3bd1-4044-898f-0e1fc1e91164 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:16.177071 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-76c0594f-3bd1-4044-898f-0e1fc1e91164 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:16.179022 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 266/539] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:16.184535 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e4199-cb31-42b7-83f8-e6ffffec8d04 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:16.328104 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e4199-cb31-42b7-83f8-e6ffffec8d04 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:16.372302 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446575b-be8e-4876-9968-373c1ede3cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:16.372975 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446575b-be8e-4876-9968-373c1ede3cba None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:16.373263 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446575b-be8e-4876-9968-373c1ede3cba None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:16.373544 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446575b-be8e-4876-9968-373c1ede3cba None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:16.374339 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446575b-be8e-4876-9968-373c1ede3cba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:16.374649 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446575b-be8e-4876-9968-373c1ede3cba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:16.376111 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446575b-be8e-4876-9968-373c1ede3cba None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:16.408245 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 274/540] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:16.414336 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0594f-3bd1-4044-898f-0e1fc1e91164 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:16.520907 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c0594f-3bd1-4044-898f-0e1fc1e91164 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:16.555922 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865f06b-1da8-41f4-ba83-78a01a328f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:16.556946 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865f06b-1da8-41f4-ba83-78a01a328f5c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:16.557444 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865f06b-1da8-41f4-ba83-78a01a328f5c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:16.557914 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865f06b-1da8-41f4-ba83-78a01a328f5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:16.558937 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865f06b-1da8-41f4-ba83-78a01a328f5c None admin] RBAC: Adding query filter params (role.id=c190a911c52940bb9b0fc255a4f7cad3, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=c084d218ea414d638ef2dc45364a492c) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:16.559442 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865f06b-1da8-41f4-ba83-78a01a328f5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:16.561093 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865f06b-1da8-41f4-ba83-78a01a328f5c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:16.567172 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 267/541] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:42:16 2022] GET /identity/v3/role_assignments?user.id=c084d218ea414d638ef2dc45364a492c&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=c190a911c52940bb9b0fc255a4f7cad3 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:16.955233 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88a79c-b9e0-4162-89f2-74cdd0954f61 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:16.955596 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88a79c-b9e0-4162-89f2-74cdd0954f61 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:16.955832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88a79c-b9e0-4162-89f2-74cdd0954f61 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:16.957451 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 275/542] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:16.962879 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583a900-bd3e-4ad3-b5f0-23cebf712ed1 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:16.963176 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583a900-bd3e-4ad3-b5f0-23cebf712ed1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:16.963467 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583a900-bd3e-4ad3-b5f0-23cebf712ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:16.984608 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-2583a900-bd3e-4ad3-b5f0-23cebf712ed1 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:16.985898 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2583a900-bd3e-4ad3-b5f0-23cebf712ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:17.086580 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 268/543] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:42:17.111184 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88a79c-b9e0-4162-89f2-74cdd0954f61 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:17.264384 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88a79c-b9e0-4162-89f2-74cdd0954f61 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:17.306051 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee42cc5-2ccf-4f5c-acf5-e9265ec32409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:17.306852 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee42cc5-2ccf-4f5c-acf5-e9265ec32409 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:17.307133 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee42cc5-2ccf-4f5c-acf5-e9265ec32409 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:17.307408 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee42cc5-2ccf-4f5c-acf5-e9265ec32409 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:17.324464 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee42cc5-2ccf-4f5c-acf5-e9265ec32409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:17.331588 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-0ee42cc5-2ccf-4f5c-acf5-e9265ec32409 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:42:17.337184 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 276/544] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:42:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:17.342956 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583a900-bd3e-4ad3-b5f0-23cebf712ed1 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:17.495168 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583a900-bd3e-4ad3-b5f0-23cebf712ed1 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:17.548456 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62976582-0f44-4662-8153-79fc03bc95d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:17.549061 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62976582-0f44-4662-8153-79fc03bc95d6 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:17.549347 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62976582-0f44-4662-8153-79fc03bc95d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:17.549621 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62976582-0f44-4662-8153-79fc03bc95d6 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:17.550388 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62976582-0f44-4662-8153-79fc03bc95d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:17.550747 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62976582-0f44-4662-8153-79fc03bc95d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:17.552180 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62976582-0f44-4662-8153-79fc03bc95d6 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:17.561965 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 269/545] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Apr 11 13:42:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:17.567472 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee42cc5-2ccf-4f5c-acf5-e9265ec32409 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:17.719357 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee42cc5-2ccf-4f5c-acf5-e9265ec32409 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:17.773274 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5901b-361b-4365-a3d1-f4907872f46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:17.774084 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5901b-361b-4365-a3d1-f4907872f46b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:17.774368 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5901b-361b-4365-a3d1-f4907872f46b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:17.774646 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5901b-361b-4365-a3d1-f4907872f46b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:17.787064 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5901b-361b-4365-a3d1-f4907872f46b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:17.789098 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5901b-361b-4365-a3d1-f4907872f46b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:17.808325 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-7bb5901b-361b-4365-a3d1-f4907872f46b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:17.809497 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 277/546] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:17.815157 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62976582-0f44-4662-8153-79fc03bc95d6 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:17.942363 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62976582-0f44-4662-8153-79fc03bc95d6 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:17.985255 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce96d83-0b40-4650-b022-3831cd256d2f None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:17.985537 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce96d83-0b40-4650-b022-3831cd256d2f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:17.986143 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce96d83-0b40-4650-b022-3831cd256d2f None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:17.987609 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719473f-b32a-45c8-90f3-b9faf96818d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:17.988305 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719473f-b32a-45c8-90f3-b9faf96818d6 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:17.988498 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 278/547] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:17.988609 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719473f-b32a-45c8-90f3-b9faf96818d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:17.991653 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719473f-b32a-45c8-90f3-b9faf96818d6 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:17.991653 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719473f-b32a-45c8-90f3-b9faf96818d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:17.991653 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719473f-b32a-45c8-90f3-b9faf96818d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:17.992011 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719473f-b32a-45c8-90f3-b9faf96818d6 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:17.997130 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb59a3-ce24-4b32-b212-1412358bd277 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:17.997130 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb59a3-ce24-4b32-b212-1412358bd277 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:17.997130 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb59a3-ce24-4b32-b212-1412358bd277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:18.009642 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 270/548] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:18.014972 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719473f-b32a-45c8-90f3-b9faf96818d6 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:18.032774 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-b5cb59a3-ce24-4b32-b212-1412358bd277 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:18.034334 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b5cb59a3-ce24-4b32-b212-1412358bd277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:18.117910 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719473f-b32a-45c8-90f3-b9faf96818d6 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:18.162082 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06f17a-85da-4297-ba52-ac712ca1013f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:18.163172 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06f17a-85da-4297-ba52-ac712ca1013f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:18.163693 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06f17a-85da-4297-ba52-ac712ca1013f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:18.164227 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06f17a-85da-4297-ba52-ac712ca1013f None admin] PATH_INFO: `/v3/users/swift` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:18.177919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06f17a-85da-4297-ba52-ac712ca1013f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:18.180521 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06f17a-85da-4297-ba52-ac712ca1013f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:18.195323 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-4d06f17a-85da-4297-ba52-ac712ca1013f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 13:42:18.196863 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 271/549] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:42:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:18.202395 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06f17a-85da-4297-ba52-ac712ca1013f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:18.208432 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 279/550] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:18.247412 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb59a3-ce24-4b32-b212-1412358bd277 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:18.371973 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06f17a-85da-4297-ba52-ac712ca1013f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:18.411806 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fc2f2-3434-4675-921b-c980ab9870db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:18.412520 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fc2f2-3434-4675-921b-c980ab9870db None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:18.412803 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fc2f2-3434-4675-921b-c980ab9870db None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:18.413078 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5fc2f2-3434-4675-921b-c980ab9870db None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:18.413931 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fc2f2-3434-4675-921b-c980ab9870db None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:18.414240 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fc2f2-3434-4675-921b-c980ab9870db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:18.415704 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5fc2f2-3434-4675-921b-c980ab9870db None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:18.423270 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb59a3-ce24-4b32-b212-1412358bd277 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:18.448796 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 272/551] 10.222.0.67 () {56 vars in 1135 bytes} [Mon Apr 11 13:42:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:18.456569 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fc2f2-3434-4675-921b-c980ab9870db None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:18.476912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdacc23-acd4-4846-93c0-d9745bdd8392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:18.478114 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdacc23-acd4-4846-93c0-d9745bdd8392 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:18.479277 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdacc23-acd4-4846-93c0-d9745bdd8392 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:18.479951 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdacc23-acd4-4846-93c0-d9745bdd8392 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:18.498389 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdacc23-acd4-4846-93c0-d9745bdd8392 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:18.505781 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-9cdacc23-acd4-4846-93c0-d9745bdd8392 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:42:18.508119 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 280/552] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:42:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:18.520580 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdacc23-acd4-4846-93c0-d9745bdd8392 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:18.625649 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5fc2f2-3434-4675-921b-c980ab9870db None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:18.647308 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdacc23-acd4-4846-93c0-d9745bdd8392 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:18.669393 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89da931-eb4b-4a4a-b55c-5d16b350c8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:18.670592 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89da931-eb4b-4a4a-b55c-5d16b350c8f9 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:18.671299 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89da931-eb4b-4a4a-b55c-5d16b350c8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:18.671751 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89da931-eb4b-4a4a-b55c-5d16b350c8f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:18.681338 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9019c-25c7-4f55-96db-f94e5c92a7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:18.682133 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9019c-25c7-4f55-96db-f94e5c92a7de None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:18.682511 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9019c-25c7-4f55-96db-f94e5c92a7de None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:18.683180 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9019c-25c7-4f55-96db-f94e5c92a7de None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:18.683739 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9019c-25c7-4f55-96db-f94e5c92a7de None admin] RBAC: Adding query filter params (name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:18.684302 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9019c-25c7-4f55-96db-f94e5c92a7de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:18.685936 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9019c-25c7-4f55-96db-f94e5c92a7de None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:18.694324 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 281/553] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Apr 11 13:42:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:18.695670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd4d5c-9625-4797-bda5-0e80c7d85276 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:18.696070 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd4d5c-9625-4797-bda5-0e80c7d85276 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:18.696443 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd4d5c-9625-4797-bda5-0e80c7d85276 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:18.702125 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 282/554] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:18.703046 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd4d5c-9625-4797-bda5-0e80c7d85276 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:18.757388 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89da931-eb4b-4a4a-b55c-5d16b350c8f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:18.758852 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89da931-eb4b-4a4a-b55c-5d16b350c8f9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:18.806584 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd4d5c-9625-4797-bda5-0e80c7d85276 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:18.844099 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25699901-9371-4c8f-bf74-cb47c3cfb0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:18.844951 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25699901-9371-4c8f-bf74-cb47c3cfb0d4 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:18.845236 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25699901-9371-4c8f-bf74-cb47c3cfb0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:18.845516 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25699901-9371-4c8f-bf74-cb47c3cfb0d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:18.856137 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25699901-9371-4c8f-bf74-cb47c3cfb0d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:18.857607 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25699901-9371-4c8f-bf74-cb47c3cfb0d4 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:18.859961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 273/555] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:42:18.861440 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e441d-05bb-44c9-a60e-fb3f7146cb72 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:18.861898 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e441d-05bb-44c9-a60e-fb3f7146cb72 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:18.862178 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e441d-05bb-44c9-a60e-fb3f7146cb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:18.879386 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-25699901-9371-4c8f-bf74-cb47c3cfb0d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:18.879832 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-713e441d-05bb-44c9-a60e-fb3f7146cb72 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:18.880549 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 283/556] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:18.881910 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-713e441d-05bb-44c9-a60e-fb3f7146cb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:18.882718 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7aea9e-10ab-4d8d-ab6d-6d9e1f389157 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:18.883016 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7aea9e-10ab-4d8d-ab6d-6d9e1f389157 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:18.883294 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7aea9e-10ab-4d8d-ab6d-6d9e1f389157 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:18.884730 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 284/557] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:18.889219 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7aea9e-10ab-4d8d-ab6d-6d9e1f389157 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:18.968916 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 274/558] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:18.970099 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e441d-05bb-44c9-a60e-fb3f7146cb72 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:18.998714 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7aea9e-10ab-4d8d-ab6d-6d9e1f389157 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:19.032725 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36454c6-5508-4a36-be9a-f859c31d086b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:19.033471 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36454c6-5508-4a36-be9a-f859c31d086b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:19.033767 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36454c6-5508-4a36-be9a-f859c31d086b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:19.034061 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36454c6-5508-4a36-be9a-f859c31d086b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:19.044971 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36454c6-5508-4a36-be9a-f859c31d086b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:19.046429 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36454c6-5508-4a36-be9a-f859c31d086b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:19.063944 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-b36454c6-5508-4a36-be9a-f859c31d086b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:19.065160 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 285/559] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:19.066436 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94ad6c-59f7-41be-ad39-06cb93ad285b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:19.066729 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94ad6c-59f7-41be-ad39-06cb93ad285b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:19.067007 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94ad6c-59f7-41be-ad39-06cb93ad285b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:19.083226 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-0e94ad6c-59f7-41be-ad39-06cb93ad285b None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:19.084468 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0e94ad6c-59f7-41be-ad39-06cb93ad285b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:19.092791 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e441d-05bb-44c9-a60e-fb3f7146cb72 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:19.126558 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521dc7bc-2fee-4ff6-a416-26f3b8bcce02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:19.127215 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521dc7bc-2fee-4ff6-a416-26f3b8bcce02 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:19.127491 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521dc7bc-2fee-4ff6-a416-26f3b8bcce02 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:19.127789 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521dc7bc-2fee-4ff6-a416-26f3b8bcce02 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:19.128506 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521dc7bc-2fee-4ff6-a416-26f3b8bcce02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:19.128806 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521dc7bc-2fee-4ff6-a416-26f3b8bcce02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:19.130258 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521dc7bc-2fee-4ff6-a416-26f3b8bcce02 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:19.142092 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 275/560] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:19.142698 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521dc7bc-2fee-4ff6-a416-26f3b8bcce02 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:19.163652 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 286/561] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:19.163652 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94ad6c-59f7-41be-ad39-06cb93ad285b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:19.251660 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94ad6c-59f7-41be-ad39-06cb93ad285b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:19.252262 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521dc7bc-2fee-4ff6-a416-26f3b8bcce02 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:19.283258 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf73bb1-d606-43f1-b0c2-51f22f11c53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:19.284084 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf73bb1-d606-43f1-b0c2-51f22f11c53d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:19.284363 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf73bb1-d606-43f1-b0c2-51f22f11c53d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:19.284635 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf73bb1-d606-43f1-b0c2-51f22f11c53d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:19.284947 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55ed70-77d3-4393-828f-9002370731bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:19.285614 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55ed70-77d3-4393-828f-9002370731bf None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:19.285900 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55ed70-77d3-4393-828f-9002370731bf None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:19.286180 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55ed70-77d3-4393-828f-9002370731bf None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:19.286905 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55ed70-77d3-4393-828f-9002370731bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:19.287841 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55ed70-77d3-4393-828f-9002370731bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:19.289226 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55ed70-77d3-4393-828f-9002370731bf None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:19.295244 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf73bb1-d606-43f1-b0c2-51f22f11c53d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:19.305198 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 287/562] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:19.305198 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55ed70-77d3-4393-828f-9002370731bf None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:19.305441 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-bdf73bb1-d606-43f1-b0c2-51f22f11c53d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:42:19.305441 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 276/563] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:42:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:19.305441 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf73bb1-d606-43f1-b0c2-51f22f11c53d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:19.394314 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55ed70-77d3-4393-828f-9002370731bf None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:19.399265 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf73bb1-d606-43f1-b0c2-51f22f11c53d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:19.426432 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64599dfe-b6aa-42fb-a0e9-fd05a3f0dbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:19.427215 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64599dfe-b6aa-42fb-a0e9-fd05a3f0dbcf None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:19.427491 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64599dfe-b6aa-42fb-a0e9-fd05a3f0dbcf None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:19.427797 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64599dfe-b6aa-42fb-a0e9-fd05a3f0dbcf None admin] PATH_INFO: `/v3/users/glance` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:19.431619 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b3be3-4663-44e8-919d-76852f70c0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:19.432507 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b3be3-4663-44e8-919d-76852f70c0e0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:19.432794 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b3be3-4663-44e8-919d-76852f70c0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:19.433066 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b3be3-4663-44e8-919d-76852f70c0e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:19.436470 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64599dfe-b6aa-42fb-a0e9-fd05a3f0dbcf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:19.437909 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64599dfe-b6aa-42fb-a0e9-fd05a3f0dbcf None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:19.442865 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b3be3-4663-44e8-919d-76852f70c0e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:19.450783 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-d94b3be3-4663-44e8-919d-76852f70c0e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:42:19.451767 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-64599dfe-b6aa-42fb-a0e9-fd05a3f0dbcf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 11 13:42:19.452009 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 277/564] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:42:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:19.457454 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 288/565] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:42:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:19.457601 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2875d33-1652-4117-bfd2-a08bf9194eb8 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:19.457601 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2875d33-1652-4117-bfd2-a08bf9194eb8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:19.457766 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64599dfe-b6aa-42fb-a0e9-fd05a3f0dbcf None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:19.457834 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2875d33-1652-4117-bfd2-a08bf9194eb8 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:19.457834 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 278/566] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:19.457834 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2875d33-1652-4117-bfd2-a08bf9194eb8 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:19.550467 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2875d33-1652-4117-bfd2-a08bf9194eb8 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:19.555996 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64599dfe-b6aa-42fb-a0e9-fd05a3f0dbcf None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:19.583099 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbeaf8a-268b-4c69-8283-e5d2a4aeaf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:19.583849 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbeaf8a-268b-4c69-8283-e5d2a4aeaf5d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:19.584070 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbeaf8a-268b-4c69-8283-e5d2a4aeaf5d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:19.584474 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbeaf8a-268b-4c69-8283-e5d2a4aeaf5d None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:19.585323 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbeaf8a-268b-4c69-8283-e5d2a4aeaf5d None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:19.585623 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbeaf8a-268b-4c69-8283-e5d2a4aeaf5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:19.586992 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbeaf8a-268b-4c69-8283-e5d2a4aeaf5d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:19.589475 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679eb50-bb4a-4dd6-baea-5fecfeff677f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:19.590262 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679eb50-bb4a-4dd6-baea-5fecfeff677f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:19.590546 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679eb50-bb4a-4dd6-baea-5fecfeff677f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:19.590823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679eb50-bb4a-4dd6-baea-5fecfeff677f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:19.594718 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 279/567] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Apr 11 13:42:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:19.595279 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbeaf8a-268b-4c69-8283-e5d2a4aeaf5d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:19.597297 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679eb50-bb4a-4dd6-baea-5fecfeff677f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:19.598753 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679eb50-bb4a-4dd6-baea-5fecfeff677f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:19.612949 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-a679eb50-bb4a-4dd6-baea-5fecfeff677f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:19.614152 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 289/568] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:19.614913 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679eb50-bb4a-4dd6-baea-5fecfeff677f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:19.688657 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbeaf8a-268b-4c69-8283-e5d2a4aeaf5d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:19.709256 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679eb50-bb4a-4dd6-baea-5fecfeff677f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:19.719836 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f1e20-4abd-425c-8480-3df6c89e9848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:19.720494 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f1e20-4abd-425c-8480-3df6c89e9848 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:19.720771 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f1e20-4abd-425c-8480-3df6c89e9848 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:19.721040 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f1e20-4abd-425c-8480-3df6c89e9848 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:19.721872 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f1e20-4abd-425c-8480-3df6c89e9848 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:19.722183 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f1e20-4abd-425c-8480-3df6c89e9848 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:19.723600 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f1e20-4abd-425c-8480-3df6c89e9848 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:19.740105 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 280/569] 10.222.0.67 () {56 vars in 1137 bytes} [Mon Apr 11 13:42:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:19.741324 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457091c-be1e-4e27-aba0-ca065e04f31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:19.741647 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c2d41-250f-466e-98a3-0dc8d70daae2 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:19.741932 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c2d41-250f-466e-98a3-0dc8d70daae2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:19.742027 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457091c-be1e-4e27-aba0-ca065e04f31a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:19.742204 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c2d41-250f-466e-98a3-0dc8d70daae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:19.742313 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457091c-be1e-4e27-aba0-ca065e04f31a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:19.742516 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457091c-be1e-4e27-aba0-ca065e04f31a None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:19.743259 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457091c-be1e-4e27-aba0-ca065e04f31a None admin] RBAC: Adding query filter params (name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:19.743562 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457091c-be1e-4e27-aba0-ca065e04f31a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:19.744949 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457091c-be1e-4e27-aba0-ca065e04f31a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:19.752794 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 290/570] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Apr 11 13:42:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:19.753576 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457091c-be1e-4e27-aba0-ca065e04f31a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:19.758700 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-742c2d41-250f-466e-98a3-0dc8d70daae2 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:19.759891 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-742c2d41-250f-466e-98a3-0dc8d70daae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:19.822380 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 281/571] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:19.823204 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c2d41-250f-466e-98a3-0dc8d70daae2 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:19.848266 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457091c-be1e-4e27-aba0-ca065e04f31a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:19.879359 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e5d66-8215-4962-99ee-0893a8da3e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:19.880523 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e5d66-8215-4962-99ee-0893a8da3e87 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:19.880804 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e5d66-8215-4962-99ee-0893a8da3e87 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:19.881617 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e5d66-8215-4962-99ee-0893a8da3e87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:19.891671 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e5d66-8215-4962-99ee-0893a8da3e87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:19.893131 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e5d66-8215-4962-99ee-0893a8da3e87 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:19.908948 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-960e5d66-8215-4962-99ee-0893a8da3e87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:19.910117 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 291/572] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:19.910879 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e5d66-8215-4962-99ee-0893a8da3e87 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:19.914348 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c2d41-250f-466e-98a3-0dc8d70daae2 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:19.946284 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f7f9e-5d89-45f1-854f-36fecc4b07c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:19.946859 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f7f9e-5d89-45f1-854f-36fecc4b07c8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:19.947135 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f7f9e-5d89-45f1-854f-36fecc4b07c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:19.947403 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f7f9e-5d89-45f1-854f-36fecc4b07c8 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:19.948214 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f7f9e-5d89-45f1-854f-36fecc4b07c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:19.948516 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f7f9e-5d89-45f1-854f-36fecc4b07c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:19.950187 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f7f9e-5d89-45f1-854f-36fecc4b07c8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:19.961612 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 282/573] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:19.962386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f7f9e-5d89-45f1-854f-36fecc4b07c8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:20.005127 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e5d66-8215-4962-99ee-0893a8da3e87 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:20.038167 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15e28c-a137-4f72-93a8-07913351e771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:20.039010 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15e28c-a137-4f72-93a8-07913351e771 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:20.039294 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15e28c-a137-4f72-93a8-07913351e771 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:20.039571 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15e28c-a137-4f72-93a8-07913351e771 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:20.049592 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15e28c-a137-4f72-93a8-07913351e771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:20.051034 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15e28c-a137-4f72-93a8-07913351e771 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:20.055224 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f7f9e-5d89-45f1-854f-36fecc4b07c8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:20.067271 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-9d15e28c-a137-4f72-93a8-07913351e771 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:20.072912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 292/574] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:20.072912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15e28c-a137-4f72-93a8-07913351e771 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:20.091602 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d6bcb-de08-43b2-ad3a-d30ea482e08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:20.092508 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d6bcb-de08-43b2-ad3a-d30ea482e08e None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:20.092852 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d6bcb-de08-43b2-ad3a-d30ea482e08e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:20.093217 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d6bcb-de08-43b2-ad3a-d30ea482e08e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:20.104080 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d6bcb-de08-43b2-ad3a-d30ea482e08e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:20.105519 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d6bcb-de08-43b2-ad3a-d30ea482e08e None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:20.121524 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-f99d6bcb-de08-43b2-ad3a-d30ea482e08e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:20.122844 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 283/575] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:20.123463 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d6bcb-de08-43b2-ad3a-d30ea482e08e None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:20.164142 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15e28c-a137-4f72-93a8-07913351e771 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:20.194894 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b28cf2-6cf4-4edd-aa9c-9ec75ba9a675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:20.195704 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b28cf2-6cf4-4edd-aa9c-9ec75ba9a675 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:20.195994 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b28cf2-6cf4-4edd-aa9c-9ec75ba9a675 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:20.196265 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b28cf2-6cf4-4edd-aa9c-9ec75ba9a675 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:20.206249 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b28cf2-6cf4-4edd-aa9c-9ec75ba9a675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:20.213760 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-c3b28cf2-6cf4-4edd-aa9c-9ec75ba9a675 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:42:20.214927 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 293/576] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:42:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:20.215322 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d6bcb-de08-43b2-ad3a-d30ea482e08e None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:20.215747 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b28cf2-6cf4-4edd-aa9c-9ec75ba9a675 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:20.246999 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d1610-600f-4164-9ea7-902bef2cca95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:20.247670 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d1610-600f-4164-9ea7-902bef2cca95 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:20.247959 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d1610-600f-4164-9ea7-902bef2cca95 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:20.248253 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d1610-600f-4164-9ea7-902bef2cca95 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:20.248951 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d1610-600f-4164-9ea7-902bef2cca95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:20.249256 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d1610-600f-4164-9ea7-902bef2cca95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:20.250630 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d1610-600f-4164-9ea7-902bef2cca95 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:20.261656 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 284/577] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:20.262432 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d1610-600f-4164-9ea7-902bef2cca95 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:20.309043 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b28cf2-6cf4-4edd-aa9c-9ec75ba9a675 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:20.340950 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67f96c-cade-4b00-abaa-65e7424b28f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:20.341593 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67f96c-cade-4b00-abaa-65e7424b28f3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:20.341877 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67f96c-cade-4b00-abaa-65e7424b28f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:20.342154 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67f96c-cade-4b00-abaa-65e7424b28f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:20.342978 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67f96c-cade-4b00-abaa-65e7424b28f3 None admin] RBAC: Adding query filter params (role.id=c190a911c52940bb9b0fc255a4f7cad3, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=6660794b27ff4a7bbe9b6b043593598c) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:20.343285 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67f96c-cade-4b00-abaa-65e7424b28f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:20.344738 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e67f96c-cade-4b00-abaa-65e7424b28f3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:20.363667 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 294/578] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:42:20 2022] GET /identity/v3/role_assignments?user.id=6660794b27ff4a7bbe9b6b043593598c&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=c190a911c52940bb9b0fc255a4f7cad3 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:20.363667 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67f96c-cade-4b00-abaa-65e7424b28f3 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:20.363997 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d1610-600f-4164-9ea7-902bef2cca95 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:20.391168 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eef313-d380-4563-ad09-e7923e38b14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:20.391892 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eef313-d380-4563-ad09-e7923e38b14f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:20.392176 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eef313-d380-4563-ad09-e7923e38b14f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:20.392452 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eef313-d380-4563-ad09-e7923e38b14f None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:20.393188 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eef313-d380-4563-ad09-e7923e38b14f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:20.393496 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eef313-d380-4563-ad09-e7923e38b14f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:20.394948 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eef313-d380-4563-ad09-e7923e38b14f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:20.411334 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 285/579] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:20.411334 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eef313-d380-4563-ad09-e7923e38b14f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:20.455898 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67f96c-cade-4b00-abaa-65e7424b28f3 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:20.491920 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e5f7e-67b7-4326-99ee-0d0d176b8468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:20.492518 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e5f7e-67b7-4326-99ee-0d0d176b8468 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:20.492805 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e5f7e-67b7-4326-99ee-0d0d176b8468 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:20.493080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e5f7e-67b7-4326-99ee-0d0d176b8468 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:20.493817 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e5f7e-67b7-4326-99ee-0d0d176b8468 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:20.494123 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e5f7e-67b7-4326-99ee-0d0d176b8468 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:20.495518 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e5f7e-67b7-4326-99ee-0d0d176b8468 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:20.512723 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 295/580] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:20.512723 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e5f7e-67b7-4326-99ee-0d0d176b8468 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:20.519308 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eef313-d380-4563-ad09-e7923e38b14f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:20.554662 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69312d5a-8dc6-4d1f-93c6-132a45333147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:20.555337 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69312d5a-8dc6-4d1f-93c6-132a45333147 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:20.555623 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69312d5a-8dc6-4d1f-93c6-132a45333147 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:20.555927 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69312d5a-8dc6-4d1f-93c6-132a45333147 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:20.556676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69312d5a-8dc6-4d1f-93c6-132a45333147 None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:20.556983 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69312d5a-8dc6-4d1f-93c6-132a45333147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:20.558368 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69312d5a-8dc6-4d1f-93c6-132a45333147 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:20.572758 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 286/581] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Apr 11 13:42:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:20.572758 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69312d5a-8dc6-4d1f-93c6-132a45333147 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:20.609906 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e5f7e-67b7-4326-99ee-0d0d176b8468 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:20.643301 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99003827-97bf-4b6e-97f9-2c95111ba8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:20.644443 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99003827-97bf-4b6e-97f9-2c95111ba8a5 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:20.644919 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99003827-97bf-4b6e-97f9-2c95111ba8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:20.645373 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99003827-97bf-4b6e-97f9-2c95111ba8a5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:20.653806 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99003827-97bf-4b6e-97f9-2c95111ba8a5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:20.655453 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99003827-97bf-4b6e-97f9-2c95111ba8a5 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:20.669833 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-99003827-97bf-4b6e-97f9-2c95111ba8a5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 11 13:42:20.669990 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69312d5a-8dc6-4d1f-93c6-132a45333147 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:20.671092 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 296/582] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:42:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:20.671897 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99003827-97bf-4b6e-97f9-2c95111ba8a5 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:20.704949 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0855b36-933e-4d1f-a1b5-09841bf1f25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:20.706303 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0855b36-933e-4d1f-a1b5-09841bf1f25e None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:20.706751 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0855b36-933e-4d1f-a1b5-09841bf1f25e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:20.707163 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0855b36-933e-4d1f-a1b5-09841bf1f25e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:20.714083 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0855b36-933e-4d1f-a1b5-09841bf1f25e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:20.715748 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0855b36-933e-4d1f-a1b5-09841bf1f25e None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:20.729795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-f0855b36-933e-4d1f-a1b5-09841bf1f25e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:20.735747 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 287/583] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:20.736712 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0855b36-933e-4d1f-a1b5-09841bf1f25e None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:20.772315 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99003827-97bf-4b6e-97f9-2c95111ba8a5 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:20.805678 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e6c99-4575-4a19-842a-1de70c8dfd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:20.806468 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e6c99-4575-4a19-842a-1de70c8dfd04 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:20.806753 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e6c99-4575-4a19-842a-1de70c8dfd04 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:20.807031 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e6c99-4575-4a19-842a-1de70c8dfd04 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:20.814981 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e6c99-4575-4a19-842a-1de70c8dfd04 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:20.816444 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e6c99-4575-4a19-842a-1de70c8dfd04 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:20.830293 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-a24e6c99-4575-4a19-842a-1de70c8dfd04 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 13:42:20.831464 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 297/584] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Apr 11 13:42:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:20.832258 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e6c99-4575-4a19-842a-1de70c8dfd04 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:20.839083 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0855b36-933e-4d1f-a1b5-09841bf1f25e None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:20.872521 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b334f7d-0228-45c9-81b3-39a99dbf2c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:20.873310 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b334f7d-0228-45c9-81b3-39a99dbf2c04 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:20.873594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b334f7d-0228-45c9-81b3-39a99dbf2c04 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:20.873872 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b334f7d-0228-45c9-81b3-39a99dbf2c04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:20.883622 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b334f7d-0228-45c9-81b3-39a99dbf2c04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:20.885098 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b334f7d-0228-45c9-81b3-39a99dbf2c04 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:20.902354 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-8b334f7d-0228-45c9-81b3-39a99dbf2c04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:20.908083 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 288/585] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:20.908083 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b334f7d-0228-45c9-81b3-39a99dbf2c04 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:20.933353 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e6c99-4575-4a19-842a-1de70c8dfd04 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:20.966442 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8da13c-627c-45fe-a8b4-d25e5e100e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:20.967105 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8da13c-627c-45fe-a8b4-d25e5e100e4b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:20.967383 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8da13c-627c-45fe-a8b4-d25e5e100e4b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:20.967680 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8da13c-627c-45fe-a8b4-d25e5e100e4b None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:20.968605 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8da13c-627c-45fe-a8b4-d25e5e100e4b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:20.968913 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8da13c-627c-45fe-a8b4-d25e5e100e4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:20.970330 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8da13c-627c-45fe-a8b4-d25e5e100e4b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:20.987106 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 298/586] 10.222.0.67 () {56 vars in 1137 bytes} [Mon Apr 11 13:42:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:20.987944 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8da13c-627c-45fe-a8b4-d25e5e100e4b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:21.017189 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b334f7d-0228-45c9-81b3-39a99dbf2c04 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:21.050771 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7e93b-d9f2-4017-aefa-fefdfd024b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:21.051351 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7e93b-d9f2-4017-aefa-fefdfd024b98 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:21.051639 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7e93b-d9f2-4017-aefa-fefdfd024b98 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:21.051927 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7e93b-d9f2-4017-aefa-fefdfd024b98 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:21.052731 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7e93b-d9f2-4017-aefa-fefdfd024b98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:21.053680 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7e93b-d9f2-4017-aefa-fefdfd024b98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:21.055277 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f7e93b-d9f2-4017-aefa-fefdfd024b98 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:21.066252 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 289/587] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:21.067034 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7e93b-d9f2-4017-aefa-fefdfd024b98 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:21.089386 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8da13c-627c-45fe-a8b4-d25e5e100e4b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:21.122639 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3fc65-d1b2-4cbc-a9dc-9283fe8fb85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:21.123307 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3fc65-d1b2-4cbc-a9dc-9283fe8fb85b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:21.123587 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3fc65-d1b2-4cbc-a9dc-9283fe8fb85b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:21.123884 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3fc65-d1b2-4cbc-a9dc-9283fe8fb85b None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:21.124708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3fc65-d1b2-4cbc-a9dc-9283fe8fb85b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:21.125015 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3fc65-d1b2-4cbc-a9dc-9283fe8fb85b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:21.126442 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3fc65-d1b2-4cbc-a9dc-9283fe8fb85b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:21.150859 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 299/588] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Apr 11 13:42:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:21.150859 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3fc65-d1b2-4cbc-a9dc-9283fe8fb85b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:21.171868 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7e93b-d9f2-4017-aefa-fefdfd024b98 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:21.206448 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057e0d7-fa13-4789-8040-c416cfc3a714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:21.207220 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057e0d7-fa13-4789-8040-c416cfc3a714 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:21.207561 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057e0d7-fa13-4789-8040-c416cfc3a714 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:21.207867 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057e0d7-fa13-4789-8040-c416cfc3a714 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:21.208586 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057e0d7-fa13-4789-8040-c416cfc3a714 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:21.208890 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057e0d7-fa13-4789-8040-c416cfc3a714 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:21.210955 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7057e0d7-fa13-4789-8040-c416cfc3a714 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:21.228180 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 290/589] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:21.228180 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057e0d7-fa13-4789-8040-c416cfc3a714 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:21.244352 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3fc65-d1b2-4cbc-a9dc-9283fe8fb85b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:21.277710 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449436e-3c05-482d-a6a6-398802b995f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:21.278538 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449436e-3c05-482d-a6a6-398802b995f2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:21.278824 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449436e-3c05-482d-a6a6-398802b995f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:21.279104 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449436e-3c05-482d-a6a6-398802b995f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:21.289103 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449436e-3c05-482d-a6a6-398802b995f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:21.290534 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449436e-3c05-482d-a6a6-398802b995f2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:21.308243 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-6449436e-3c05-482d-a6a6-398802b995f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:21.309683 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 300/590] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:21.310477 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449436e-3c05-482d-a6a6-398802b995f2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:21.323282 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057e0d7-fa13-4789-8040-c416cfc3a714 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:21.356742 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd20880-a6eb-41a9-b7d9-3547fef0e5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:21.357625 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd20880-a6eb-41a9-b7d9-3547fef0e5b8 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:21.357907 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd20880-a6eb-41a9-b7d9-3547fef0e5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:21.358177 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd20880-a6eb-41a9-b7d9-3547fef0e5b8 None admin] PATH_INFO: `/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/08cbf69574af4e25b940ec038f9e1bd1/roles/c190a911c52940bb9b0fc255a4f7cad3` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:21.372470 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd20880-a6eb-41a9-b7d9-3547fef0e5b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d46063ee60fd4f6dba86d1c5946e9381, user_id=08cbf69574af4e25b940ec038f9e1bd1, role_id=c190a911c52940bb9b0fc255a4f7cad3)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:21.373925 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd20880-a6eb-41a9-b7d9-3547fef0e5b8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:21.395674 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 291/591] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:42:21 2022] PUT /identity/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/08cbf69574af4e25b940ec038f9e1bd1/roles/c190a911c52940bb9b0fc255a4f7cad3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:42:21.395674 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd20880-a6eb-41a9-b7d9-3547fef0e5b8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:21.420900 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449436e-3c05-482d-a6a6-398802b995f2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:21.457834 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54452edd-2aa0-479b-b526-8c15893ffbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:21.458660 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54452edd-2aa0-479b-b526-8c15893ffbc2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:21.458930 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54452edd-2aa0-479b-b526-8c15893ffbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:21.459233 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54452edd-2aa0-479b-b526-8c15893ffbc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:21.472010 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54452edd-2aa0-479b-b526-8c15893ffbc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:21.473604 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54452edd-2aa0-479b-b526-8c15893ffbc2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:21.493683 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-54452edd-2aa0-479b-b526-8c15893ffbc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:21.500534 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 301/592] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:21.501514 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54452edd-2aa0-479b-b526-8c15893ffbc2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:21.505425 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd20880-a6eb-41a9-b7d9-3547fef0e5b8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:21.541052 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e8493-857e-47fd-9dbb-ad635751305f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:21.541869 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e8493-857e-47fd-9dbb-ad635751305f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:21.542150 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e8493-857e-47fd-9dbb-ad635751305f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:21.542422 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e8493-857e-47fd-9dbb-ad635751305f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:21.550323 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e8493-857e-47fd-9dbb-ad635751305f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:21.551893 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e8493-857e-47fd-9dbb-ad635751305f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:21.573635 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-491e8493-857e-47fd-9dbb-ad635751305f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 11 13:42:21.575782 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 292/593] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:42:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:21.576790 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e8493-857e-47fd-9dbb-ad635751305f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:21.615956 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54452edd-2aa0-479b-b526-8c15893ffbc2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:21.654708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686ba19-9c58-48a3-8f7e-d4efdf2d4d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:21.655384 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686ba19-9c58-48a3-8f7e-d4efdf2d4d55 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:21.655691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686ba19-9c58-48a3-8f7e-d4efdf2d4d55 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:21.655977 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686ba19-9c58-48a3-8f7e-d4efdf2d4d55 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:21.656704 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686ba19-9c58-48a3-8f7e-d4efdf2d4d55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:21.657012 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686ba19-9c58-48a3-8f7e-d4efdf2d4d55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:21.658697 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686ba19-9c58-48a3-8f7e-d4efdf2d4d55 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:21.670566 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 302/594] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:21.675072 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686ba19-9c58-48a3-8f7e-d4efdf2d4d55 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:21.706052 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e8493-857e-47fd-9dbb-ad635751305f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:21.746868 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042c3f7-6224-4a65-8c5d-3cc380721afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:21.747534 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042c3f7-6224-4a65-8c5d-3cc380721afc None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:21.747848 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042c3f7-6224-4a65-8c5d-3cc380721afc None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:21.748127 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042c3f7-6224-4a65-8c5d-3cc380721afc None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:21.749474 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042c3f7-6224-4a65-8c5d-3cc380721afc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:21.749474 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042c3f7-6224-4a65-8c5d-3cc380721afc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:21.750522 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042c3f7-6224-4a65-8c5d-3cc380721afc None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:21.762356 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 293/595] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:21.763185 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042c3f7-6224-4a65-8c5d-3cc380721afc None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:21.779506 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686ba19-9c58-48a3-8f7e-d4efdf2d4d55 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:21.814059 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce28e0-37d2-4497-9624-3fa560b5a4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:21.815070 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce28e0-37d2-4497-9624-3fa560b5a4db None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:21.815574 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce28e0-37d2-4497-9624-3fa560b5a4db None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:21.816082 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce28e0-37d2-4497-9624-3fa560b5a4db None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:21.817112 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce28e0-37d2-4497-9624-3fa560b5a4db None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:21.817633 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce28e0-37d2-4497-9624-3fa560b5a4db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:21.819300 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce28e0-37d2-4497-9624-3fa560b5a4db None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:21.841972 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 303/596] 10.222.0.67 () {56 vars in 1139 bytes} [Mon Apr 11 13:42:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:21.843129 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce28e0-37d2-4497-9624-3fa560b5a4db None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:21.868015 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042c3f7-6224-4a65-8c5d-3cc380721afc None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:21.901677 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3bbeb-edda-4fc4-89e6-1c36a8965098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:21.902473 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3bbeb-edda-4fc4-89e6-1c36a8965098 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:21.902770 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3bbeb-edda-4fc4-89e6-1c36a8965098 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:21.903069 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3bbeb-edda-4fc4-89e6-1c36a8965098 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:21.909820 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3bbeb-edda-4fc4-89e6-1c36a8965098 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:21.911279 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3bbeb-edda-4fc4-89e6-1c36a8965098 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:21.924789 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-71b3bbeb-edda-4fc4-89e6-1c36a8965098 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:21.931330 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 294/597] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:21.931330 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3bbeb-edda-4fc4-89e6-1c36a8965098 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:21.957685 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce28e0-37d2-4497-9624-3fa560b5a4db None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:22.004512 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe2a3c-4271-46a7-8dd5-de4f2dfe0b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:22.006987 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe2a3c-4271-46a7-8dd5-de4f2dfe0b60 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:22.007448 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe2a3c-4271-46a7-8dd5-de4f2dfe0b60 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:22.007915 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe2a3c-4271-46a7-8dd5-de4f2dfe0b60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:22.016416 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe2a3c-4271-46a7-8dd5-de4f2dfe0b60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:22.018713 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe2a3c-4271-46a7-8dd5-de4f2dfe0b60 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:22.035780 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3bbeb-edda-4fc4-89e6-1c36a8965098 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:22.036493 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-4abe2a3c-4271-46a7-8dd5-de4f2dfe0b60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:22.039595 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 304/598] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:22.040572 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe2a3c-4271-46a7-8dd5-de4f2dfe0b60 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:22.075131 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec43a5-de67-4bac-aff8-867e341af872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:22.076139 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec43a5-de67-4bac-aff8-867e341af872 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:22.076425 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec43a5-de67-4bac-aff8-867e341af872 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:22.076774 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec43a5-de67-4bac-aff8-867e341af872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:22.089588 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec43a5-de67-4bac-aff8-867e341af872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:22.091159 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec43a5-de67-4bac-aff8-867e341af872 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:22.109551 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-a9ec43a5-de67-4bac-aff8-867e341af872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:22.115231 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 295/599] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:22.115231 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec43a5-de67-4bac-aff8-867e341af872 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:22.160120 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe2a3c-4271-46a7-8dd5-de4f2dfe0b60 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:22.194069 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3368b-b02f-4bef-9b8d-352445301d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:22.194772 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3368b-b02f-4bef-9b8d-352445301d9d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:22.195058 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3368b-b02f-4bef-9b8d-352445301d9d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:22.195338 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3368b-b02f-4bef-9b8d-352445301d9d None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:22.196292 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3368b-b02f-4bef-9b8d-352445301d9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:22.196605 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3368b-b02f-4bef-9b8d-352445301d9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:22.198040 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3368b-b02f-4bef-9b8d-352445301d9d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:22.211287 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 305/600] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:22.212512 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3368b-b02f-4bef-9b8d-352445301d9d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:22.234426 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec43a5-de67-4bac-aff8-867e341af872 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:22.272095 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae079ac-fa1a-4340-a201-a72c3e756b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:22.273135 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae079ac-fa1a-4340-a201-a72c3e756b54 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:22.273620 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae079ac-fa1a-4340-a201-a72c3e756b54 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:22.274083 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae079ac-fa1a-4340-a201-a72c3e756b54 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:22.275053 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae079ac-fa1a-4340-a201-a72c3e756b54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:22.275550 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae079ac-fa1a-4340-a201-a72c3e756b54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:22.277194 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae079ac-fa1a-4340-a201-a72c3e756b54 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:22.289559 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 296/601] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:22.290802 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae079ac-fa1a-4340-a201-a72c3e756b54 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:22.325595 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3368b-b02f-4bef-9b8d-352445301d9d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:22.368099 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c46fe4-ee4f-4d61-9efd-4fddb70e15ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:22.369104 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c46fe4-ee4f-4d61-9efd-4fddb70e15ad None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:22.369588 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c46fe4-ee4f-4d61-9efd-4fddb70e15ad None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:22.370054 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c46fe4-ee4f-4d61-9efd-4fddb70e15ad None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:22.370967 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c46fe4-ee4f-4d61-9efd-4fddb70e15ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:22.371469 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c46fe4-ee4f-4d61-9efd-4fddb70e15ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:22.373062 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c46fe4-ee4f-4d61-9efd-4fddb70e15ad None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:22.384824 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 306/602] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:22.385931 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c46fe4-ee4f-4d61-9efd-4fddb70e15ad None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:22.416106 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae079ac-fa1a-4340-a201-a72c3e756b54 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:22.450552 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136e220-a169-438f-8be2-7b01ffae1107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:22.451587 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136e220-a169-438f-8be2-7b01ffae1107 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:22.452078 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136e220-a169-438f-8be2-7b01ffae1107 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:22.452449 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136e220-a169-438f-8be2-7b01ffae1107 None admin] PATH_INFO: `/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/af2e8f671cba49969ccf9e13778b5052/roles/c190a911c52940bb9b0fc255a4f7cad3` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:22.467198 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136e220-a169-438f-8be2-7b01ffae1107 None admin] RBAC: Authorizing `identity:create_grant(project_id=d46063ee60fd4f6dba86d1c5946e9381, user_id=af2e8f671cba49969ccf9e13778b5052, role_id=c190a911c52940bb9b0fc255a4f7cad3)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:22.468823 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136e220-a169-438f-8be2-7b01ffae1107 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:22.483719 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 297/603] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:42:22 2022] PUT /identity/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/af2e8f671cba49969ccf9e13778b5052/roles/c190a911c52940bb9b0fc255a4f7cad3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:42:22.484766 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136e220-a169-438f-8be2-7b01ffae1107 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:22.510444 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c46fe4-ee4f-4d61-9efd-4fddb70e15ad None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:22.587240 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6980d5-026a-4b7b-a6d2-14b84e70c9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:22.588184 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6980d5-026a-4b7b-a6d2-14b84e70c9c7 None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:22.588467 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6980d5-026a-4b7b-a6d2-14b84e70c9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:22.588742 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6980d5-026a-4b7b-a6d2-14b84e70c9c7 None admin] PATH_INFO: `/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/fedd2314dc594bcba749bf7b0d1e50fb/roles/c190a911c52940bb9b0fc255a4f7cad3` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:22.632602 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6980d5-026a-4b7b-a6d2-14b84e70c9c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d46063ee60fd4f6dba86d1c5946e9381, user_id=fedd2314dc594bcba749bf7b0d1e50fb, role_id=c190a911c52940bb9b0fc255a4f7cad3)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:22.634065 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6980d5-026a-4b7b-a6d2-14b84e70c9c7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:22.663310 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136e220-a169-438f-8be2-7b01ffae1107 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:22.674286 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 307/604] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:42:22 2022] PUT /identity/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/fedd2314dc594bcba749bf7b0d1e50fb/roles/c190a911c52940bb9b0fc255a4f7cad3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:42:22.718790 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d56dd-760f-4382-b256-2a77eeaed2eb None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:22.719121 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d56dd-760f-4382-b256-2a77eeaed2eb None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:22.719342 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d56dd-760f-4382-b256-2a77eeaed2eb None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:22.719793 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456237bf-22fe-44f9-8b24-0bde671194b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:22.720662 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456237bf-22fe-44f9-8b24-0bde671194b4 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:22.720945 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456237bf-22fe-44f9-8b24-0bde671194b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:22.721237 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456237bf-22fe-44f9-8b24-0bde671194b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:22.722398 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 308/605] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:22.729115 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc342e8-9324-4c17-97dd-1a0e94fda5bc None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:22.729449 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc342e8-9324-4c17-97dd-1a0e94fda5bc None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:22.729726 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc342e8-9324-4c17-97dd-1a0e94fda5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:22.732485 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456237bf-22fe-44f9-8b24-0bde671194b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:22.733968 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456237bf-22fe-44f9-8b24-0bde671194b4 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:22.750292 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-9bc342e8-9324-4c17-97dd-1a0e94fda5bc None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:22.751009 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-456237bf-22fe-44f9-8b24-0bde671194b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:22.751528 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9bc342e8-9324-4c17-97dd-1a0e94fda5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:22.753032 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 298/606] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:22.760740 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456237bf-22fe-44f9-8b24-0bde671194b4 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:22.861479 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 309/607] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:22.895864 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc342e8-9324-4c17-97dd-1a0e94fda5bc None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:22.921356 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456237bf-22fe-44f9-8b24-0bde671194b4 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:22.961890 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be0bc5-a35b-4665-86f0-9a7ea13f0b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:22.962562 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be0bc5-a35b-4665-86f0-9a7ea13f0b34 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:22.962842 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be0bc5-a35b-4665-86f0-9a7ea13f0b34 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:22.963115 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be0bc5-a35b-4665-86f0-9a7ea13f0b34 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:22.963960 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be0bc5-a35b-4665-86f0-9a7ea13f0b34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:22.964272 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be0bc5-a35b-4665-86f0-9a7ea13f0b34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:22.965727 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be0bc5-a35b-4665-86f0-9a7ea13f0b34 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:22.979443 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 299/608] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:22.985704 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be0bc5-a35b-4665-86f0-9a7ea13f0b34 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:23.027645 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc342e8-9324-4c17-97dd-1a0e94fda5bc None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:23.067658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba97f9a-e12b-4c0a-8022-e6f4d5b3d6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:23.067658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba97f9a-e12b-4c0a-8022-e6f4d5b3d6a8 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:23.067658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba97f9a-e12b-4c0a-8022-e6f4d5b3d6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:23.067658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba97f9a-e12b-4c0a-8022-e6f4d5b3d6a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:23.093105 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be0bc5-a35b-4665-86f0-9a7ea13f0b34 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:23.103060 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba97f9a-e12b-4c0a-8022-e6f4d5b3d6a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:23.110142 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-5ba97f9a-e12b-4c0a-8022-e6f4d5b3d6a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:42:23.115719 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 310/609] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:42:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:23.117652 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba97f9a-e12b-4c0a-8022-e6f4d5b3d6a8 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:23.134332 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77758c29-f7f9-465f-a2f6-e20648f19b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:23.135226 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77758c29-f7f9-465f-a2f6-e20648f19b00 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:23.135507 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77758c29-f7f9-465f-a2f6-e20648f19b00 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:23.135812 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77758c29-f7f9-465f-a2f6-e20648f19b00 None admin] PATH_INFO: `/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/c084d218ea414d638ef2dc45364a492c/roles/c190a911c52940bb9b0fc255a4f7cad3` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:23.163075 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77758c29-f7f9-465f-a2f6-e20648f19b00 None admin] RBAC: Authorizing `identity:create_grant(project_id=d46063ee60fd4f6dba86d1c5946e9381, user_id=c084d218ea414d638ef2dc45364a492c, role_id=c190a911c52940bb9b0fc255a4f7cad3)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:23.164486 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77758c29-f7f9-465f-a2f6-e20648f19b00 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:23.186959 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 300/610] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:42:22 2022] PUT /identity/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/c084d218ea414d638ef2dc45364a492c/roles/c190a911c52940bb9b0fc255a4f7cad3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:42:23.282073 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba97f9a-e12b-4c0a-8022-e6f4d5b3d6a8 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:23.331214 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6046d-c378-4359-8776-6c9e06c758c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:23.331937 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6046d-c378-4359-8776-6c9e06c758c2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:23.332221 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6046d-c378-4359-8776-6c9e06c758c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:23.332498 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6046d-c378-4359-8776-6c9e06c758c2 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:23.333254 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6046d-c378-4359-8776-6c9e06c758c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:23.333560 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6046d-c378-4359-8776-6c9e06c758c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:23.335674 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6046d-c378-4359-8776-6c9e06c758c2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:23.344670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 311/611] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Apr 11 13:42:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:23.352517 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77758c29-f7f9-465f-a2f6-e20648f19b00 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:23.482762 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77758c29-f7f9-465f-a2f6-e20648f19b00 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:23.520540 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725128c0-3d36-4a87-8bbc-c953c089b25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:23.521395 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725128c0-3d36-4a87-8bbc-c953c089b25f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:23.521676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725128c0-3d36-4a87-8bbc-c953c089b25f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:23.521949 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725128c0-3d36-4a87-8bbc-c953c089b25f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:23.533921 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725128c0-3d36-4a87-8bbc-c953c089b25f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:23.535424 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725128c0-3d36-4a87-8bbc-c953c089b25f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:23.554826 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-725128c0-3d36-4a87-8bbc-c953c089b25f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:23.556464 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 301/612] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:23.562236 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6046d-c378-4359-8776-6c9e06c758c2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:23.707613 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6046d-c378-4359-8776-6c9e06c758c2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:23.740884 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5d6b5-440a-4843-8be3-943405dfe9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:23.741520 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5d6b5-440a-4843-8be3-943405dfe9fc None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:23.741805 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5d6b5-440a-4843-8be3-943405dfe9fc None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:23.742088 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5d6b5-440a-4843-8be3-943405dfe9fc None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:23.742816 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5d6b5-440a-4843-8be3-943405dfe9fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:23.743124 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5d6b5-440a-4843-8be3-943405dfe9fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:23.744515 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5d6b5-440a-4843-8be3-943405dfe9fc None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:23.758330 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 312/613] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:23.764939 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725128c0-3d36-4a87-8bbc-c953c089b25f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:23.882805 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725128c0-3d36-4a87-8bbc-c953c089b25f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:23.923164 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bf1a2-8648-4ac7-90a0-0985586669a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:23.923996 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bf1a2-8648-4ac7-90a0-0985586669a6 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:23.924280 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bf1a2-8648-4ac7-90a0-0985586669a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:23.924556 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bf1a2-8648-4ac7-90a0-0985586669a6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:23.932700 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bf1a2-8648-4ac7-90a0-0985586669a6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:23.934157 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bf1a2-8648-4ac7-90a0-0985586669a6 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:23.944596 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70ec21-acec-4a32-aa72-df32729e25e6 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:23.945055 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70ec21-acec-4a32-aa72-df32729e25e6 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:23.945340 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70ec21-acec-4a32-aa72-df32729e25e6 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:23.946700 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 313/614] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:23.952020 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f52228-682e-4ac4-b2ca-91364caba4fd None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:23.952314 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f52228-682e-4ac4-b2ca-91364caba4fd None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:23.952594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f52228-682e-4ac4-b2ca-91364caba4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:23.963985 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-2c6bf1a2-8648-4ac7-90a0-0985586669a6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 13:42:23.965506 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 302/615] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:42:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:23.971209 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bf1a2-8648-4ac7-90a0-0985586669a6 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:23.981662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c2f52228-682e-4ac4-b2ca-91364caba4fd None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:23.982870 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c2f52228-682e-4ac4-b2ca-91364caba4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:24.087259 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 314/616] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:24.093612 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bf1a2-8648-4ac7-90a0-0985586669a6 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:24.124266 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f52228-682e-4ac4-b2ca-91364caba4fd None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:24.135153 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fecab-0570-4d03-a959-3ebfaa124fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:24.136048 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fecab-0570-4d03-a959-3ebfaa124fda None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:24.136498 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fecab-0570-4d03-a959-3ebfaa124fda None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:24.136908 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fecab-0570-4d03-a959-3ebfaa124fda None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:24.137920 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fecab-0570-4d03-a959-3ebfaa124fda None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:24.138363 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fecab-0570-4d03-a959-3ebfaa124fda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:24.139973 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fecab-0570-4d03-a959-3ebfaa124fda None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:24.179401 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 303/617] 10.222.0.67 () {56 vars in 1135 bytes} [Mon Apr 11 13:42:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:24.184630 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fecab-0570-4d03-a959-3ebfaa124fda None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:24.224133 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f52228-682e-4ac4-b2ca-91364caba4fd None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:24.272652 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9365a-825d-4bb9-a2b2-4f8f56d0b7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:24.273481 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9365a-825d-4bb9-a2b2-4f8f56d0b7b5 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:24.273770 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9365a-825d-4bb9-a2b2-4f8f56d0b7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:24.274053 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9365a-825d-4bb9-a2b2-4f8f56d0b7b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:24.289112 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9365a-825d-4bb9-a2b2-4f8f56d0b7b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:24.304293 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-c2d9365a-825d-4bb9-a2b2-4f8f56d0b7b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:42:24.305859 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 315/618] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:42:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:24.311524 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9365a-825d-4bb9-a2b2-4f8f56d0b7b5 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:24.326823 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fecab-0570-4d03-a959-3ebfaa124fda None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:24.371094 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce52a42-3ceb-4978-bdf4-b734299bb434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:24.372249 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce52a42-3ceb-4978-bdf4-b734299bb434 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:24.372724 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce52a42-3ceb-4978-bdf4-b734299bb434 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:24.373203 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce52a42-3ceb-4978-bdf4-b734299bb434 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:24.391916 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce52a42-3ceb-4978-bdf4-b734299bb434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:24.393700 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce52a42-3ceb-4978-bdf4-b734299bb434 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:24.421117 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-4ce52a42-3ceb-4978-bdf4-b734299bb434 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:24.422755 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 304/619] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:24.431651 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce52a42-3ceb-4978-bdf4-b734299bb434 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:24.489818 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9365a-825d-4bb9-a2b2-4f8f56d0b7b5 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:24.535825 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce52a42-3ceb-4978-bdf4-b734299bb434 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:24.572085 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247a8b5-f44a-4c19-b4bb-dab209cf87cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:24.572861 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247a8b5-f44a-4c19-b4bb-dab209cf87cb None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:24.573140 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247a8b5-f44a-4c19-b4bb-dab209cf87cb None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:24.573411 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247a8b5-f44a-4c19-b4bb-dab209cf87cb None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:24.574511 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247a8b5-f44a-4c19-b4bb-dab209cf87cb None admin] RBAC: Adding query filter params (name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:24.574619 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06cebd-b485-4768-8499-6efeeb3b4511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:24.574832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247a8b5-f44a-4c19-b4bb-dab209cf87cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:24.575177 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06cebd-b485-4768-8499-6efeeb3b4511 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:24.575460 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06cebd-b485-4768-8499-6efeeb3b4511 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:24.575768 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06cebd-b485-4768-8499-6efeeb3b4511 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:24.576497 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06cebd-b485-4768-8499-6efeeb3b4511 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:24.576802 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06cebd-b485-4768-8499-6efeeb3b4511 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:24.578164 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06cebd-b485-4768-8499-6efeeb3b4511 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:24.580259 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247a8b5-f44a-4c19-b4bb-dab209cf87cb None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:24.591611 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 305/620] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:24.597774 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 316/621] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Apr 11 13:42:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:24.600940 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06cebd-b485-4768-8499-6efeeb3b4511 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:24.603847 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247a8b5-f44a-4c19-b4bb-dab209cf87cb None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:24.708202 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247a8b5-f44a-4c19-b4bb-dab209cf87cb None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:24.741768 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e584f0-a942-4f79-995e-c273b52be3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:24.742567 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e584f0-a942-4f79-995e-c273b52be3a2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:24.742845 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e584f0-a942-4f79-995e-c273b52be3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:24.743121 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e584f0-a942-4f79-995e-c273b52be3a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:24.753810 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e584f0-a942-4f79-995e-c273b52be3a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:24.755282 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e584f0-a942-4f79-995e-c273b52be3a2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:24.774284 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-b7e584f0-a942-4f79-995e-c273b52be3a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:24.776061 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 317/622] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:24.784518 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e584f0-a942-4f79-995e-c273b52be3a2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:24.817688 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06cebd-b485-4768-8499-6efeeb3b4511 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:24.892511 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e584f0-a942-4f79-995e-c273b52be3a2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:24.913738 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965920f-bec3-45ee-b701-fd98287ef249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:24.914561 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965920f-bec3-45ee-b701-fd98287ef249 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:24.914840 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965920f-bec3-45ee-b701-fd98287ef249 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:24.915111 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965920f-bec3-45ee-b701-fd98287ef249 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:24.925774 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253675d-9774-4492-ab2a-cecf223c8cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:24.926435 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253675d-9774-4492-ab2a-cecf223c8cd1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:24.926756 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253675d-9774-4492-ab2a-cecf223c8cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:24.927032 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253675d-9774-4492-ab2a-cecf223c8cd1 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:24.928359 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253675d-9774-4492-ab2a-cecf223c8cd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:24.928663 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253675d-9774-4492-ab2a-cecf223c8cd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:24.930031 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253675d-9774-4492-ab2a-cecf223c8cd1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:24.932864 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965920f-bec3-45ee-b701-fd98287ef249 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:24.934314 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965920f-bec3-45ee-b701-fd98287ef249 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:24.942319 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 318/623] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:24.949388 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253675d-9774-4492-ab2a-cecf223c8cd1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:24.957672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-6965920f-bec3-45ee-b701-fd98287ef249 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:24.966342 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 306/624] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:24.971965 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965920f-bec3-45ee-b701-fd98287ef249 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:25.112394 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965920f-bec3-45ee-b701-fd98287ef249 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:25.149369 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253675d-9774-4492-ab2a-cecf223c8cd1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:25.168235 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79c9f2-4f78-40c9-99d3-bb6ad9e36890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:25.168893 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79c9f2-4f78-40c9-99d3-bb6ad9e36890 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:25.169170 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79c9f2-4f78-40c9-99d3-bb6ad9e36890 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:25.169440 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79c9f2-4f78-40c9-99d3-bb6ad9e36890 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:25.170226 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79c9f2-4f78-40c9-99d3-bb6ad9e36890 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:25.170530 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79c9f2-4f78-40c9-99d3-bb6ad9e36890 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:25.171983 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79c9f2-4f78-40c9-99d3-bb6ad9e36890 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:25.197386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 307/625] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:25.207710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79c9f2-4f78-40c9-99d3-bb6ad9e36890 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:25.226260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c76d99-2195-4688-8ddf-fea4a9567593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:25.227000 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c76d99-2195-4688-8ddf-fea4a9567593 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:25.227275 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c76d99-2195-4688-8ddf-fea4a9567593 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:25.227547 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c76d99-2195-4688-8ddf-fea4a9567593 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:25.238248 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c76d99-2195-4688-8ddf-fea4a9567593 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:25.239775 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c76d99-2195-4688-8ddf-fea4a9567593 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:25.254487 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-94c76d99-2195-4688-8ddf-fea4a9567593 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 11 13:42:25.256594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 319/626] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:42:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:25.258332 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2281b-cbb9-417c-897f-e8becba6bae5 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:25.258763 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2281b-cbb9-417c-897f-e8becba6bae5 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:25.259176 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2281b-cbb9-417c-897f-e8becba6bae5 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:25.260851 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 320/627] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:25.262528 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2281b-cbb9-417c-897f-e8becba6bae5 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:25.335906 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79c9f2-4f78-40c9-99d3-bb6ad9e36890 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:25.373824 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff25f5-c01e-4505-a821-63edb1824c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:25.374979 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff25f5-c01e-4505-a821-63edb1824c2c None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:25.375398 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff25f5-c01e-4505-a821-63edb1824c2c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:25.375870 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff25f5-c01e-4505-a821-63edb1824c2c None admin] PATH_INFO: `/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/6660794b27ff4a7bbe9b6b043593598c/roles/c190a911c52940bb9b0fc255a4f7cad3` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:25.380187 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2281b-cbb9-417c-897f-e8becba6bae5 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:25.391904 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff25f5-c01e-4505-a821-63edb1824c2c None admin] RBAC: Authorizing `identity:create_grant(project_id=d46063ee60fd4f6dba86d1c5946e9381, user_id=6660794b27ff4a7bbe9b6b043593598c, role_id=c190a911c52940bb9b0fc255a4f7cad3)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:25.393563 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff25f5-c01e-4505-a821-63edb1824c2c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:25.415532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 308/628] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:42:25 2022] PUT /identity/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/6660794b27ff4a7bbe9b6b043593598c/roles/c190a911c52940bb9b0fc255a4f7cad3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:42:25.415532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219792c7-0748-4e22-9321-abdf4d32ecca None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:25.415532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219792c7-0748-4e22-9321-abdf4d32ecca None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:25.415532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219792c7-0748-4e22-9321-abdf4d32ecca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:25.437546 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08045a-35e0-4e9b-b2b4-7f043f938c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:25.439969 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08045a-35e0-4e9b-b2b4-7f043f938c22 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:25.440254 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08045a-35e0-4e9b-b2b4-7f043f938c22 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:25.440528 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08045a-35e0-4e9b-b2b4-7f043f938c22 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:25.442776 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08045a-35e0-4e9b-b2b4-7f043f938c22 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:25.443872 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08045a-35e0-4e9b-b2b4-7f043f938c22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:25.447683 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08045a-35e0-4e9b-b2b4-7f043f938c22 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:25.454690 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-219792c7-0748-4e22-9321-abdf4d32ecca None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:25.455286 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-219792c7-0748-4e22-9321-abdf4d32ecca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:25.484444 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 321/629] 10.222.0.67 () {56 vars in 1137 bytes} [Mon Apr 11 13:42:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:25.490478 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08045a-35e0-4e9b-b2b4-7f043f938c22 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:25.559920 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 309/630] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:25.582040 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219792c7-0748-4e22-9321-abdf4d32ecca None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:25.666152 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08045a-35e0-4e9b-b2b4-7f043f938c22 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:25.686077 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219792c7-0748-4e22-9321-abdf4d32ecca None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:25.714399 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00ee1c-3222-488f-bd63-aa2e0b3eeeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:25.715439 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00ee1c-3222-488f-bd63-aa2e0b3eeeb9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:25.715841 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00ee1c-3222-488f-bd63-aa2e0b3eeeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:25.716180 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00ee1c-3222-488f-bd63-aa2e0b3eeeb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:25.726350 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbc524-52c3-49d9-9ee8-b5f75b21f59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:25.727416 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbc524-52c3-49d9-9ee8-b5f75b21f59b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:25.728003 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbc524-52c3-49d9-9ee8-b5f75b21f59b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:25.728448 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbc524-52c3-49d9-9ee8-b5f75b21f59b None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:25.741868 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbc524-52c3-49d9-9ee8-b5f75b21f59b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:25.749143 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-45dbc524-52c3-49d9-9ee8-b5f75b21f59b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:42:25.755261 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 310/631] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:42:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:25.756892 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d17f23-be78-421c-8750-ba3ada70cd01 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:25.757359 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d17f23-be78-421c-8750-ba3ada70cd01 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:25.757820 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d17f23-be78-421c-8750-ba3ada70cd01 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:25.759676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 311/632] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:25.760984 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d17f23-be78-421c-8750-ba3ada70cd01 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:25.793790 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00ee1c-3222-488f-bd63-aa2e0b3eeeb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:25.795269 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00ee1c-3222-488f-bd63-aa2e0b3eeeb9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:25.869956 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d17f23-be78-421c-8750-ba3ada70cd01 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:25.910838 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 322/633] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:42:25.913424 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889efc1-33cf-4b60-86ca-fc17758b928b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:25.913912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889efc1-33cf-4b60-86ca-fc17758b928b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:25.914358 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889efc1-33cf-4b60-86ca-fc17758b928b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:25.919772 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93215f3b-dae3-461d-b2d8-f197a2922b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:25.920739 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93215f3b-dae3-461d-b2d8-f197a2922b64 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:25.921196 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93215f3b-dae3-461d-b2d8-f197a2922b64 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:25.921671 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93215f3b-dae3-461d-b2d8-f197a2922b64 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:25.922620 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93215f3b-dae3-461d-b2d8-f197a2922b64 None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:25.923108 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93215f3b-dae3-461d-b2d8-f197a2922b64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:25.924739 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93215f3b-dae3-461d-b2d8-f197a2922b64 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:25.934501 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-5889efc1-33cf-4b60-86ca-fc17758b928b None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:25.935754 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5889efc1-33cf-4b60-86ca-fc17758b928b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:25.939709 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 312/634] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Apr 11 13:42:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:25.940956 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93215f3b-dae3-461d-b2d8-f197a2922b64 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:26.014253 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 323/635] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:26.015028 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889efc1-33cf-4b60-86ca-fc17758b928b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:26.067146 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93215f3b-dae3-461d-b2d8-f197a2922b64 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:26.101250 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6af1f-6d4a-4360-8b73-1b5b7df5dbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:26.102139 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6af1f-6d4a-4360-8b73-1b5b7df5dbb6 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:26.102613 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6af1f-6d4a-4360-8b73-1b5b7df5dbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:26.102735 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6af1f-6d4a-4360-8b73-1b5b7df5dbb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:26.113021 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6af1f-6d4a-4360-8b73-1b5b7df5dbb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:26.114583 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6af1f-6d4a-4360-8b73-1b5b7df5dbb6 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:26.128511 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889efc1-33cf-4b60-86ca-fc17758b928b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:26.131690 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-acd6af1f-6d4a-4360-8b73-1b5b7df5dbb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:26.132908 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 313/636] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:26.137530 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6af1f-6d4a-4360-8b73-1b5b7df5dbb6 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:26.170834 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f6efe-d73c-4271-b923-535259f5c8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:26.172507 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f6efe-d73c-4271-b923-535259f5c8a7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:26.173270 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f6efe-d73c-4271-b923-535259f5c8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:26.173785 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f6efe-d73c-4271-b923-535259f5c8a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:26.187295 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f6efe-d73c-4271-b923-535259f5c8a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:26.189933 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f6efe-d73c-4271-b923-535259f5c8a7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:26.213069 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-e66f6efe-d73c-4271-b923-535259f5c8a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:26.215374 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 324/637] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:26.216521 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f6efe-d73c-4271-b923-535259f5c8a7 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:26.250999 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6af1f-6d4a-4360-8b73-1b5b7df5dbb6 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:26.290675 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1ae92-48b1-4340-81ea-bc888ac8b6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:26.291404 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1ae92-48b1-4340-81ea-bc888ac8b6bb None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:26.291889 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1ae92-48b1-4340-81ea-bc888ac8b6bb None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:26.292183 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1ae92-48b1-4340-81ea-bc888ac8b6bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:26.305447 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1ae92-48b1-4340-81ea-bc888ac8b6bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:26.314570 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-8be1ae92-48b1-4340-81ea-bc888ac8b6bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:42:26.319710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 314/638] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:42:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:26.320792 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1ae92-48b1-4340-81ea-bc888ac8b6bb None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:26.341499 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f6efe-d73c-4271-b923-535259f5c8a7 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:26.380497 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923294e-90ad-4acd-ae5f-cb4380cf35b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:26.380497 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923294e-90ad-4acd-ae5f-cb4380cf35b1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:26.380497 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923294e-90ad-4acd-ae5f-cb4380cf35b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:26.380497 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923294e-90ad-4acd-ae5f-cb4380cf35b1 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:26.381975 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923294e-90ad-4acd-ae5f-cb4380cf35b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:26.382285 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923294e-90ad-4acd-ae5f-cb4380cf35b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:26.384441 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923294e-90ad-4acd-ae5f-cb4380cf35b1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:26.396327 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 325/639] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:26.397435 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923294e-90ad-4acd-ae5f-cb4380cf35b1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:26.434304 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1ae92-48b1-4340-81ea-bc888ac8b6bb None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:26.467622 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4ed69-cf9b-447e-8e2a-733ec4d6034f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:26.468363 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4ed69-cf9b-447e-8e2a-733ec4d6034f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:26.468650 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4ed69-cf9b-447e-8e2a-733ec4d6034f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:26.468927 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4ed69-cf9b-447e-8e2a-733ec4d6034f None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:26.469654 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4ed69-cf9b-447e-8e2a-733ec4d6034f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:26.469961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4ed69-cf9b-447e-8e2a-733ec4d6034f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:26.471366 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4ed69-cf9b-447e-8e2a-733ec4d6034f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:26.483399 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 315/640] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:26.484689 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e956a-e239-46a1-9d3c-812c850814c3 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:26.484978 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e956a-e239-46a1-9d3c-812c850814c3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:26.485253 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e956a-e239-46a1-9d3c-812c850814c3 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:26.486615 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 316/641] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:26.487151 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e956a-e239-46a1-9d3c-812c850814c3 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:26.502466 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923294e-90ad-4acd-ae5f-cb4380cf35b1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:26.537318 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2509a-ffd4-4532-b320-3174e7e7c118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:26.538123 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2509a-ffd4-4532-b320-3174e7e7c118 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:26.538854 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2509a-ffd4-4532-b320-3174e7e7c118 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:26.539135 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2509a-ffd4-4532-b320-3174e7e7c118 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:26.540188 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2509a-ffd4-4532-b320-3174e7e7c118 None admin] RBAC: Adding query filter params (name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:26.540496 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2509a-ffd4-4532-b320-3174e7e7c118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:26.542668 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2509a-ffd4-4532-b320-3174e7e7c118 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:26.557947 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 326/642] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Apr 11 13:42:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:26.557947 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2509a-ffd4-4532-b320-3174e7e7c118 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:26.584090 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e956a-e239-46a1-9d3c-812c850814c3 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:26.617727 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f216e0-617f-4b2f-87d9-ea780580b9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:26.618517 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f216e0-617f-4b2f-87d9-ea780580b9c4 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:26.618797 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f216e0-617f-4b2f-87d9-ea780580b9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:26.619067 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f216e0-617f-4b2f-87d9-ea780580b9c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:26.625560 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f216e0-617f-4b2f-87d9-ea780580b9c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:26.627005 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f216e0-617f-4b2f-87d9-ea780580b9c4 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:26.639873 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-d3f216e0-617f-4b2f-87d9-ea780580b9c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:26.645898 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 317/643] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:26.645898 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cc739-eb57-40f9-959a-3f1f0cf10864 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:26.645898 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cc739-eb57-40f9-959a-3f1f0cf10864 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:26.645898 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67cc739-eb57-40f9-959a-3f1f0cf10864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:26.658517 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2509a-ffd4-4532-b320-3174e7e7c118 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:26.658681 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-d67cc739-eb57-40f9-959a-3f1f0cf10864 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:26.659827 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d67cc739-eb57-40f9-959a-3f1f0cf10864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:26.695667 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2206e2-3faf-4829-9acf-8d8f6a1ff058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:26.696484 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2206e2-3faf-4829-9acf-8d8f6a1ff058 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:26.696767 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2206e2-3faf-4829-9acf-8d8f6a1ff058 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:26.697043 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2206e2-3faf-4829-9acf-8d8f6a1ff058 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:26.706155 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2206e2-3faf-4829-9acf-8d8f6a1ff058 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:26.707592 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2206e2-3faf-4829-9acf-8d8f6a1ff058 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:26.721051 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-3e2206e2-3faf-4829-9acf-8d8f6a1ff058 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 11 13:42:26.735668 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 318/644] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:26.735668 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67cc739-eb57-40f9-959a-3f1f0cf10864 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:26.735937 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 327/645] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:42:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:26.735937 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2206e2-3faf-4829-9acf-8d8f6a1ff058 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:26.835208 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2206e2-3faf-4829-9acf-8d8f6a1ff058 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:26.837322 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67cc739-eb57-40f9-959a-3f1f0cf10864 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:26.869149 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f7d56-3688-4cf8-ac6d-77e207e27ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:26.869434 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b17de-7a02-4a3a-8de6-7a809927258b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:26.869812 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f7d56-3688-4cf8-ac6d-77e207e27ab1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:26.870098 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f7d56-3688-4cf8-ac6d-77e207e27ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:26.870193 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b17de-7a02-4a3a-8de6-7a809927258b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:26.870621 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f7d56-3688-4cf8-ac6d-77e207e27ab1 None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:26.870695 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b17de-7a02-4a3a-8de6-7a809927258b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:26.870695 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b17de-7a02-4a3a-8de6-7a809927258b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:26.871148 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f7d56-3688-4cf8-ac6d-77e207e27ab1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:26.871458 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f7d56-3688-4cf8-ac6d-77e207e27ab1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:26.872912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f7d56-3688-4cf8-ac6d-77e207e27ab1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:26.881461 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b17de-7a02-4a3a-8de6-7a809927258b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:26.882883 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b17de-7a02-4a3a-8de6-7a809927258b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:26.889662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 328/646] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:26.889662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f7d56-3688-4cf8-ac6d-77e207e27ab1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:26.905242 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-336b17de-7a02-4a3a-8de6-7a809927258b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:26.910713 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 319/647] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:26.910713 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b17de-7a02-4a3a-8de6-7a809927258b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:26.986055 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f7d56-3688-4cf8-ac6d-77e207e27ab1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:27.004531 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b17de-7a02-4a3a-8de6-7a809927258b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:27.019700 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e92e3f-fc41-4e66-afe2-e37fb3b9d9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:27.020377 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e92e3f-fc41-4e66-afe2-e37fb3b9d9c5 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:27.020660 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e92e3f-fc41-4e66-afe2-e37fb3b9d9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:27.020933 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e92e3f-fc41-4e66-afe2-e37fb3b9d9c5 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:27.021863 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e92e3f-fc41-4e66-afe2-e37fb3b9d9c5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:27.022186 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e92e3f-fc41-4e66-afe2-e37fb3b9d9c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:27.023604 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e92e3f-fc41-4e66-afe2-e37fb3b9d9c5 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:27.040493 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb88e4f-5c97-4294-ab6a-bbe8d687853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:27.041298 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb88e4f-5c97-4294-ab6a-bbe8d687853c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:27.041579 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb88e4f-5c97-4294-ab6a-bbe8d687853c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:27.041853 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb88e4f-5c97-4294-ab6a-bbe8d687853c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:27.048954 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 329/648] 10.222.0.67 () {56 vars in 1137 bytes} [Mon Apr 11 13:42:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:27.049937 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e92e3f-fc41-4e66-afe2-e37fb3b9d9c5 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:27.051906 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb88e4f-5c97-4294-ab6a-bbe8d687853c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:27.059570 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-9cb88e4f-5c97-4294-ab6a-bbe8d687853c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:42:27.065345 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 320/649] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:42:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:27.065345 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb88e4f-5c97-4294-ab6a-bbe8d687853c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:27.150139 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e92e3f-fc41-4e66-afe2-e37fb3b9d9c5 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:27.162086 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb88e4f-5c97-4294-ab6a-bbe8d687853c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:27.182884 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f1bdf-5218-431c-98cf-582ec3f62c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:27.183540 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f1bdf-5218-431c-98cf-582ec3f62c1c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:27.183852 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f1bdf-5218-431c-98cf-582ec3f62c1c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:27.184126 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f1bdf-5218-431c-98cf-582ec3f62c1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:27.184953 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f1bdf-5218-431c-98cf-582ec3f62c1c None admin] RBAC: Adding query filter params (role.id=c190a911c52940bb9b0fc255a4f7cad3, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=08cbf69574af4e25b940ec038f9e1bd1) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:27.185260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f1bdf-5218-431c-98cf-582ec3f62c1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:27.186675 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f1bdf-5218-431c-98cf-582ec3f62c1c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:27.192402 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 330/650] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:42:27 2022] GET /identity/v3/role_assignments?user.id=08cbf69574af4e25b940ec038f9e1bd1&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=c190a911c52940bb9b0fc255a4f7cad3 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:27.193820 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f1bdf-5218-431c-98cf-582ec3f62c1c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:27.215360 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17adf445-4da0-4802-9851-f06ce0645ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:27.216409 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adf445-4da0-4802-9851-f06ce0645ac3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:27.216921 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adf445-4da0-4802-9851-f06ce0645ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:27.217961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17adf445-4da0-4802-9851-f06ce0645ac3 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:27.219279 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17adf445-4da0-4802-9851-f06ce0645ac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:27.219808 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17adf445-4da0-4802-9851-f06ce0645ac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:27.222378 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17adf445-4da0-4802-9851-f06ce0645ac3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:27.245416 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 321/651] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:27.245416 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17adf445-4da0-4802-9851-f06ce0645ac3 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:27.308131 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f1bdf-5218-431c-98cf-582ec3f62c1c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:27.346110 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03d308-e3a2-4133-adb0-cdce466e09a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:27.346778 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03d308-e3a2-4133-adb0-cdce466e09a4 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:27.347058 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03d308-e3a2-4133-adb0-cdce466e09a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:27.347341 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03d308-e3a2-4133-adb0-cdce466e09a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:27.361801 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17adf445-4da0-4802-9851-f06ce0645ac3 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:27.412118 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10430897-7d0c-4f88-9503-000042be1988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:27.412118 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10430897-7d0c-4f88-9503-000042be1988 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:27.412118 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10430897-7d0c-4f88-9503-000042be1988 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:27.412596 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10430897-7d0c-4f88-9503-000042be1988 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:27.413651 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10430897-7d0c-4f88-9503-000042be1988 None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:27.414501 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10430897-7d0c-4f88-9503-000042be1988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:27.415993 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10430897-7d0c-4f88-9503-000042be1988 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:27.424941 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 322/652] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Apr 11 13:42:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:27.426527 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10430897-7d0c-4f88-9503-000042be1988 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:27.433279 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03d308-e3a2-4133-adb0-cdce466e09a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:27.434750 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03d308-e3a2-4133-adb0-cdce466e09a4 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:27.532796 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10430897-7d0c-4f88-9503-000042be1988 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:27.559575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 331/653] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:42:27.560467 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03d308-e3a2-4133-adb0-cdce466e09a4 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:27.569530 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066518d8-7228-4d56-aa82-8c15215d1ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:27.570332 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066518d8-7228-4d56-aa82-8c15215d1ee8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:27.570614 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066518d8-7228-4d56-aa82-8c15215d1ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:27.573368 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066518d8-7228-4d56-aa82-8c15215d1ee8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:27.582420 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066518d8-7228-4d56-aa82-8c15215d1ee8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:27.585256 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066518d8-7228-4d56-aa82-8c15215d1ee8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:27.600922 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-066518d8-7228-4d56-aa82-8c15215d1ee8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 13:42:27.602437 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 323/654] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Apr 11 13:42:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:27.603218 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066518d8-7228-4d56-aa82-8c15215d1ee8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:27.665657 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03d308-e3a2-4133-adb0-cdce466e09a4 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:27.700191 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375efb2-6f21-4c4a-bea4-f3e5e908cd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:27.701748 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375efb2-6f21-4c4a-bea4-f3e5e908cd7b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:27.702232 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375efb2-6f21-4c4a-bea4-f3e5e908cd7b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:27.702731 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375efb2-6f21-4c4a-bea4-f3e5e908cd7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:27.713354 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375efb2-6f21-4c4a-bea4-f3e5e908cd7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:27.715082 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375efb2-6f21-4c4a-bea4-f3e5e908cd7b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:27.716277 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066518d8-7228-4d56-aa82-8c15215d1ee8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:27.732805 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-a375efb2-6f21-4c4a-bea4-f3e5e908cd7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:27.734840 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 332/655] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:27.735868 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375efb2-6f21-4c4a-bea4-f3e5e908cd7b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:27.757440 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111058cb-c6af-4398-b71c-8346a34fb937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:27.758474 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111058cb-c6af-4398-b71c-8346a34fb937 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:27.758756 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111058cb-c6af-4398-b71c-8346a34fb937 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:27.759028 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111058cb-c6af-4398-b71c-8346a34fb937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:27.776988 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111058cb-c6af-4398-b71c-8346a34fb937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:27.778475 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111058cb-c6af-4398-b71c-8346a34fb937 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:27.799734 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-111058cb-c6af-4398-b71c-8346a34fb937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:27.801732 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 324/656] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:27.802571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111058cb-c6af-4398-b71c-8346a34fb937 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:27.842684 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375efb2-6f21-4c4a-bea4-f3e5e908cd7b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:27.884643 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4239e-4e0f-472d-b0c5-a14f7b82a658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:27.885651 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4239e-4e0f-472d-b0c5-a14f7b82a658 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:27.886157 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4239e-4e0f-472d-b0c5-a14f7b82a658 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:27.886654 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4239e-4e0f-472d-b0c5-a14f7b82a658 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:27.887712 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4239e-4e0f-472d-b0c5-a14f7b82a658 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:27.888219 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4239e-4e0f-472d-b0c5-a14f7b82a658 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:27.889842 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4239e-4e0f-472d-b0c5-a14f7b82a658 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:27.908505 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 333/657] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Apr 11 13:42:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:27.909813 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4239e-4e0f-472d-b0c5-a14f7b82a658 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:27.922090 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111058cb-c6af-4398-b71c-8346a34fb937 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:27.956818 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51814dbf-ef9d-4636-96f9-14032bfa55de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:27.957893 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814dbf-ef9d-4636-96f9-14032bfa55de None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:27.958334 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814dbf-ef9d-4636-96f9-14032bfa55de None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:27.958866 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814dbf-ef9d-4636-96f9-14032bfa55de None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:27.959598 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51814dbf-ef9d-4636-96f9-14032bfa55de None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:27.959937 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51814dbf-ef9d-4636-96f9-14032bfa55de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:27.961331 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51814dbf-ef9d-4636-96f9-14032bfa55de None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:27.977617 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 325/658] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:27.977617 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d02b5f-72af-4a8d-8649-499c77748349 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:27.977617 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d02b5f-72af-4a8d-8649-499c77748349 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:27.977617 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d02b5f-72af-4a8d-8649-499c77748349 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:27.977617 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 326/659] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:27.977617 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d02b5f-72af-4a8d-8649-499c77748349 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:28.017942 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4239e-4e0f-472d-b0c5-a14f7b82a658 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:28.051928 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe17e4-e748-4b0f-bc70-6f881e9b676e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:28.053231 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe17e4-e748-4b0f-bc70-6f881e9b676e None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:28.053517 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe17e4-e748-4b0f-bc70-6f881e9b676e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:28.053794 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe17e4-e748-4b0f-bc70-6f881e9b676e None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:28.054520 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe17e4-e748-4b0f-bc70-6f881e9b676e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:28.054827 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe17e4-e748-4b0f-bc70-6f881e9b676e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:28.056220 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe17e4-e748-4b0f-bc70-6f881e9b676e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:28.071875 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 334/660] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:28.071875 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe17e4-e748-4b0f-bc70-6f881e9b676e None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:28.082962 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d02b5f-72af-4a8d-8649-499c77748349 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:28.118640 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bcd02-982b-4798-accd-d291fa57a0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:28.119300 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bcd02-982b-4798-accd-d291fa57a0d6 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:28.119585 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bcd02-982b-4798-accd-d291fa57a0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:28.119888 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bcd02-982b-4798-accd-d291fa57a0d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:28.164390 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe17e4-e748-4b0f-bc70-6f881e9b676e None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:28.186251 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81bcd02-982b-4798-accd-d291fa57a0d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:28.187733 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81bcd02-982b-4798-accd-d291fa57a0d6 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:28.198684 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a479293-4b22-43ee-a7a2-80c245496147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:28.198684 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a479293-4b22-43ee-a7a2-80c245496147 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:28.198684 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a479293-4b22-43ee-a7a2-80c245496147 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:28.198684 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a479293-4b22-43ee-a7a2-80c245496147 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:28.207178 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a479293-4b22-43ee-a7a2-80c245496147 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:28.208683 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a479293-4b22-43ee-a7a2-80c245496147 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:28.222711 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-0a479293-4b22-43ee-a7a2-80c245496147 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 11 13:42:28.223923 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 335/661] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:42:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:28.225726 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00330845-d117-4dc6-b8b9-d70fa76c3bf5 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:28.226013 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00330845-d117-4dc6-b8b9-d70fa76c3bf5 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:28.226293 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00330845-d117-4dc6-b8b9-d70fa76c3bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:28.245443 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-00330845-d117-4dc6-b8b9-d70fa76c3bf5 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:28.246615 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-00330845-d117-4dc6-b8b9-d70fa76c3bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:28.293936 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 327/662] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:42:28.293936 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bcd02-982b-4798-accd-d291fa57a0d6 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:28.322361 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 336/663] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:28.322361 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00330845-d117-4dc6-b8b9-d70fa76c3bf5 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:28.407298 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bcd02-982b-4798-accd-d291fa57a0d6 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:28.417271 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00330845-d117-4dc6-b8b9-d70fa76c3bf5 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:28.446720 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abca7e5-591c-4dd8-ab2c-85791a60853f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:28.447466 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abca7e5-591c-4dd8-ab2c-85791a60853f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:28.447799 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abca7e5-591c-4dd8-ab2c-85791a60853f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:28.448108 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abca7e5-591c-4dd8-ab2c-85791a60853f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:28.451124 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe97c8-2ef6-4997-9e58-d9496bf63c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:28.451816 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe97c8-2ef6-4997-9e58-d9496bf63c27 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:28.452097 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe97c8-2ef6-4997-9e58-d9496bf63c27 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:28.452367 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe97c8-2ef6-4997-9e58-d9496bf63c27 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:28.453194 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe97c8-2ef6-4997-9e58-d9496bf63c27 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:28.453497 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe97c8-2ef6-4997-9e58-d9496bf63c27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:28.454908 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe97c8-2ef6-4997-9e58-d9496bf63c27 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:28.455003 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abca7e5-591c-4dd8-ab2c-85791a60853f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:28.456446 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abca7e5-591c-4dd8-ab2c-85791a60853f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:28.469476 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-7abca7e5-591c-4dd8-ab2c-85791a60853f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:28.470699 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 328/664] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:28.471472 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abca7e5-591c-4dd8-ab2c-85791a60853f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:28.472002 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 337/665] 10.222.0.67 () {56 vars in 1139 bytes} [Mon Apr 11 13:42:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:28.472942 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe97c8-2ef6-4997-9e58-d9496bf63c27 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:28.571496 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe97c8-2ef6-4997-9e58-d9496bf63c27 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:28.572294 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abca7e5-591c-4dd8-ab2c-85791a60853f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:28.604208 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f048a-5049-48e6-8879-8cb2ad09f6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:28.604650 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd35602-d5ea-4942-8528-ea4c586adee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:28.605001 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f048a-5049-48e6-8879-8cb2ad09f6a9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:28.605277 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f048a-5049-48e6-8879-8cb2ad09f6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:28.605444 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd35602-d5ea-4942-8528-ea4c586adee3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:28.605537 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f048a-5049-48e6-8879-8cb2ad09f6a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:28.605715 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd35602-d5ea-4942-8528-ea4c586adee3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:28.605986 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd35602-d5ea-4942-8528-ea4c586adee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:28.616046 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f048a-5049-48e6-8879-8cb2ad09f6a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:28.617733 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd35602-d5ea-4942-8528-ea4c586adee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:28.619203 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd35602-d5ea-4942-8528-ea4c586adee3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:28.622910 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-851f048a-5049-48e6-8879-8cb2ad09f6a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:42:28.629056 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 338/666] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:42:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:28.629056 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f048a-5049-48e6-8879-8cb2ad09f6a9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:28.636358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-bfd35602-d5ea-4942-8528-ea4c586adee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:28.637675 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 329/667] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:28.642389 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd35602-d5ea-4942-8528-ea4c586adee3 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:28.725946 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f048a-5049-48e6-8879-8cb2ad09f6a9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:28.738817 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd35602-d5ea-4942-8528-ea4c586adee3 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:28.759303 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2474f-c010-4146-9137-ac885a6de200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:28.759950 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2474f-c010-4146-9137-ac885a6de200 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:28.760234 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2474f-c010-4146-9137-ac885a6de200 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:28.760514 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2474f-c010-4146-9137-ac885a6de200 None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:28.761294 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2474f-c010-4146-9137-ac885a6de200 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:28.761604 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2474f-c010-4146-9137-ac885a6de200 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:28.763029 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2474f-c010-4146-9137-ac885a6de200 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:28.775126 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 339/668] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:28.775902 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2474f-c010-4146-9137-ac885a6de200 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:28.783320 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b68b0-bc42-4522-ba98-fa1ad8c3d9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:28.784652 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b68b0-bc42-4522-ba98-fa1ad8c3d9c0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:28.785146 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b68b0-bc42-4522-ba98-fa1ad8c3d9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:28.785978 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b68b0-bc42-4522-ba98-fa1ad8c3d9c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:28.852611 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b68b0-bc42-4522-ba98-fa1ad8c3d9c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:28.854083 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b68b0-bc42-4522-ba98-fa1ad8c3d9c0 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:28.871001 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2474f-c010-4146-9137-ac885a6de200 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:28.905007 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1692e-b685-42bd-9be6-2fdc2c509ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:28.905673 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1692e-b685-42bd-9be6-2fdc2c509ece None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:28.905961 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1692e-b685-42bd-9be6-2fdc2c509ece None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:28.906243 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1692e-b685-42bd-9be6-2fdc2c509ece None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:28.906985 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1692e-b685-42bd-9be6-2fdc2c509ece None admin] RBAC: Adding query filter params (name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:28.907288 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1692e-b685-42bd-9be6-2fdc2c509ece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:28.908677 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1692e-b685-42bd-9be6-2fdc2c509ece None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:28.921705 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 340/669] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Apr 11 13:42:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:28.922329 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1692e-b685-42bd-9be6-2fdc2c509ece None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:28.954529 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 330/670] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:42:28.955422 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b68b0-bc42-4522-ba98-fa1ad8c3d9c0 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:29.021457 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1692e-b685-42bd-9be6-2fdc2c509ece None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:29.056166 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b68b0-bc42-4522-ba98-fa1ad8c3d9c0 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:29.056357 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d71805-5d35-45fd-a0b0-335729e9488c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:29.057035 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d71805-5d35-45fd-a0b0-335729e9488c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:29.057351 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d71805-5d35-45fd-a0b0-335729e9488c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:29.057632 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d71805-5d35-45fd-a0b0-335729e9488c None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:29.058349 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d71805-5d35-45fd-a0b0-335729e9488c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:29.058659 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d71805-5d35-45fd-a0b0-335729e9488c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:29.060052 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d71805-5d35-45fd-a0b0-335729e9488c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:29.071555 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 341/671] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:29.072401 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d71805-5d35-45fd-a0b0-335729e9488c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:29.094644 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43e9f5-51bd-4608-9d92-b5ba2d4c5643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:29.095303 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43e9f5-51bd-4608-9d92-b5ba2d4c5643 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:29.095584 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43e9f5-51bd-4608-9d92-b5ba2d4c5643 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:29.095885 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43e9f5-51bd-4608-9d92-b5ba2d4c5643 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:29.096757 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43e9f5-51bd-4608-9d92-b5ba2d4c5643 None admin] RBAC: Adding query filter params (role.id=c190a911c52940bb9b0fc255a4f7cad3, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=af2e8f671cba49969ccf9e13778b5052) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:29.097040 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43e9f5-51bd-4608-9d92-b5ba2d4c5643 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:29.098476 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43e9f5-51bd-4608-9d92-b5ba2d4c5643 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:29.112053 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 331/672] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:42:28 2022] GET /identity/v3/role_assignments?user.id=af2e8f671cba49969ccf9e13778b5052&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=c190a911c52940bb9b0fc255a4f7cad3 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:29.113380 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43e9f5-51bd-4608-9d92-b5ba2d4c5643 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:29.181634 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d71805-5d35-45fd-a0b0-335729e9488c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:29.230200 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfa7e5-fc9a-471c-8f31-cee43ca390e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:29.231362 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfa7e5-fc9a-471c-8f31-cee43ca390e5 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:29.231680 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfa7e5-fc9a-471c-8f31-cee43ca390e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:29.231964 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfa7e5-fc9a-471c-8f31-cee43ca390e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:29.237901 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43e9f5-51bd-4608-9d92-b5ba2d4c5643 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:29.245382 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfa7e5-fc9a-471c-8f31-cee43ca390e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:29.246932 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfa7e5-fc9a-471c-8f31-cee43ca390e5 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:29.270041 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-bbcfa7e5-fc9a-471c-8f31-cee43ca390e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:29.272336 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 342/673] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:29.276603 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfa7e5-fc9a-471c-8f31-cee43ca390e5 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:29.285882 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50c679-d35f-422a-8985-4c8fe73c829c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:29.287908 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50c679-d35f-422a-8985-4c8fe73c829c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:29.288790 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50c679-d35f-422a-8985-4c8fe73c829c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:29.289513 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50c679-d35f-422a-8985-4c8fe73c829c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:29.306654 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50c679-d35f-422a-8985-4c8fe73c829c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:29.309184 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50c679-d35f-422a-8985-4c8fe73c829c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:29.330562 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-bb50c679-d35f-422a-8985-4c8fe73c829c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:29.332322 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 332/674] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:29.333263 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50c679-d35f-422a-8985-4c8fe73c829c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:29.405083 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfa7e5-fc9a-471c-8f31-cee43ca390e5 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:29.440869 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9cafd0-ab2c-4291-9d8f-a10159ae1a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:29.441678 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cafd0-ab2c-4291-9d8f-a10159ae1a5d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:29.441959 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cafd0-ab2c-4291-9d8f-a10159ae1a5d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:29.442231 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9cafd0-ab2c-4291-9d8f-a10159ae1a5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:29.449887 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9cafd0-ab2c-4291-9d8f-a10159ae1a5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:29.451343 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9cafd0-ab2c-4291-9d8f-a10159ae1a5d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:29.452777 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50c679-d35f-422a-8985-4c8fe73c829c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:29.465528 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-0a9cafd0-ab2c-4291-9d8f-a10159ae1a5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:29.467136 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 343/675] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:29.472521 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9cafd0-ab2c-4291-9d8f-a10159ae1a5d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:29.493758 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d66801-0380-4ae9-9429-7cdb5bf3c784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:29.494439 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66801-0380-4ae9-9429-7cdb5bf3c784 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:29.494721 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66801-0380-4ae9-9429-7cdb5bf3c784 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:29.494994 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66801-0380-4ae9-9429-7cdb5bf3c784 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:29.496221 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d66801-0380-4ae9-9429-7cdb5bf3c784 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:29.496533 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d66801-0380-4ae9-9429-7cdb5bf3c784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:29.498400 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d66801-0380-4ae9-9429-7cdb5bf3c784 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:29.513233 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 333/676] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:29.514499 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d66801-0380-4ae9-9429-7cdb5bf3c784 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:29.582074 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9cafd0-ab2c-4291-9d8f-a10159ae1a5d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:29.619419 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851135b-3559-45e2-be85-4470cde502a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:29.620219 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851135b-3559-45e2-be85-4470cde502a3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:29.620662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851135b-3559-45e2-be85-4470cde502a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:29.621091 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851135b-3559-45e2-be85-4470cde502a3 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:29.621899 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851135b-3559-45e2-be85-4470cde502a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:29.622275 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851135b-3559-45e2-be85-4470cde502a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:29.623244 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d66801-0380-4ae9-9429-7cdb5bf3c784 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:29.623888 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851135b-3559-45e2-be85-4470cde502a3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:29.636523 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 344/677] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:29.637495 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851135b-3559-45e2-be85-4470cde502a3 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:29.657908 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149f67c-8c49-4143-8f7b-d518f10cfa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:29.658583 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149f67c-8c49-4143-8f7b-d518f10cfa6c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:29.658869 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149f67c-8c49-4143-8f7b-d518f10cfa6c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:29.659146 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149f67c-8c49-4143-8f7b-d518f10cfa6c None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:29.660034 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149f67c-8c49-4143-8f7b-d518f10cfa6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:29.660344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149f67c-8c49-4143-8f7b-d518f10cfa6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:29.662593 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149f67c-8c49-4143-8f7b-d518f10cfa6c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:29.679919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 334/678] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:29.680866 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149f67c-8c49-4143-8f7b-d518f10cfa6c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:29.741076 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851135b-3559-45e2-be85-4470cde502a3 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:29.773083 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57968f50-fd5f-4c4e-8572-f5a0a5895999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:29.773869 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57968f50-fd5f-4c4e-8572-f5a0a5895999 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:29.774148 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57968f50-fd5f-4c4e-8572-f5a0a5895999 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:29.774434 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57968f50-fd5f-4c4e-8572-f5a0a5895999 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:29.780099 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149f67c-8c49-4143-8f7b-d518f10cfa6c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:29.781611 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57968f50-fd5f-4c4e-8572-f5a0a5895999 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:29.783022 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57968f50-fd5f-4c4e-8572-f5a0a5895999 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:29.796939 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-57968f50-fd5f-4c4e-8572-f5a0a5895999 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 13:42:29.798117 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 345/679] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:42:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:29.798879 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57968f50-fd5f-4c4e-8572-f5a0a5895999 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:29.817453 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d813eb7-6f31-4413-a10b-2d72433d56f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:29.818528 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d813eb7-6f31-4413-a10b-2d72433d56f3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:29.818992 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d813eb7-6f31-4413-a10b-2d72433d56f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:29.819487 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d813eb7-6f31-4413-a10b-2d72433d56f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:29.826651 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d813eb7-6f31-4413-a10b-2d72433d56f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:29.828141 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d813eb7-6f31-4413-a10b-2d72433d56f3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:29.841505 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-2d813eb7-6f31-4413-a10b-2d72433d56f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:29.847386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 335/680] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:29.848510 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f74b22-5f34-44f0-8f07-4f0d4dc405fb None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:29.848809 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f74b22-5f34-44f0-8f07-4f0d4dc405fb None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:29.849633 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f74b22-5f34-44f0-8f07-4f0d4dc405fb None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:29.851168 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 336/681] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:29.851972 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f74b22-5f34-44f0-8f07-4f0d4dc405fb None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:29.899314 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57968f50-fd5f-4c4e-8572-f5a0a5895999 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:29.932255 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab0821-9f76-4b7d-9e55-f675f5ec96eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:29.932920 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab0821-9f76-4b7d-9e55-f675f5ec96eb None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:29.933208 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab0821-9f76-4b7d-9e55-f675f5ec96eb None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:29.933487 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab0821-9f76-4b7d-9e55-f675f5ec96eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:29.934385 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab0821-9f76-4b7d-9e55-f675f5ec96eb None admin] RBAC: Adding query filter params (role.id=c190a911c52940bb9b0fc255a4f7cad3, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=fedd2314dc594bcba749bf7b0d1e50fb) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:29.934704 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab0821-9f76-4b7d-9e55-f675f5ec96eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:29.936160 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab0821-9f76-4b7d-9e55-f675f5ec96eb None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:29.942015 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 346/682] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:42:29 2022] GET /identity/v3/role_assignments?user.id=fedd2314dc594bcba749bf7b0d1e50fb&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=c190a911c52940bb9b0fc255a4f7cad3 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:29.943664 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab0821-9f76-4b7d-9e55-f675f5ec96eb None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:29.965101 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f74b22-5f34-44f0-8f07-4f0d4dc405fb None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:30.018330 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709866b-7f84-4d5d-86c9-ae123d056cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:30.019680 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709866b-7f84-4d5d-86c9-ae123d056cac None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:30.019976 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709866b-7f84-4d5d-86c9-ae123d056cac None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:30.020259 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709866b-7f84-4d5d-86c9-ae123d056cac None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:30.021742 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709866b-7f84-4d5d-86c9-ae123d056cac None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:30.022072 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709866b-7f84-4d5d-86c9-ae123d056cac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:30.025384 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709866b-7f84-4d5d-86c9-ae123d056cac None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:30.051751 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 337/683] 10.222.0.67 () {56 vars in 1135 bytes} [Mon Apr 11 13:42:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:30.053930 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d979173-f131-4168-a1c7-ec7898b64edb None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:30.054220 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d979173-f131-4168-a1c7-ec7898b64edb None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:30.054505 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d979173-f131-4168-a1c7-ec7898b64edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:30.064526 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab0821-9f76-4b7d-9e55-f675f5ec96eb None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:30.072890 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-7d979173-f131-4168-a1c7-ec7898b64edb None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:30.074370 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7d979173-f131-4168-a1c7-ec7898b64edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:30.111878 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b0a56-10d4-4eb4-b3d3-caafc242a6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:30.112478 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b0a56-10d4-4eb4-b3d3-caafc242a6ac None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:30.112766 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b0a56-10d4-4eb4-b3d3-caafc242a6ac None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:30.113046 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b0a56-10d4-4eb4-b3d3-caafc242a6ac None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:30.113851 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b0a56-10d4-4eb4-b3d3-caafc242a6ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:30.114164 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b0a56-10d4-4eb4-b3d3-caafc242a6ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:30.116462 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b0a56-10d4-4eb4-b3d3-caafc242a6ac None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:30.135670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 347/684] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:30.135670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b0a56-10d4-4eb4-b3d3-caafc242a6ac None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:30.168269 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 338/685] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:30.169015 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d979173-f131-4168-a1c7-ec7898b64edb None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:30.256147 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b0a56-10d4-4eb4-b3d3-caafc242a6ac None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:30.284204 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d979173-f131-4168-a1c7-ec7898b64edb None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:30.295678 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcfd44-4ad0-40b3-86e0-195b7eec8a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:30.296401 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcfd44-4ad0-40b3-86e0-195b7eec8a83 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:30.296680 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcfd44-4ad0-40b3-86e0-195b7eec8a83 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:30.296956 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dcfd44-4ad0-40b3-86e0-195b7eec8a83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:30.325854 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317704d-9a52-459c-8694-f89a779744e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:30.326997 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317704d-9a52-459c-8694-f89a779744e6 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:30.327845 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317704d-9a52-459c-8694-f89a779744e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:30.328451 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317704d-9a52-459c-8694-f89a779744e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:30.329575 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317704d-9a52-459c-8694-f89a779744e6 None admin] RBAC: Adding query filter params (role.id=c190a911c52940bb9b0fc255a4f7cad3, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=c084d218ea414d638ef2dc45364a492c) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:30.330197 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317704d-9a52-459c-8694-f89a779744e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:30.332436 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317704d-9a52-459c-8694-f89a779744e6 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:30.340859 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 339/686] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:42:30 2022] GET /identity/v3/role_assignments?user.id=c084d218ea414d638ef2dc45364a492c&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=c190a911c52940bb9b0fc255a4f7cad3 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:30.341923 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317704d-9a52-459c-8694-f89a779744e6 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:30.424850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcfd44-4ad0-40b3-86e0-195b7eec8a83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:30.426397 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dcfd44-4ad0-40b3-86e0-195b7eec8a83 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:30.483089 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317704d-9a52-459c-8694-f89a779744e6 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:30.519961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082d0ba-69df-4195-adca-db1a1153dce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:30.520883 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082d0ba-69df-4195-adca-db1a1153dce8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:30.521712 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082d0ba-69df-4195-adca-db1a1153dce8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:30.521976 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082d0ba-69df-4195-adca-db1a1153dce8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:30.533212 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082d0ba-69df-4195-adca-db1a1153dce8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:30.534722 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082d0ba-69df-4195-adca-db1a1153dce8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:30.553803 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-c082d0ba-69df-4195-adca-db1a1153dce8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:30.555214 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 340/687] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:30.563162 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082d0ba-69df-4195-adca-db1a1153dce8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:30.618595 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 348/688] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:42:30.624479 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcfd44-4ad0-40b3-86e0-195b7eec8a83 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:30.664926 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082d0ba-69df-4195-adca-db1a1153dce8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:30.698621 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e49ae0-8a7a-4163-bfd7-b66e73d821fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:30.699543 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e49ae0-8a7a-4163-bfd7-b66e73d821fb None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:30.699855 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e49ae0-8a7a-4163-bfd7-b66e73d821fb None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:30.700132 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e49ae0-8a7a-4163-bfd7-b66e73d821fb None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:30.700857 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e49ae0-8a7a-4163-bfd7-b66e73d821fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:30.701165 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e49ae0-8a7a-4163-bfd7-b66e73d821fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:30.702540 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e49ae0-8a7a-4163-bfd7-b66e73d821fb None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:30.714663 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 341/689] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:30.721192 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e49ae0-8a7a-4163-bfd7-b66e73d821fb None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:30.733991 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dcfd44-4ad0-40b3-86e0-195b7eec8a83 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:30.769850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4592aef-aa75-4c9c-adc1-3514a6935d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:30.771972 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4592aef-aa75-4c9c-adc1-3514a6935d5e None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:30.772491 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4592aef-aa75-4c9c-adc1-3514a6935d5e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:30.772982 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4592aef-aa75-4c9c-adc1-3514a6935d5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:30.783315 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4592aef-aa75-4c9c-adc1-3514a6935d5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:30.785058 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4592aef-aa75-4c9c-adc1-3514a6935d5e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:30.803051 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-c4592aef-aa75-4c9c-adc1-3514a6935d5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:30.804875 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 349/690] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:30.810414 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4592aef-aa75-4c9c-adc1-3514a6935d5e None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:30.824001 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e49ae0-8a7a-4163-bfd7-b66e73d821fb None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:30.859867 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce811f-da40-470d-9ef5-972b2fb30628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:30.860374 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce811f-da40-470d-9ef5-972b2fb30628 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:30.860659 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce811f-da40-470d-9ef5-972b2fb30628 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:30.860938 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce811f-da40-470d-9ef5-972b2fb30628 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:30.861658 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce811f-da40-470d-9ef5-972b2fb30628 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:30.871655 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce811f-da40-470d-9ef5-972b2fb30628 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:30.887126 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 342/691] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Apr 11 13:42:30 2022] POST /identity/v3/users => generated 254 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:42:30.973600 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4592aef-aa75-4c9c-adc1-3514a6935d5e None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:31.024895 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceca0c-b6ba-465b-8430-a4111f77526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:31.026054 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceca0c-b6ba-465b-8430-a4111f77526b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:31.026541 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceca0c-b6ba-465b-8430-a4111f77526b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:31.027043 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceca0c-b6ba-465b-8430-a4111f77526b None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:31.028066 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceca0c-b6ba-465b-8430-a4111f77526b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:31.028596 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceca0c-b6ba-465b-8430-a4111f77526b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:31.030205 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceca0c-b6ba-465b-8430-a4111f77526b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:31.047802 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 350/692] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:31.054409 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce811f-da40-470d-9ef5-972b2fb30628 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:31.180615 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce811f-da40-470d-9ef5-972b2fb30628 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:31.213776 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324090a-6980-4958-afe3-50c74a469b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:31.214580 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324090a-6980-4958-afe3-50c74a469b6d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:31.214862 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324090a-6980-4958-afe3-50c74a469b6d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:31.215132 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324090a-6980-4958-afe3-50c74a469b6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:31.228011 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324090a-6980-4958-afe3-50c74a469b6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:31.229716 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324090a-6980-4958-afe3-50c74a469b6d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:31.247084 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-0324090a-6980-4958-afe3-50c74a469b6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:31.248929 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 343/693] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:31.254475 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceca0c-b6ba-465b-8430-a4111f77526b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:31.360088 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceca0c-b6ba-465b-8430-a4111f77526b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:31.397617 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654c0d9-2ca9-45f3-b3d3-1b1b8b9553ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:31.398303 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654c0d9-2ca9-45f3-b3d3-1b1b8b9553ba None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:31.398590 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654c0d9-2ca9-45f3-b3d3-1b1b8b9553ba None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:31.399201 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654c0d9-2ca9-45f3-b3d3-1b1b8b9553ba None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:31.399679 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654c0d9-2ca9-45f3-b3d3-1b1b8b9553ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:31.399996 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654c0d9-2ca9-45f3-b3d3-1b1b8b9553ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:31.401446 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654c0d9-2ca9-45f3-b3d3-1b1b8b9553ba None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:31.414670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 351/694] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:31.420775 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324090a-6980-4958-afe3-50c74a469b6d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:31.538014 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324090a-6980-4958-afe3-50c74a469b6d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:31.587334 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a46dd7-649e-4f0d-8541-8df4ce0fc682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:31.588028 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a46dd7-649e-4f0d-8541-8df4ce0fc682 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:31.588316 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a46dd7-649e-4f0d-8541-8df4ce0fc682 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:31.588594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a46dd7-649e-4f0d-8541-8df4ce0fc682 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:31.589435 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a46dd7-649e-4f0d-8541-8df4ce0fc682 None admin] RBAC: Adding query filter params (role.id=c190a911c52940bb9b0fc255a4f7cad3, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=6660794b27ff4a7bbe9b6b043593598c) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:31.589745 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a46dd7-649e-4f0d-8541-8df4ce0fc682 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:31.591197 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a46dd7-649e-4f0d-8541-8df4ce0fc682 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:31.597704 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 344/695] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:42:31 2022] GET /identity/v3/role_assignments?user.id=6660794b27ff4a7bbe9b6b043593598c&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=c190a911c52940bb9b0fc255a4f7cad3 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:31.693333 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334a6a4-82f1-4249-a7d5-f2f5ee886ad8 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:31.693615 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334a6a4-82f1-4249-a7d5-f2f5ee886ad8 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:31.693891 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334a6a4-82f1-4249-a7d5-f2f5ee886ad8 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:31.695507 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 352/696] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:31.701006 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbb823-a91a-41cc-acb5-3a4679378e43 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:31.701293 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbb823-a91a-41cc-acb5-3a4679378e43 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:31.701572 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbb823-a91a-41cc-acb5-3a4679378e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:31.725029 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4dcbb823-a91a-41cc-acb5-3a4679378e43 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:31.726450 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4dcbb823-a91a-41cc-acb5-3a4679378e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:31.816169 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 345/697] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:31.857492 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334a6a4-82f1-4249-a7d5-f2f5ee886ad8 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:31.968585 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334a6a4-82f1-4249-a7d5-f2f5ee886ad8 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:32.002522 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fb9ae-bb2c-4edc-9970-ec3a26d6a9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:32.003338 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fb9ae-bb2c-4edc-9970-ec3a26d6a9c1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:32.003621 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fb9ae-bb2c-4edc-9970-ec3a26d6a9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:32.003922 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fb9ae-bb2c-4edc-9970-ec3a26d6a9c1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:32.004575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7fb9ae-bb2c-4edc-9970-ec3a26d6a9c1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:32.006718 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7fb9ae-bb2c-4edc-9970-ec3a26d6a9c1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:32.019756 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-fe7fb9ae-bb2c-4edc-9970-ec3a26d6a9c1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 11 13:42:32.021905 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 353/698] 10.222.0.67 () {56 vars in 1129 bytes} [Mon Apr 11 13:42:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:32.029159 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbb823-a91a-41cc-acb5-3a4679378e43 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:32.131443 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbb823-a91a-41cc-acb5-3a4679378e43 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:32.164583 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c144a3-9d58-428a-9c9b-ed8d7edef010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:32.165259 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c144a3-9d58-428a-9c9b-ed8d7edef010 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:32.165543 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c144a3-9d58-428a-9c9b-ed8d7edef010 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:32.165816 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c144a3-9d58-428a-9c9b-ed8d7edef010 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:32.166537 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c144a3-9d58-428a-9c9b-ed8d7edef010 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:32.166839 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c144a3-9d58-428a-9c9b-ed8d7edef010 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:32.168254 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c144a3-9d58-428a-9c9b-ed8d7edef010 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:32.173054 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 346/699] 10.222.0.67 () {56 vars in 1124 bytes} [Mon Apr 11 13:42:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:32.179265 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fb9ae-bb2c-4edc-9970-ec3a26d6a9c1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:32.283760 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fb9ae-bb2c-4edc-9970-ec3a26d6a9c1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:32.320060 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac00647-c094-4473-a079-ac8d2e68fece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:32.320734 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac00647-c094-4473-a079-ac8d2e68fece None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:32.321080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac00647-c094-4473-a079-ac8d2e68fece None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:32.321356 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac00647-c094-4473-a079-ac8d2e68fece None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:32.322114 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac00647-c094-4473-a079-ac8d2e68fece None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:32.322423 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac00647-c094-4473-a079-ac8d2e68fece None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:32.324085 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac00647-c094-4473-a079-ac8d2e68fece None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:32.330183 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 354/700] 10.222.0.67 () {56 vars in 1124 bytes} [Mon Apr 11 13:42:32 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:33.054338 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fca669-39d3-4187-aec4-8cc1af4794df None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:33.055023 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fca669-39d3-4187-aec4-8cc1af4794df None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:33.055506 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fca669-39d3-4187-aec4-8cc1af4794df None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:33.057080 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 347/701] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:33.062419 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da944f-faa4-425f-96cd-cd2d25f56fb6 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:33.063299 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da944f-faa4-425f-96cd-cd2d25f56fb6 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:33.063824 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da944f-faa4-425f-96cd-cd2d25f56fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:33.088622 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e7da944f-faa4-425f-96cd-cd2d25f56fb6 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:33.090166 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e7da944f-faa4-425f-96cd-cd2d25f56fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:33.170559 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 355/702] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:33.203164 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16d459-5214-44ac-a9e7-cc6a12be4ea1 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:33.204104 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16d459-5214-44ac-a9e7-cc6a12be4ea1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:33.204578 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16d459-5214-44ac-a9e7-cc6a12be4ea1 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:33.206128 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 348/703] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:42:33.207359 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da944f-faa4-425f-96cd-cd2d25f56fb6 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:33.211220 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d2c86-853e-45ab-9e0b-a06b201093f7 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:33.211769 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d2c86-853e-45ab-9e0b-a06b201093f7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:33.212305 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d2c86-853e-45ab-9e0b-a06b201093f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:33.235275 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-850d2c86-853e-45ab-9e0b-a06b201093f7 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:33.237959 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-850d2c86-853e-45ab-9e0b-a06b201093f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:33.365066 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 349/704] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:33.381960 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da944f-faa4-425f-96cd-cd2d25f56fb6 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:33.418966 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d2c86-853e-45ab-9e0b-a06b201093f7 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:33.421065 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf6df4-cb00-4eaf-922a-fdebffea5c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:33.422900 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf6df4-cb00-4eaf-922a-fdebffea5c05 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:33.428394 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf6df4-cb00-4eaf-922a-fdebffea5c05 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:33.428713 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf6df4-cb00-4eaf-922a-fdebffea5c05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:33.452083 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf6df4-cb00-4eaf-922a-fdebffea5c05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:33.462500 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-99bf6df4-cb00-4eaf-922a-fdebffea5c05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:42:33.464072 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 356/705] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:42:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:33.472576 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf6df4-cb00-4eaf-922a-fdebffea5c05 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:33.540216 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d2c86-853e-45ab-9e0b-a06b201093f7 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:33.578063 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e9559-4734-4259-bced-a69af852491e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:33.578875 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e9559-4734-4259-bced-a69af852491e None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:33.579158 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e9559-4734-4259-bced-a69af852491e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:33.579433 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e9559-4734-4259-bced-a69af852491e None admin] PATH_INFO: `/v3/services/network` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:33.580124 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e9559-4734-4259-bced-a69af852491e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:33.581500 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e9559-4734-4259-bced-a69af852491e None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:33.605666 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-909e9559-4734-4259-bced-a69af852491e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 11 13:42:33.606893 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 350/706] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:33 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:33.617223 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e9559-4734-4259-bced-a69af852491e None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:33.662254 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf6df4-cb00-4eaf-922a-fdebffea5c05 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:33.721609 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc54e4-bec4-4aab-b695-04ce0b7cacd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:33.722292 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc54e4-bec4-4aab-b695-04ce0b7cacd0 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:33.722577 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc54e4-bec4-4aab-b695-04ce0b7cacd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:33.722857 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc54e4-bec4-4aab-b695-04ce0b7cacd0 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:33.723678 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc54e4-bec4-4aab-b695-04ce0b7cacd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:33.724049 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc54e4-bec4-4aab-b695-04ce0b7cacd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:33.725485 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc54e4-bec4-4aab-b695-04ce0b7cacd0 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:33.735234 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 357/707] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:42:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:33.742441 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc54e4-bec4-4aab-b695-04ce0b7cacd0 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:33.809724 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e9559-4734-4259-bced-a69af852491e None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:33.869090 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc54e4-bec4-4aab-b695-04ce0b7cacd0 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:33.872830 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb336c-a5bf-4f89-a5e7-f534b8a02a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:33.873508 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb336c-a5bf-4f89-a5e7-f534b8a02a40 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:33.873792 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb336c-a5bf-4f89-a5e7-f534b8a02a40 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:33.874070 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb336c-a5bf-4f89-a5e7-f534b8a02a40 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:33.874792 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb336c-a5bf-4f89-a5e7-f534b8a02a40 None admin] RBAC: Adding query filter params (name=network) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:33.875095 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb336c-a5bf-4f89-a5e7-f534b8a02a40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:33.876522 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb336c-a5bf-4f89-a5e7-f534b8a02a40 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:33.887887 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 351/708] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Apr 11 13:42:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:33.893457 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb336c-a5bf-4f89-a5e7-f534b8a02a40 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:33.941727 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31aa3b8-8494-4f08-b135-fe046baca677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:33.943591 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31aa3b8-8494-4f08-b135-fe046baca677 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:33.944122 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31aa3b8-8494-4f08-b135-fe046baca677 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:33.944605 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31aa3b8-8494-4f08-b135-fe046baca677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:33.964258 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31aa3b8-8494-4f08-b135-fe046baca677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:33.966032 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31aa3b8-8494-4f08-b135-fe046baca677 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:33.989144 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-a31aa3b8-8494-4f08-b135-fe046baca677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:33.997346 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 358/709] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:34.003172 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31aa3b8-8494-4f08-b135-fe046baca677 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:34.075129 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb336c-a5bf-4f89-a5e7-f534b8a02a40 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:34.133743 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bceeda1-2425-4632-af6f-820f0cb4ea5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:34.134751 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bceeda1-2425-4632-af6f-820f0cb4ea5d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:34.135266 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bceeda1-2425-4632-af6f-820f0cb4ea5d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:34.135775 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bceeda1-2425-4632-af6f-820f0cb4ea5d None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:34.136681 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bceeda1-2425-4632-af6f-820f0cb4ea5d None admin] RBAC: Adding query filter params (type=network) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:34.137196 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bceeda1-2425-4632-af6f-820f0cb4ea5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:34.138766 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bceeda1-2425-4632-af6f-820f0cb4ea5d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:34.152807 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 352/710] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Apr 11 13:42:33 2022] GET /identity/v3/services?type=network => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:34.167691 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb8d4a-3585-4aac-89cf-49ca965fb247 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:34.168310 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb8d4a-3585-4aac-89cf-49ca965fb247 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:34.168784 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb8d4a-3585-4aac-89cf-49ca965fb247 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:34.170665 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 353/711] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:42:34.183077 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc227457-65d5-4b6b-b7e4-f290e7568eb8 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:34.183809 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc227457-65d5-4b6b-b7e4-f290e7568eb8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:34.184290 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc227457-65d5-4b6b-b7e4-f290e7568eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:34.209949 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31aa3b8-8494-4f08-b135-fe046baca677 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:34.213150 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-cc227457-65d5-4b6b-b7e4-f290e7568eb8 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:34.215746 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-cc227457-65d5-4b6b-b7e4-f290e7568eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:34.290608 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4559cb-84fc-458d-b67b-1131286f8cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:34.291736 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4559cb-84fc-458d-b67b-1131286f8cfb None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:34.292234 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4559cb-84fc-458d-b67b-1131286f8cfb None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:34.292705 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4559cb-84fc-458d-b67b-1131286f8cfb None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:34.293653 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4559cb-84fc-458d-b67b-1131286f8cfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:34.294166 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4559cb-84fc-458d-b67b-1131286f8cfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:34.296160 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4559cb-84fc-458d-b67b-1131286f8cfb None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:34.320617 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 359/712] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:34.325838 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4559cb-84fc-458d-b67b-1131286f8cfb None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:34.326111 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 354/713] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 13:42:34.375489 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc227457-65d5-4b6b-b7e4-f290e7568eb8 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:34.464563 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4559cb-84fc-458d-b67b-1131286f8cfb None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:34.483899 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc227457-65d5-4b6b-b7e4-f290e7568eb8 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:34.500230 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde219a1-d7e7-49e8-a86d-06836fba7aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:34.501029 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde219a1-d7e7-49e8-a86d-06836fba7aba None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:34.501305 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde219a1-d7e7-49e8-a86d-06836fba7aba None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:34.501574 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde219a1-d7e7-49e8-a86d-06836fba7aba None admin] PATH_INFO: `/v3/users/nova` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:34.509204 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde219a1-d7e7-49e8-a86d-06836fba7aba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:34.510650 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde219a1-d7e7-49e8-a86d-06836fba7aba None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:34.519340 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1817602-3d4c-4e58-a758-12701f3be5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:34.520191 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1817602-3d4c-4e58-a758-12701f3be5a9 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:34.521076 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1817602-3d4c-4e58-a758-12701f3be5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:34.521433 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1817602-3d4c-4e58-a758-12701f3be5a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:34.525607 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-bde219a1-d7e7-49e8-a86d-06836fba7aba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 13:42:34.527141 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 360/714] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Apr 11 13:42:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:34.534698 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde219a1-d7e7-49e8-a86d-06836fba7aba None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:34.537545 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1817602-3d4c-4e58-a758-12701f3be5a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:34.544807 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-e1817602-3d4c-4e58-a758-12701f3be5a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:42:34.546316 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 355/715] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:42:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:34.570960 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1817602-3d4c-4e58-a758-12701f3be5a9 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:34.645000 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde219a1-d7e7-49e8-a86d-06836fba7aba None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:34.686619 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acb2c9-5ecc-4128-a399-bc4e446aaa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:34.687212 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acb2c9-5ecc-4128-a399-bc4e446aaa09 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:34.687495 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acb2c9-5ecc-4128-a399-bc4e446aaa09 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:34.688768 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acb2c9-5ecc-4128-a399-bc4e446aaa09 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:34.689612 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acb2c9-5ecc-4128-a399-bc4e446aaa09 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:34.689924 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acb2c9-5ecc-4128-a399-bc4e446aaa09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:34.691746 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acb2c9-5ecc-4128-a399-bc4e446aaa09 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:34.726418 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 361/716] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Apr 11 13:42:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:34.732503 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acb2c9-5ecc-4128-a399-bc4e446aaa09 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:34.757270 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1817602-3d4c-4e58-a758-12701f3be5a9 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:34.790659 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af6df7-7ebf-4382-ac9c-4a47110f5113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:34.791332 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af6df7-7ebf-4382-ac9c-4a47110f5113 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:34.791683 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af6df7-7ebf-4382-ac9c-4a47110f5113 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:34.791965 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af6df7-7ebf-4382-ac9c-4a47110f5113 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:34.792730 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af6df7-7ebf-4382-ac9c-4a47110f5113 None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:34.793037 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af6df7-7ebf-4382-ac9c-4a47110f5113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:34.794414 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af6df7-7ebf-4382-ac9c-4a47110f5113 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:34.803268 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 356/717] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Apr 11 13:42:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:34.804652 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e9ceb-758f-4c63-b40f-7176b7815ba3 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:34.804945 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e9ceb-758f-4c63-b40f-7176b7815ba3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:34.805225 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e9ceb-758f-4c63-b40f-7176b7815ba3 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:34.806688 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 357/718] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:34.808801 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e9ceb-758f-4c63-b40f-7176b7815ba3 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:34.855676 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acb2c9-5ecc-4128-a399-bc4e446aaa09 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:34.889245 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e85783-dd05-447a-beac-5ef0a03bb51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:34.890067 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e85783-dd05-447a-beac-5ef0a03bb51d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:34.890451 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e85783-dd05-447a-beac-5ef0a03bb51d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:34.890828 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e85783-dd05-447a-beac-5ef0a03bb51d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:34.924773 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e9ceb-758f-4c63-b40f-7176b7815ba3 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:34.966121 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c39ac6-fd93-4f21-89a1-075d0c88c495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:34.967033 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c39ac6-fd93-4f21-89a1-075d0c88c495 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:34.967461 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c39ac6-fd93-4f21-89a1-075d0c88c495 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:34.967909 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c39ac6-fd93-4f21-89a1-075d0c88c495 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:34.969228 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e85783-dd05-447a-beac-5ef0a03bb51d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:34.971174 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e85783-dd05-447a-beac-5ef0a03bb51d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:34.980333 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c39ac6-fd93-4f21-89a1-075d0c88c495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:34.982003 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c39ac6-fd93-4f21-89a1-075d0c88c495 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:34.999099 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-50c39ac6-fd93-4f21-89a1-075d0c88c495 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:35.000855 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 358/719] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:35.002227 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fa418-081d-4e48-91a1-3f8ef41861f5 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:35.002614 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fa418-081d-4e48-91a1-3f8ef41861f5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:35.002991 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fa418-081d-4e48-91a1-3f8ef41861f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:35.020344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0d0fa418-081d-4e48-91a1-3f8ef41861f5 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:35.022001 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0d0fa418-081d-4e48-91a1-3f8ef41861f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:35.089257 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 362/720] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:42:35.090204 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e85783-dd05-447a-beac-5ef0a03bb51d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:35.096121 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 359/721] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:35.097365 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fa418-081d-4e48-91a1-3f8ef41861f5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:35.200224 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e85783-dd05-447a-beac-5ef0a03bb51d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:35.232430 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fa418-081d-4e48-91a1-3f8ef41861f5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:35.233850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7f9fb-4013-40ef-85fa-10925b9022f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:35.234668 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7f9fb-4013-40ef-85fa-10925b9022f9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:35.235052 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7f9fb-4013-40ef-85fa-10925b9022f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:35.235432 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7f9fb-4013-40ef-85fa-10925b9022f9 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:35.236285 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7f9fb-4013-40ef-85fa-10925b9022f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:35.236713 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7f9fb-4013-40ef-85fa-10925b9022f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:35.238183 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7f9fb-4013-40ef-85fa-10925b9022f9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:35.250698 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 363/722] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:35.251716 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7f9fb-4013-40ef-85fa-10925b9022f9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:35.272182 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a82a9-0344-4ee6-8872-33a336f0122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:35.272985 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a82a9-0344-4ee6-8872-33a336f0122d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:35.273264 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a82a9-0344-4ee6-8872-33a336f0122d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:35.273535 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a82a9-0344-4ee6-8872-33a336f0122d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:35.287792 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a82a9-0344-4ee6-8872-33a336f0122d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:35.290231 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a82a9-0344-4ee6-8872-33a336f0122d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:35.312502 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-041a82a9-0344-4ee6-8872-33a336f0122d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:35.314594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 360/723] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:35.315445 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a82a9-0344-4ee6-8872-33a336f0122d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:35.366962 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7f9fb-4013-40ef-85fa-10925b9022f9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:35.405049 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a07c1-2acc-433c-84d8-15c67d606617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:35.405850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a07c1-2acc-433c-84d8-15c67d606617 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:35.406132 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a07c1-2acc-433c-84d8-15c67d606617 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:35.406416 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a07c1-2acc-433c-84d8-15c67d606617 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:35.416320 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a07c1-2acc-433c-84d8-15c67d606617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:35.422677 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a82a9-0344-4ee6-8872-33a336f0122d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:35.423236 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-8a7a07c1-2acc-433c-84d8-15c67d606617 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:42:35.430209 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 364/724] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:42:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:35.430209 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a07c1-2acc-433c-84d8-15c67d606617 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:35.464022 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254531d5-a3a7-4665-94ad-3ab777d59ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:35.464851 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254531d5-a3a7-4665-94ad-3ab777d59ad9 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:35.465139 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254531d5-a3a7-4665-94ad-3ab777d59ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:35.465419 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254531d5-a3a7-4665-94ad-3ab777d59ad9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:35.472517 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254531d5-a3a7-4665-94ad-3ab777d59ad9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:35.474743 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254531d5-a3a7-4665-94ad-3ab777d59ad9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:35.488940 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-254531d5-a3a7-4665-94ad-3ab777d59ad9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 13:42:35.494804 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 361/725] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Apr 11 13:42:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:35.496138 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c50fd5-6376-47da-82b9-e71490d75385 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:35.496429 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c50fd5-6376-47da-82b9-e71490d75385 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:35.496707 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c50fd5-6376-47da-82b9-e71490d75385 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:35.498121 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 362/726] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:35.502525 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c50fd5-6376-47da-82b9-e71490d75385 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:35.531608 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a07c1-2acc-433c-84d8-15c67d606617 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:35.568163 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab119b-0db9-4f01-967d-98f7fe54f174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:35.569038 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab119b-0db9-4f01-967d-98f7fe54f174 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:35.569341 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab119b-0db9-4f01-967d-98f7fe54f174 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:35.569625 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab119b-0db9-4f01-967d-98f7fe54f174 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:35.570825 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab119b-0db9-4f01-967d-98f7fe54f174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:35.571140 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab119b-0db9-4f01-967d-98f7fe54f174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:35.573051 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab119b-0db9-4f01-967d-98f7fe54f174 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:35.585608 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 365/727] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:35.586698 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab119b-0db9-4f01-967d-98f7fe54f174 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:35.609803 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c50fd5-6376-47da-82b9-e71490d75385 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:35.643211 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bfd9a-a0ac-4524-82aa-f3f40fd08dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:35.643912 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bfd9a-a0ac-4524-82aa-f3f40fd08dab None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:35.644198 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bfd9a-a0ac-4524-82aa-f3f40fd08dab None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:35.644477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bfd9a-a0ac-4524-82aa-f3f40fd08dab None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:35.645226 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bfd9a-a0ac-4524-82aa-f3f40fd08dab None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:35.646146 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bfd9a-a0ac-4524-82aa-f3f40fd08dab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:35.647515 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bfd9a-a0ac-4524-82aa-f3f40fd08dab None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:35.660182 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 363/728] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:42:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:35.660182 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf98a1-d098-4cf3-88c6-d930b4156af5 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:35.660182 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf98a1-d098-4cf3-88c6-d930b4156af5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:35.660182 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf98a1-d098-4cf3-88c6-d930b4156af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:35.677602 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b2cf98a1-d098-4cf3-88c6-d930b4156af5 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:35.678909 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b2cf98a1-d098-4cf3-88c6-d930b4156af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:35.684695 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab119b-0db9-4f01-967d-98f7fe54f174 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:35.718295 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d2b3b-4f91-4ce9-b9b5-d01cdc4e0ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:35.718971 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d2b3b-4f91-4ce9-b9b5-d01cdc4e0ddb None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:35.719258 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d2b3b-4f91-4ce9-b9b5-d01cdc4e0ddb None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:35.719539 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d2b3b-4f91-4ce9-b9b5-d01cdc4e0ddb None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:35.720402 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d2b3b-4f91-4ce9-b9b5-d01cdc4e0ddb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:35.720717 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d2b3b-4f91-4ce9-b9b5-d01cdc4e0ddb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:35.722138 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d2b3b-4f91-4ce9-b9b5-d01cdc4e0ddb None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:35.743325 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 366/729] 10.222.0.67 () {56 vars in 1149 bytes} [Mon Apr 11 13:42:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:35.743325 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d2b3b-4f91-4ce9-b9b5-d01cdc4e0ddb None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:35.754182 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 364/730] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:35.754182 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf98a1-d098-4cf3-88c6-d930b4156af5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:35.844828 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d2b3b-4f91-4ce9-b9b5-d01cdc4e0ddb None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:35.861133 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf98a1-d098-4cf3-88c6-d930b4156af5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:35.878526 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29713b9e-4903-470d-9b3d-0c56be9c5ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:35.879407 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29713b9e-4903-470d-9b3d-0c56be9c5ca6 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:35.879743 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29713b9e-4903-470d-9b3d-0c56be9c5ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:35.880431 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29713b9e-4903-470d-9b3d-0c56be9c5ca6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:35.887220 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29713b9e-4903-470d-9b3d-0c56be9c5ca6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:35.888714 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29713b9e-4903-470d-9b3d-0c56be9c5ca6 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:35.896612 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbac8f-8960-4679-bc8a-36a9a5c26227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:35.897416 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbac8f-8960-4679-bc8a-36a9a5c26227 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:35.897703 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbac8f-8960-4679-bc8a-36a9a5c26227 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:35.897978 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbac8f-8960-4679-bc8a-36a9a5c26227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:35.901644 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-29713b9e-4903-470d-9b3d-0c56be9c5ca6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:35.907796 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 367/731] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:35.907796 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29713b9e-4903-470d-9b3d-0c56be9c5ca6 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:35.908092 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebbac8f-8960-4679-bc8a-36a9a5c26227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:35.909540 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebbac8f-8960-4679-bc8a-36a9a5c26227 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:35.928418 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-cebbac8f-8960-4679-bc8a-36a9a5c26227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:35.934259 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 365/732] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:35.934259 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbac8f-8960-4679-bc8a-36a9a5c26227 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:36.017663 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29713b9e-4903-470d-9b3d-0c56be9c5ca6 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:36.026411 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbac8f-8960-4679-bc8a-36a9a5c26227 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:36.055776 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f61536-769b-4542-827b-d003f1dc647d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:36.056588 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f61536-769b-4542-827b-d003f1dc647d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:36.057177 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f61536-769b-4542-827b-d003f1dc647d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:36.057447 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f61536-769b-4542-827b-d003f1dc647d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:36.061755 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e55a18-f1be-41a2-badd-c9b1c0bf165c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:36.062425 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e55a18-f1be-41a2-badd-c9b1c0bf165c None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:36.062707 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e55a18-f1be-41a2-badd-c9b1c0bf165c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:36.062981 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e55a18-f1be-41a2-badd-c9b1c0bf165c None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:36.063744 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e55a18-f1be-41a2-badd-c9b1c0bf165c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:36.065141 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e55a18-f1be-41a2-badd-c9b1c0bf165c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:36.090081 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 366/733] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Apr 11 13:42:35 2022] POST /identity/v3/services => generated 251 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:42:36.090081 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e55a18-f1be-41a2-badd-c9b1c0bf165c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:36.144715 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f61536-769b-4542-827b-d003f1dc647d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:36.146839 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f61536-769b-4542-827b-d003f1dc647d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:36.200233 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e55a18-f1be-41a2-badd-c9b1c0bf165c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:36.246084 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cf29f-824a-4728-a037-43abec61ee07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:36.247369 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cf29f-824a-4728-a037-43abec61ee07 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:36.247731 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cf29f-824a-4728-a037-43abec61ee07 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:36.248300 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cf29f-824a-4728-a037-43abec61ee07 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:36.249130 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8cf29f-824a-4728-a037-43abec61ee07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:36.249618 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8cf29f-824a-4728-a037-43abec61ee07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:36.251846 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8cf29f-824a-4728-a037-43abec61ee07 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:36.259819 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 368/734] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:42:36.265690 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f61536-769b-4542-827b-d003f1dc647d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:36.268630 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 367/735] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:36.270596 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cf29f-824a-4728-a037-43abec61ee07 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:36.394376 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f61536-769b-4542-827b-d003f1dc647d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:36.405014 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cf29f-824a-4728-a037-43abec61ee07 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:36.432630 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452906be-0838-48d6-8c0c-afbaa8225ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:36.433301 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452906be-0838-48d6-8c0c-afbaa8225ec8 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:36.433584 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452906be-0838-48d6-8c0c-afbaa8225ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:36.433862 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452906be-0838-48d6-8c0c-afbaa8225ec8 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:36.434596 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452906be-0838-48d6-8c0c-afbaa8225ec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:36.434901 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452906be-0838-48d6-8c0c-afbaa8225ec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:36.436297 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452906be-0838-48d6-8c0c-afbaa8225ec8 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:36.447193 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8f05e-cfc6-469a-83b9-a3717c1e4130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:36.448022 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8f05e-cfc6-469a-83b9-a3717c1e4130 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:36.448283 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 369/736] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:36.448635 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8f05e-cfc6-469a-83b9-a3717c1e4130 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:36.448810 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8f05e-cfc6-469a-83b9-a3717c1e4130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:36.449424 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452906be-0838-48d6-8c0c-afbaa8225ec8 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:36.459803 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8f05e-cfc6-469a-83b9-a3717c1e4130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:36.461372 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8f05e-cfc6-469a-83b9-a3717c1e4130 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:36.479187 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-1cc8f05e-cfc6-469a-83b9-a3717c1e4130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:36.480890 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 368/737] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:36.481767 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8f05e-cfc6-469a-83b9-a3717c1e4130 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:36.558088 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452906be-0838-48d6-8c0c-afbaa8225ec8 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:36.581134 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8f05e-cfc6-469a-83b9-a3717c1e4130 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:36.591825 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cd87c-51e9-4f60-aa11-ac7f22968bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:36.592487 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cd87c-51e9-4f60-aa11-ac7f22968bc6 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:36.592771 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cd87c-51e9-4f60-aa11-ac7f22968bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:36.593048 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cd87c-51e9-4f60-aa11-ac7f22968bc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:36.593885 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cd87c-51e9-4f60-aa11-ac7f22968bc6 None admin] RBAC: Adding query filter params (role.id=e3333fcf22b040e3a1f0bfbfe657cffa, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=fedd2314dc594bcba749bf7b0d1e50fb) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:36.594200 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cd87c-51e9-4f60-aa11-ac7f22968bc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:36.595655 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cd87c-51e9-4f60-aa11-ac7f22968bc6 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:36.602240 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 370/738] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:42:36 2022] GET /identity/v3/role_assignments?user.id=fedd2314dc594bcba749bf7b0d1e50fb&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=e3333fcf22b040e3a1f0bfbfe657cffa => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:36.603439 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cd87c-51e9-4f60-aa11-ac7f22968bc6 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:36.618001 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374498e9-f5cf-4410-a14f-da9cb730315d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:36.618807 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374498e9-f5cf-4410-a14f-da9cb730315d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:36.619089 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374498e9-f5cf-4410-a14f-da9cb730315d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:36.619364 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374498e9-f5cf-4410-a14f-da9cb730315d None admin] PATH_INFO: `/v3/users/swift` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:36.628664 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374498e9-f5cf-4410-a14f-da9cb730315d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:36.630242 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374498e9-f5cf-4410-a14f-da9cb730315d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:36.644889 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-374498e9-f5cf-4410-a14f-da9cb730315d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 13:42:36.647126 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 369/739] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:42:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:36.652503 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374498e9-f5cf-4410-a14f-da9cb730315d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:36.743195 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cd87c-51e9-4f60-aa11-ac7f22968bc6 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:36.777708 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374498e9-f5cf-4410-a14f-da9cb730315d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:36.781677 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b033ae-b7d5-4db4-8e86-ea207085e840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:36.782353 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b033ae-b7d5-4db4-8e86-ea207085e840 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:36.782635 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b033ae-b7d5-4db4-8e86-ea207085e840 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:36.782912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b033ae-b7d5-4db4-8e86-ea207085e840 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:36.783658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b033ae-b7d5-4db4-8e86-ea207085e840 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:36.783975 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b033ae-b7d5-4db4-8e86-ea207085e840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:36.785369 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b033ae-b7d5-4db4-8e86-ea207085e840 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:36.799291 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 371/740] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:36.800724 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb1a68-2e77-412c-8e5b-581bbf9d3879 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:36.801012 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb1a68-2e77-412c-8e5b-581bbf9d3879 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:36.801292 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb1a68-2e77-412c-8e5b-581bbf9d3879 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:36.802955 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 372/741] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:36.804463 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb1a68-2e77-412c-8e5b-581bbf9d3879 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:36.823234 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00207684-5d79-4b45-8936-36ad96995ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:36.824120 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00207684-5d79-4b45-8936-36ad96995ecf None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:36.824559 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00207684-5d79-4b45-8936-36ad96995ecf None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:36.824834 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00207684-5d79-4b45-8936-36ad96995ecf None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:36.826048 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00207684-5d79-4b45-8936-36ad96995ecf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:36.826345 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00207684-5d79-4b45-8936-36ad96995ecf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:36.827810 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00207684-5d79-4b45-8936-36ad96995ecf None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:36.851523 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 370/742] 10.222.0.67 () {56 vars in 1135 bytes} [Mon Apr 11 13:42:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:36.852922 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225a533-7ffd-4557-8d56-f9e2db1c03c9 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:36.853204 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225a533-7ffd-4557-8d56-f9e2db1c03c9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:36.853473 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225a533-7ffd-4557-8d56-f9e2db1c03c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:36.869786 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4225a533-7ffd-4557-8d56-f9e2db1c03c9 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:36.870955 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4225a533-7ffd-4557-8d56-f9e2db1c03c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:36.924146 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb1a68-2e77-412c-8e5b-581bbf9d3879 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:36.944620 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 371/743] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:36 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 13:42:36.945913 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225a533-7ffd-4557-8d56-f9e2db1c03c9 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:36.976178 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796cefa-0bf4-4dc6-90d0-19a5c2c6bd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:36.977034 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796cefa-0bf4-4dc6-90d0-19a5c2c6bd8a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:36.977317 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796cefa-0bf4-4dc6-90d0-19a5c2c6bd8a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:36.977587 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796cefa-0bf4-4dc6-90d0-19a5c2c6bd8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:36.991285 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796cefa-0bf4-4dc6-90d0-19a5c2c6bd8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:36.992837 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796cefa-0bf4-4dc6-90d0-19a5c2c6bd8a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:37.007080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-b796cefa-0bf4-4dc6-90d0-19a5c2c6bd8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:37.008605 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 373/744] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:37.009412 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796cefa-0bf4-4dc6-90d0-19a5c2c6bd8a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:37.060515 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225a533-7ffd-4557-8d56-f9e2db1c03c9 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:37.095171 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846fdff-553a-404b-b7ca-c04721e4aaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:37.095764 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846fdff-553a-404b-b7ca-c04721e4aaa9 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:37.096045 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846fdff-553a-404b-b7ca-c04721e4aaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:37.096317 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846fdff-553a-404b-b7ca-c04721e4aaa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:37.137419 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796cefa-0bf4-4dc6-90d0-19a5c2c6bd8a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:37.166693 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846fdff-553a-404b-b7ca-c04721e4aaa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:37.168180 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846fdff-553a-404b-b7ca-c04721e4aaa9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:37.179080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0e9d9-7bba-49c0-a35b-08ed5febac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:37.180071 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0e9d9-7bba-49c0-a35b-08ed5febac23 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:37.180359 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0e9d9-7bba-49c0-a35b-08ed5febac23 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:37.180915 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0e9d9-7bba-49c0-a35b-08ed5febac23 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:37.181636 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0e9d9-7bba-49c0-a35b-08ed5febac23 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:37.183537 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0e9d9-7bba-49c0-a35b-08ed5febac23 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:37.204108 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 374/745] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Apr 11 13:42:37 2022] POST /identity/v3/services => generated 240 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:42:37.204969 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0e9d9-7bba-49c0-a35b-08ed5febac23 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:37.338274 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0e9d9-7bba-49c0-a35b-08ed5febac23 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:37.343144 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 372/746] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:36 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 13:42:37.349022 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846fdff-553a-404b-b7ca-c04721e4aaa9 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:37.433721 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c04be9-f906-4f0d-b397-12edd4022f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:37.434413 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c04be9-f906-4f0d-b397-12edd4022f46 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:37.434694 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c04be9-f906-4f0d-b397-12edd4022f46 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:37.434967 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c04be9-f906-4f0d-b397-12edd4022f46 None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:37.435799 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c04be9-f906-4f0d-b397-12edd4022f46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:37.436112 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c04be9-f906-4f0d-b397-12edd4022f46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:37.437588 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c04be9-f906-4f0d-b397-12edd4022f46 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:37.458370 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 375/747] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:37.469547 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c04be9-f906-4f0d-b397-12edd4022f46 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:37.531607 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846fdff-553a-404b-b7ca-c04721e4aaa9 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:37.576386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003fa9f-bd76-4d90-9d73-ad915b08bb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:37.577335 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003fa9f-bd76-4d90-9d73-ad915b08bb96 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:37.577618 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003fa9f-bd76-4d90-9d73-ad915b08bb96 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:37.577894 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003fa9f-bd76-4d90-9d73-ad915b08bb96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:37.582094 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c04be9-f906-4f0d-b397-12edd4022f46 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:37.592627 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003fa9f-bd76-4d90-9d73-ad915b08bb96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:37.594687 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003fa9f-bd76-4d90-9d73-ad915b08bb96 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:37.623433 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-a003fa9f-bd76-4d90-9d73-ad915b08bb96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:37.625391 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 373/748] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:37.629655 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17429978-9e61-4178-8e71-b086d5681877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:37.630717 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17429978-9e61-4178-8e71-b086d5681877 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:37.631242 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17429978-9e61-4178-8e71-b086d5681877 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:37.631413 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003fa9f-bd76-4d90-9d73-ad915b08bb96 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:37.632001 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17429978-9e61-4178-8e71-b086d5681877 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:37.639653 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17429978-9e61-4178-8e71-b086d5681877 None admin] RBAC: Adding query filter params (role.id=c190a911c52940bb9b0fc255a4f7cad3, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=920ed843195243f8abd6dfb2ebb3a549) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:37.640335 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17429978-9e61-4178-8e71-b086d5681877 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:37.642085 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17429978-9e61-4178-8e71-b086d5681877 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:37.653260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 376/749] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:42:37 2022] GET /identity/v3/role_assignments?user.id=920ed843195243f8abd6dfb2ebb3a549&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=c190a911c52940bb9b0fc255a4f7cad3 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:37.736691 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003fa9f-bd76-4d90-9d73-ad915b08bb96 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:37.779431 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c90f74-17be-4ca4-862b-8e91cc042b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:37.780164 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c90f74-17be-4ca4-862b-8e91cc042b7c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:37.780444 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c90f74-17be-4ca4-862b-8e91cc042b7c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:37.780720 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c90f74-17be-4ca4-862b-8e91cc042b7c None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:37.781470 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c90f74-17be-4ca4-862b-8e91cc042b7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:37.781775 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c90f74-17be-4ca4-862b-8e91cc042b7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:37.783194 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c90f74-17be-4ca4-862b-8e91cc042b7c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:37.800517 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 374/750] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:37.806866 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17429978-9e61-4178-8e71-b086d5681877 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:37.956696 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17429978-9e61-4178-8e71-b086d5681877 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:37.991992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578860f4-a2d6-4732-b423-0f5e05a4ade1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:37.992844 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578860f4-a2d6-4732-b423-0f5e05a4ade1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:37.993130 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578860f4-a2d6-4732-b423-0f5e05a4ade1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:37.993453 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578860f4-a2d6-4732-b423-0f5e05a4ade1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:38.000195 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578860f4-a2d6-4732-b423-0f5e05a4ade1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:38.001651 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578860f4-a2d6-4732-b423-0f5e05a4ade1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:38.027785 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-578860f4-a2d6-4732-b423-0f5e05a4ade1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:38.029342 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 377/751] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:38.034767 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c90f74-17be-4ca4-862b-8e91cc042b7c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:38.183273 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c90f74-17be-4ca4-862b-8e91cc042b7c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:38.227436 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98971119-a71a-42c0-a33f-1d13a89a0bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:38.228046 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98971119-a71a-42c0-a33f-1d13a89a0bfc None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:38.228325 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98971119-a71a-42c0-a33f-1d13a89a0bfc None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:38.228598 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98971119-a71a-42c0-a33f-1d13a89a0bfc None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:38.229385 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98971119-a71a-42c0-a33f-1d13a89a0bfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:38.229691 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98971119-a71a-42c0-a33f-1d13a89a0bfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:38.231122 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98971119-a71a-42c0-a33f-1d13a89a0bfc None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:38.243319 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 375/752] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:38.249225 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578860f4-a2d6-4732-b423-0f5e05a4ade1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:38.394973 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578860f4-a2d6-4732-b423-0f5e05a4ade1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:38.434275 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193efb2-f9c0-4847-8bd9-196e409c029e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:38.434947 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193efb2-f9c0-4847-8bd9-196e409c029e None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:38.435284 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193efb2-f9c0-4847-8bd9-196e409c029e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:38.435566 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193efb2-f9c0-4847-8bd9-196e409c029e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:38.436435 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193efb2-f9c0-4847-8bd9-196e409c029e None admin] RBAC: Adding query filter params (role.id=e3333fcf22b040e3a1f0bfbfe657cffa, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=6660794b27ff4a7bbe9b6b043593598c) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:38.436748 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193efb2-f9c0-4847-8bd9-196e409c029e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:38.438197 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193efb2-f9c0-4847-8bd9-196e409c029e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:38.447965 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 378/753] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:42:38 2022] GET /identity/v3/role_assignments?user.id=6660794b27ff4a7bbe9b6b043593598c&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=e3333fcf22b040e3a1f0bfbfe657cffa => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:39.058607 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16715c-e3f4-4747-b3a4-2a2674b80bb7 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:39.058607 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16715c-e3f4-4747-b3a4-2a2674b80bb7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:39.058607 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16715c-e3f4-4747-b3a4-2a2674b80bb7 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:39.059712 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 376/754] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:39.065691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cfcdd-3c16-432b-ac1a-3d34aaa50ded None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:39.066290 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cfcdd-3c16-432b-ac1a-3d34aaa50ded None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:39.066767 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cfcdd-3c16-432b-ac1a-3d34aaa50ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:39.085679 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-be7cfcdd-3c16-432b-ac1a-3d34aaa50ded None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:39.087291 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-be7cfcdd-3c16-432b-ac1a-3d34aaa50ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:39.147540 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12a105-1245-40b3-b562-7a85db294e5a None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:39.148180 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12a105-1245-40b3-b562-7a85db294e5a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:39.149114 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12a105-1245-40b3-b562-7a85db294e5a None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:39.155065 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 377/755] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:39.157538 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9439319-9ced-417e-9a1d-4c39054d2978 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:39.158188 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9439319-9ced-417e-9a1d-4c39054d2978 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:39.158994 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9439319-9ced-417e-9a1d-4c39054d2978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:39.175659 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 379/756] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:42:39.184252 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b9439319-9ced-417e-9a1d-4c39054d2978 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:39.185710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b9439319-9ced-417e-9a1d-4c39054d2978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:39.214057 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cfcdd-3c16-432b-ac1a-3d34aaa50ded None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:39.277477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 378/757] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:42:39.304553 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9439319-9ced-417e-9a1d-4c39054d2978 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:39.403956 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cfcdd-3c16-432b-ac1a-3d34aaa50ded None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:39.440495 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302bbd5-0922-4829-b2b4-2a33451415f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:39.441310 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302bbd5-0922-4829-b2b4-2a33451415f7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:39.442591 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302bbd5-0922-4829-b2b4-2a33451415f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:39.442872 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302bbd5-0922-4829-b2b4-2a33451415f7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:39.443547 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302bbd5-0922-4829-b2b4-2a33451415f7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:39.445287 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302bbd5-0922-4829-b2b4-2a33451415f7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:39.458872 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-6302bbd5-0922-4829-b2b4-2a33451415f7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 11 13:42:39.460923 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 380/758] 10.222.0.67 () {56 vars in 1129 bytes} [Mon Apr 11 13:42:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:39.467022 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302bbd5-0922-4829-b2b4-2a33451415f7 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:39.483758 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9439319-9ced-417e-9a1d-4c39054d2978 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:39.541552 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64463d14-f39f-45cc-af30-4faa80289c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:39.542361 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64463d14-f39f-45cc-af30-4faa80289c6e None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:39.542645 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64463d14-f39f-45cc-af30-4faa80289c6e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:39.542922 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64463d14-f39f-45cc-af30-4faa80289c6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:39.553881 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64463d14-f39f-45cc-af30-4faa80289c6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:39.560962 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-64463d14-f39f-45cc-af30-4faa80289c6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:42:39.562484 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 379/759] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:42:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:39.569914 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64463d14-f39f-45cc-af30-4faa80289c6e None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:39.620189 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302bbd5-0922-4829-b2b4-2a33451415f7 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:39.677205 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c867d3-2027-456e-a5a0-a4ecf0d6065b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:39.679383 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c867d3-2027-456e-a5a0-a4ecf0d6065b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:39.680106 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c867d3-2027-456e-a5a0-a4ecf0d6065b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:39.681906 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c867d3-2027-456e-a5a0-a4ecf0d6065b None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:39.684805 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c867d3-2027-456e-a5a0-a4ecf0d6065b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:39.687213 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c867d3-2027-456e-a5a0-a4ecf0d6065b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:39.690638 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c867d3-2027-456e-a5a0-a4ecf0d6065b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:39.704527 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 381/760] 10.222.0.67 () {56 vars in 1124 bytes} [Mon Apr 11 13:42:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:39.711689 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c867d3-2027-456e-a5a0-a4ecf0d6065b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:39.771795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64463d14-f39f-45cc-af30-4faa80289c6e None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:39.830915 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457eecb-1fb7-4537-9cc0-c77d36ae2eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:39.831597 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457eecb-1fb7-4537-9cc0-c77d36ae2eec None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:39.831909 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457eecb-1fb7-4537-9cc0-c77d36ae2eec None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:39.832184 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457eecb-1fb7-4537-9cc0-c77d36ae2eec None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:39.833703 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457eecb-1fb7-4537-9cc0-c77d36ae2eec None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:39.834006 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457eecb-1fb7-4537-9cc0-c77d36ae2eec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:39.835387 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457eecb-1fb7-4537-9cc0-c77d36ae2eec None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:39.854635 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 380/761] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:42:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:39.862454 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457eecb-1fb7-4537-9cc0-c77d36ae2eec None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:39.902152 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c867d3-2027-456e-a5a0-a4ecf0d6065b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:39.967221 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e843d9-bf20-4b83-9bd0-813df813a3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:39.967832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e843d9-bf20-4b83-9bd0-813df813a3c9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:39.968116 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e843d9-bf20-4b83-9bd0-813df813a3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:39.968393 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e843d9-bf20-4b83-9bd0-813df813a3c9 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:39.969103 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e843d9-bf20-4b83-9bd0-813df813a3c9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:39.969410 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e843d9-bf20-4b83-9bd0-813df813a3c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:39.970797 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e843d9-bf20-4b83-9bd0-813df813a3c9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:39.982728 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 382/762] 10.222.0.67 () {56 vars in 1124 bytes} [Mon Apr 11 13:42:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:39.988405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e843d9-bf20-4b83-9bd0-813df813a3c9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:40.038827 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457eecb-1fb7-4537-9cc0-c77d36ae2eec None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:40.080325 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbe3bc-1633-47bf-a90c-8d5d55d747ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:40.081184 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbe3bc-1633-47bf-a90c-8d5d55d747ae None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:40.081468 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbe3bc-1633-47bf-a90c-8d5d55d747ae None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:40.081739 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbe3bc-1633-47bf-a90c-8d5d55d747ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:40.097837 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fbe3bc-1633-47bf-a90c-8d5d55d747ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:40.099971 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fbe3bc-1633-47bf-a90c-8d5d55d747ae None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:40.134852 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-10fbe3bc-1633-47bf-a90c-8d5d55d747ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:40.138567 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 381/763] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:40.146085 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbe3bc-1633-47bf-a90c-8d5d55d747ae None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:40.190466 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e843d9-bf20-4b83-9bd0-813df813a3c9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:40.224893 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582dc7f-7b61-4c2f-b0a7-53968fd7f7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:40.225918 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582dc7f-7b61-4c2f-b0a7-53968fd7f7b6 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:40.226345 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582dc7f-7b61-4c2f-b0a7-53968fd7f7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:40.226765 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582dc7f-7b61-4c2f-b0a7-53968fd7f7b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:40.227735 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582dc7f-7b61-4c2f-b0a7-53968fd7f7b6 None admin] RBAC: Adding query filter params (interface=public, service_id=4d68da600a804c1ab77e922cc4364c3a, region_id=RegionOne) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:40.228188 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582dc7f-7b61-4c2f-b0a7-53968fd7f7b6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:40.229699 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582dc7f-7b61-4c2f-b0a7-53968fd7f7b6 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:40.237663 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 383/764] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Apr 11 13:42:39 2022] GET /identity/v3/endpoints?service_id=4d68da600a804c1ab77e922cc4364c3a&interface=public®ion_id=RegionOne => generated 194 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:40.239706 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31aae4e-3204-453c-9953-6568dc702445 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:40.240162 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31aae4e-3204-453c-9953-6568dc702445 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:40.240598 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31aae4e-3204-453c-9953-6568dc702445 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:40.242238 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 384/765] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:40.244330 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31aae4e-3204-453c-9953-6568dc702445 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:40.252998 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbe3bc-1633-47bf-a90c-8d5d55d747ae None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:40.291515 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e4222-8a3f-404d-9c02-5883bf730904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:40.292291 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e4222-8a3f-404d-9c02-5883bf730904 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:40.292577 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e4222-8a3f-404d-9c02-5883bf730904 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:40.292856 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e4222-8a3f-404d-9c02-5883bf730904 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:40.293591 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e4222-8a3f-404d-9c02-5883bf730904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:40.293901 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e4222-8a3f-404d-9c02-5883bf730904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:40.295287 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e4222-8a3f-404d-9c02-5883bf730904 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:40.307388 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 382/766] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:40.308784 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dd655-e3f3-40ac-8db0-cc92a9d08e46 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:40.309075 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dd655-e3f3-40ac-8db0-cc92a9d08e46 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:40.309353 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dd655-e3f3-40ac-8db0-cc92a9d08e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:40.325654 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-aa4dd655-e3f3-40ac-8db0-cc92a9d08e46 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:40.326846 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-aa4dd655-e3f3-40ac-8db0-cc92a9d08e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:40.370707 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31aae4e-3204-453c-9953-6568dc702445 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:40.411302 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2fbce-21ba-4679-bdf9-27d25d7315e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:40.412087 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2fbce-21ba-4679-bdf9-27d25d7315e7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:40.412272 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2fbce-21ba-4679-bdf9-27d25d7315e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:40.412642 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2fbce-21ba-4679-bdf9-27d25d7315e7 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:40.413223 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2fbce-21ba-4679-bdf9-27d25d7315e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:40.414574 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2fbce-21ba-4679-bdf9-27d25d7315e7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:40.416477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 383/767] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:42:40.416936 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dd655-e3f3-40ac-8db0-cc92a9d08e46 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:40.435869 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 385/768] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Apr 11 13:42:40 2022] GET /identity/v3/services => generated 772 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:40.435869 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e678f5-bf0d-4f61-a425-2939979b658a None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:40.435869 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e678f5-bf0d-4f61-a425-2939979b658a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:40.435869 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e678f5-bf0d-4f61-a425-2939979b658a None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:40.435869 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 386/769] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:40.443745 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a38491-b18a-452b-848c-2d08cc819b99 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:40.444096 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a38491-b18a-452b-848c-2d08cc819b99 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:40.444383 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a38491-b18a-452b-848c-2d08cc819b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:40.464069 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-92a38491-b18a-452b-848c-2d08cc819b99 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:40.465283 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-92a38491-b18a-452b-848c-2d08cc819b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:40.539263 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 387/770] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:42:40.540174 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a38491-b18a-452b-848c-2d08cc819b99 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:40.544080 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dd655-e3f3-40ac-8db0-cc92a9d08e46 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:40.602834 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac8170-7410-47a7-a918-8da75178cd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:40.603667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac8170-7410-47a7-a918-8da75178cd59 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:40.604012 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac8170-7410-47a7-a918-8da75178cd59 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:40.604285 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac8170-7410-47a7-a918-8da75178cd59 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:40.612267 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac8170-7410-47a7-a918-8da75178cd59 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:40.614396 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac8170-7410-47a7-a918-8da75178cd59 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:40.630269 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-73ac8170-7410-47a7-a918-8da75178cd59 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 13:42:40.631829 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 384/771] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Apr 11 13:42:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:40.632622 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac8170-7410-47a7-a918-8da75178cd59 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:40.652937 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a38491-b18a-452b-848c-2d08cc819b99 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:40.700826 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5803e-bf67-46fa-a1fa-ca68ea2c3fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:40.701934 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5803e-bf67-46fa-a1fa-ca68ea2c3fb7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:40.702221 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5803e-bf67-46fa-a1fa-ca68ea2c3fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:40.702501 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5803e-bf67-46fa-a1fa-ca68ea2c3fb7 None admin] PATH_INFO: `/v3/services/network` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:40.703436 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5803e-bf67-46fa-a1fa-ca68ea2c3fb7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:40.704834 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5803e-bf67-46fa-a1fa-ca68ea2c3fb7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:40.719391 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-54a5803e-bf67-46fa-a1fa-ca68ea2c3fb7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 11 13:42:40.721299 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 388/772] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:40 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:40.722341 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5803e-bf67-46fa-a1fa-ca68ea2c3fb7 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:40.742449 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac8170-7410-47a7-a918-8da75178cd59 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:40.780568 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175539d2-0aef-4bef-9ec0-363b5176bfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:40.781787 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175539d2-0aef-4bef-9ec0-363b5176bfee None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:40.782271 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175539d2-0aef-4bef-9ec0-363b5176bfee None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:40.782764 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175539d2-0aef-4bef-9ec0-363b5176bfee None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:40.794082 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175539d2-0aef-4bef-9ec0-363b5176bfee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:40.801518 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-175539d2-0aef-4bef-9ec0-363b5176bfee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:42:40.803307 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 385/773] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:42:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:40.804421 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175539d2-0aef-4bef-9ec0-363b5176bfee None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:40.845860 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5803e-bf67-46fa-a1fa-ca68ea2c3fb7 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:40.896508 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8ec0d-14b9-44dc-9d3f-e35df4b58fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:40.897197 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8ec0d-14b9-44dc-9d3f-e35df4b58fee None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:40.897480 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8ec0d-14b9-44dc-9d3f-e35df4b58fee None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:40.897755 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8ec0d-14b9-44dc-9d3f-e35df4b58fee None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:40.898604 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8ec0d-14b9-44dc-9d3f-e35df4b58fee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:40.898915 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8ec0d-14b9-44dc-9d3f-e35df4b58fee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:40.900405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8ec0d-14b9-44dc-9d3f-e35df4b58fee None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:40.920020 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175539d2-0aef-4bef-9ec0-363b5176bfee None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:40.924711 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 389/774] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Apr 11 13:42:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:40.925759 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8ec0d-14b9-44dc-9d3f-e35df4b58fee None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:40.958625 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc78ebc-c591-483e-805c-a313997fa4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:40.959701 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc78ebc-c591-483e-805c-a313997fa4dc None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:40.960183 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc78ebc-c591-483e-805c-a313997fa4dc None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:40.960652 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc78ebc-c591-483e-805c-a313997fa4dc None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:40.961571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc78ebc-c591-483e-805c-a313997fa4dc None admin] RBAC: Adding query filter params (name=network) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:40.962111 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc78ebc-c591-483e-805c-a313997fa4dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:40.963817 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc78ebc-c591-483e-805c-a313997fa4dc None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:40.968948 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 386/775] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Apr 11 13:42:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:40.970029 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc78ebc-c591-483e-805c-a313997fa4dc None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:41.030844 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8ec0d-14b9-44dc-9d3f-e35df4b58fee None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:41.066571 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50061cb6-13e6-4503-92b4-6d10b421e2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:41.068010 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50061cb6-13e6-4503-92b4-6d10b421e2e8 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:41.068122 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50061cb6-13e6-4503-92b4-6d10b421e2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:41.068331 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50061cb6-13e6-4503-92b4-6d10b421e2e8 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:41.069115 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50061cb6-13e6-4503-92b4-6d10b421e2e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:41.069460 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50061cb6-13e6-4503-92b4-6d10b421e2e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:41.070841 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50061cb6-13e6-4503-92b4-6d10b421e2e8 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:41.071790 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc78ebc-c591-483e-805c-a313997fa4dc None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:41.079552 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 390/776] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Apr 11 13:42:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:41.080415 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50061cb6-13e6-4503-92b4-6d10b421e2e8 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:41.107886 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2112917-8a5d-431e-bc40-ad4ea74d7c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:41.109811 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2112917-8a5d-431e-bc40-ad4ea74d7c8c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:41.110574 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2112917-8a5d-431e-bc40-ad4ea74d7c8c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:41.111065 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2112917-8a5d-431e-bc40-ad4ea74d7c8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:41.125455 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2112917-8a5d-431e-bc40-ad4ea74d7c8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:41.127790 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2112917-8a5d-431e-bc40-ad4ea74d7c8c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:41.149841 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-b2112917-8a5d-431e-bc40-ad4ea74d7c8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:41.156640 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 387/777] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:41.156640 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2112917-8a5d-431e-bc40-ad4ea74d7c8c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:41.190618 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50061cb6-13e6-4503-92b4-6d10b421e2e8 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:41.233899 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccf416-4095-4684-b7a4-26a62218f701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:41.235493 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccf416-4095-4684-b7a4-26a62218f701 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:41.236006 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccf416-4095-4684-b7a4-26a62218f701 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:41.236480 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccf416-4095-4684-b7a4-26a62218f701 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:41.237869 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccf416-4095-4684-b7a4-26a62218f701 None admin] RBAC: Adding query filter params (type=network) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:41.238408 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccf416-4095-4684-b7a4-26a62218f701 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:41.241068 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccf416-4095-4684-b7a4-26a62218f701 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:41.248230 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 391/778] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Apr 11 13:42:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:41.249608 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccf416-4095-4684-b7a4-26a62218f701 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:41.256466 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2112917-8a5d-431e-bc40-ad4ea74d7c8c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:41.290613 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607d4a6-b90b-4e49-8c1e-346284955c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:41.291710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607d4a6-b90b-4e49-8c1e-346284955c64 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:41.291994 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607d4a6-b90b-4e49-8c1e-346284955c64 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:41.292266 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607d4a6-b90b-4e49-8c1e-346284955c64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:41.303484 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607d4a6-b90b-4e49-8c1e-346284955c64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:41.305006 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607d4a6-b90b-4e49-8c1e-346284955c64 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:41.325916 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-0607d4a6-b90b-4e49-8c1e-346284955c64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:41.332316 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 388/779] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:41.333403 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607d4a6-b90b-4e49-8c1e-346284955c64 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:41.356290 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccf416-4095-4684-b7a4-26a62218f701 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:41.400355 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbacefa-5902-4179-af69-e572778ddb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:41.401113 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbacefa-5902-4179-af69-e572778ddb7a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:41.401466 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbacefa-5902-4179-af69-e572778ddb7a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:41.401816 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbacefa-5902-4179-af69-e572778ddb7a None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:41.402624 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbacefa-5902-4179-af69-e572778ddb7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:41.402992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbacefa-5902-4179-af69-e572778ddb7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:41.404533 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbacefa-5902-4179-af69-e572778ddb7a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:41.420708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 392/780] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:41.420708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9748e34-5d69-4d9f-bf53-0edb6b2b3073 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:41.420708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9748e34-5d69-4d9f-bf53-0edb6b2b3073 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:41.420708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9748e34-5d69-4d9f-bf53-0edb6b2b3073 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:41.420708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 393/781] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:41.420708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9748e34-5d69-4d9f-bf53-0edb6b2b3073 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:41.441796 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607d4a6-b90b-4e49-8c1e-346284955c64 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:41.475107 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d5fa1-4a59-4244-85c7-f9446f44d880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:41.475807 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d5fa1-4a59-4244-85c7-f9446f44d880 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:41.476140 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d5fa1-4a59-4244-85c7-f9446f44d880 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:41.476417 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d5fa1-4a59-4244-85c7-f9446f44d880 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:41.477204 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d5fa1-4a59-4244-85c7-f9446f44d880 None admin] RBAC: Adding query filter params (interface=public, service_id=1ed5d2ba87524850b3eecf8d8d0b8ec6, region_id=RegionOne) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:41.477510 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d5fa1-4a59-4244-85c7-f9446f44d880 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:41.478876 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d5fa1-4a59-4244-85c7-f9446f44d880 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:41.490879 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 389/782] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Apr 11 13:42:41 2022] GET /identity/v3/endpoints?service_id=1ed5d2ba87524850b3eecf8d8d0b8ec6&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:41.490879 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d5fa1-4a59-4244-85c7-f9446f44d880 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:41.521692 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9748e34-5d69-4d9f-bf53-0edb6b2b3073 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:41.561211 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc5e4f-794d-450c-aeae-82745da79323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:41.561880 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc5e4f-794d-450c-aeae-82745da79323 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:41.562163 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc5e4f-794d-450c-aeae-82745da79323 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:41.562436 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc5e4f-794d-450c-aeae-82745da79323 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:41.563153 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc5e4f-794d-450c-aeae-82745da79323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:41.563456 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc5e4f-794d-450c-aeae-82745da79323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:41.565271 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc5e4f-794d-450c-aeae-82745da79323 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:41.578967 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 394/783] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:41.580174 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5dbba-5d8c-42f4-8c5e-83633a631a24 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:41.580459 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5dbba-5d8c-42f4-8c5e-83633a631a24 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:41.580735 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5dbba-5d8c-42f4-8c5e-83633a631a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:41.592913 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d5fa1-4a59-4244-85c7-f9446f44d880 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:41.596616 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e1a5dbba-5d8c-42f4-8c5e-83633a631a24 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:41.597800 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e1a5dbba-5d8c-42f4-8c5e-83633a631a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:41.627742 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0b49c-07ac-4bdc-8d45-cd1fd4ebcdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:41.628543 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0b49c-07ac-4bdc-8d45-cd1fd4ebcdef None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:41.628823 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0b49c-07ac-4bdc-8d45-cd1fd4ebcdef None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:41.629104 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0b49c-07ac-4bdc-8d45-cd1fd4ebcdef None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:41.636185 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0b49c-07ac-4bdc-8d45-cd1fd4ebcdef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:41.637633 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0b49c-07ac-4bdc-8d45-cd1fd4ebcdef None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:41.652718 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-d0d0b49c-07ac-4bdc-8d45-cd1fd4ebcdef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:41.657686 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 390/784] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:41.657686 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0b49c-07ac-4bdc-8d45-cd1fd4ebcdef None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:41.674023 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 395/785] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:42:41.675039 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5dbba-5d8c-42f4-8c5e-83633a631a24 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:41.768409 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0b49c-07ac-4bdc-8d45-cd1fd4ebcdef None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:41.771017 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5dbba-5d8c-42f4-8c5e-83633a631a24 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:41.802717 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e84b12-9755-40d3-bb07-81d71d6b0250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:41.803654 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e84b12-9755-40d3-bb07-81d71d6b0250 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:41.804087 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e84b12-9755-40d3-bb07-81d71d6b0250 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:41.804531 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e84b12-9755-40d3-bb07-81d71d6b0250 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:41.805354 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e84b12-9755-40d3-bb07-81d71d6b0250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:41.806859 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e84b12-9755-40d3-bb07-81d71d6b0250 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:41.806974 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f867f4f-6607-416b-8ede-5d0b13fdca78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:41.807820 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f867f4f-6607-416b-8ede-5d0b13fdca78 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:41.808101 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f867f4f-6607-416b-8ede-5d0b13fdca78 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:41.808370 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f867f4f-6607-416b-8ede-5d0b13fdca78 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:41.813330 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 391/786] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Apr 11 13:42:41 2022] GET /identity/v3/services => generated 772 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:41.814257 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e84b12-9755-40d3-bb07-81d71d6b0250 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:41.815422 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f867f4f-6607-416b-8ede-5d0b13fdca78 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:41.817006 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f867f4f-6607-416b-8ede-5d0b13fdca78 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:41.833823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-0f867f4f-6607-416b-8ede-5d0b13fdca78 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 13:42:41.835342 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 396/787] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Apr 11 13:42:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:41.836165 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f867f4f-6607-416b-8ede-5d0b13fdca78 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:41.940036 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e84b12-9755-40d3-bb07-81d71d6b0250 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:41.964987 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f867f4f-6607-416b-8ede-5d0b13fdca78 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:41.986576 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56d87d-4ec7-4a28-9af3-ffc2e2538227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:41.987839 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56d87d-4ec7-4a28-9af3-ffc2e2538227 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:41.988278 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56d87d-4ec7-4a28-9af3-ffc2e2538227 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:41.989382 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56d87d-4ec7-4a28-9af3-ffc2e2538227 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:41.991034 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56d87d-4ec7-4a28-9af3-ffc2e2538227 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:41.991513 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56d87d-4ec7-4a28-9af3-ffc2e2538227 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:41.993933 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56d87d-4ec7-4a28-9af3-ffc2e2538227 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:42.000428 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b782df0-e07e-4e4b-bf57-af74a692270b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:42.001234 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782df0-e07e-4e4b-bf57-af74a692270b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:42.001514 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782df0-e07e-4e4b-bf57-af74a692270b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:42.001787 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782df0-e07e-4e4b-bf57-af74a692270b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:42.009772 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 392/788] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:42.010818 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56d87d-4ec7-4a28-9af3-ffc2e2538227 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:42.022671 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b782df0-e07e-4e4b-bf57-af74a692270b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:42.029764 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-8b782df0-e07e-4e4b-bf57-af74a692270b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:42:42.030999 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 397/789] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:42:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:42.031765 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b782df0-e07e-4e4b-bf57-af74a692270b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:42.121240 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56d87d-4ec7-4a28-9af3-ffc2e2538227 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:42.151658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b782df0-e07e-4e4b-bf57-af74a692270b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:42.165153 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796059b5-77b0-4754-abb3-f5c483979ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:42.166452 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796059b5-77b0-4754-abb3-f5c483979ce8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:42.167115 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796059b5-77b0-4754-abb3-f5c483979ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:42.167532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796059b5-77b0-4754-abb3-f5c483979ce8 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:42.168691 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796059b5-77b0-4754-abb3-f5c483979ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:42.169450 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796059b5-77b0-4754-abb3-f5c483979ce8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:42.171073 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796059b5-77b0-4754-abb3-f5c483979ce8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:42.186548 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ef668-8a7b-4fc8-9a52-5780b7f5856b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:42.187682 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ef668-8a7b-4fc8-9a52-5780b7f5856b None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:42.188125 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ef668-8a7b-4fc8-9a52-5780b7f5856b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:42.188539 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ef668-8a7b-4fc8-9a52-5780b7f5856b None admin] PATH_INFO: `/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/fedd2314dc594bcba749bf7b0d1e50fb/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:42.190675 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ef668-8a7b-4fc8-9a52-5780b7f5856b None admin] RBAC: Authorizing `identity:create_grant(project_id=d46063ee60fd4f6dba86d1c5946e9381, user_id=fedd2314dc594bcba749bf7b0d1e50fb, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:42.193093 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ef668-8a7b-4fc8-9a52-5780b7f5856b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:42.196705 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 393/790] 10.222.0.67 () {56 vars in 1149 bytes} [Mon Apr 11 13:42:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:42.197767 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796059b5-77b0-4754-abb3-f5c483979ce8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:42.209137 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 398/791] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:42:42 2022] PUT /identity/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/fedd2314dc594bcba749bf7b0d1e50fb/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:42:42.210452 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ef668-8a7b-4fc8-9a52-5780b7f5856b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:42.303520 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796059b5-77b0-4754-abb3-f5c483979ce8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:42.319395 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ef668-8a7b-4fc8-9a52-5780b7f5856b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:42.356577 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9d8fa-1ee1-4cc1-b143-45dd42b69e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:42.357651 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9d8fa-1ee1-4cc1-b143-45dd42b69e48 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:42.358080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9d8fa-1ee1-4cc1-b143-45dd42b69e48 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:42.358526 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9d8fa-1ee1-4cc1-b143-45dd42b69e48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:42.367405 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5960650-44db-4b23-b028-07bd667ba8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:42.368328 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5960650-44db-4b23-b028-07bd667ba8af None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:42.368447 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5960650-44db-4b23-b028-07bd667ba8af None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:42.368669 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5960650-44db-4b23-b028-07bd667ba8af None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:42.369446 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5960650-44db-4b23-b028-07bd667ba8af None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:42.369755 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5960650-44db-4b23-b028-07bd667ba8af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:42.371238 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5960650-44db-4b23-b028-07bd667ba8af None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:42.373504 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9d8fa-1ee1-4cc1-b143-45dd42b69e48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:42.375121 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9d8fa-1ee1-4cc1-b143-45dd42b69e48 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:42.396111 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 394/792] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:42:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:42.396542 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-e3f9d8fa-1ee1-4cc1-b143-45dd42b69e48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:42.397113 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5960650-44db-4b23-b028-07bd667ba8af None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:42.398611 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 399/793] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:42.406325 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9d8fa-1ee1-4cc1-b143-45dd42b69e48 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:42.510371 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5960650-44db-4b23-b028-07bd667ba8af None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:42.525731 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9d8fa-1ee1-4cc1-b143-45dd42b69e48 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:42.558861 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20d9cd-2452-4170-81df-2c0b4f163bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:42.559706 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20d9cd-2452-4170-81df-2c0b4f163bce None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:42.559995 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20d9cd-2452-4170-81df-2c0b4f163bce None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:42.560269 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20d9cd-2452-4170-81df-2c0b4f163bce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:42.579268 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20d9cd-2452-4170-81df-2c0b4f163bce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:42.580454 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee37ce-08bb-4804-b3ff-b6542ad2f726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:42.580760 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20d9cd-2452-4170-81df-2c0b4f163bce None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:42.581138 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee37ce-08bb-4804-b3ff-b6542ad2f726 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:42.581423 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee37ce-08bb-4804-b3ff-b6542ad2f726 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:42.581702 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee37ce-08bb-4804-b3ff-b6542ad2f726 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:42.583125 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee37ce-08bb-4804-b3ff-b6542ad2f726 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:42.583318 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee37ce-08bb-4804-b3ff-b6542ad2f726 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:42.584919 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee37ce-08bb-4804-b3ff-b6542ad2f726 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:42.607255 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 400/794] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:42.611027 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-6e20d9cd-2452-4170-81df-2c0b4f163bce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:42.612718 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee37ce-08bb-4804-b3ff-b6542ad2f726 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:42.616944 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 395/795] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:42.622558 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20d9cd-2452-4170-81df-2c0b4f163bce None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:42.737356 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20d9cd-2452-4170-81df-2c0b4f163bce None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:42.780074 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ef7e7-b69c-40ca-85c2-e2486dd995dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:42.780745 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ef7e7-b69c-40ca-85c2-e2486dd995dc None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:42.781032 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ef7e7-b69c-40ca-85c2-e2486dd995dc None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:42.781310 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ef7e7-b69c-40ca-85c2-e2486dd995dc None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:42.782033 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ef7e7-b69c-40ca-85c2-e2486dd995dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:42.782341 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ef7e7-b69c-40ca-85c2-e2486dd995dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:42.783749 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ef7e7-b69c-40ca-85c2-e2486dd995dc None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:42.787978 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee37ce-08bb-4804-b3ff-b6542ad2f726 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:42.810569 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 396/796] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:42.817112 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ef7e7-b69c-40ca-85c2-e2486dd995dc None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:42.844227 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753188b7-abad-46cf-bab1-18ac0ca93343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:42.858814 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753188b7-abad-46cf-bab1-18ac0ca93343 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:42.858814 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753188b7-abad-46cf-bab1-18ac0ca93343 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:42.858814 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753188b7-abad-46cf-bab1-18ac0ca93343 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:42.869878 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753188b7-abad-46cf-bab1-18ac0ca93343 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:42.869878 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753188b7-abad-46cf-bab1-18ac0ca93343 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:42.903656 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-753188b7-abad-46cf-bab1-18ac0ca93343 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:42.905828 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 401/797] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:42.911652 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753188b7-abad-46cf-bab1-18ac0ca93343 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:42.925143 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ef7e7-b69c-40ca-85c2-e2486dd995dc None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:42.959984 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbed9c-0da2-434f-b9f9-8e79d6699d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:42.960789 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbed9c-0da2-434f-b9f9-8e79d6699d28 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:42.961071 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbed9c-0da2-434f-b9f9-8e79d6699d28 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:42.961345 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbed9c-0da2-434f-b9f9-8e79d6699d28 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:42.968740 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbed9c-0da2-434f-b9f9-8e79d6699d28 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:42.970191 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbed9c-0da2-434f-b9f9-8e79d6699d28 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:42.983947 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-57cbed9c-0da2-434f-b9f9-8e79d6699d28 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 13:42:42.985459 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 397/798] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:42:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:42.991008 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbed9c-0da2-434f-b9f9-8e79d6699d28 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:43.106387 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbed9c-0da2-434f-b9f9-8e79d6699d28 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:43.124364 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753188b7-abad-46cf-bab1-18ac0ca93343 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:43.141145 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b017859-7577-4dc4-b08d-5e4f4c454178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:43.141828 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b017859-7577-4dc4-b08d-5e4f4c454178 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:43.142187 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b017859-7577-4dc4-b08d-5e4f4c454178 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:43.142385 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b017859-7577-4dc4-b08d-5e4f4c454178 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:43.143229 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b017859-7577-4dc4-b08d-5e4f4c454178 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:43.143713 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b017859-7577-4dc4-b08d-5e4f4c454178 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:43.145095 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b017859-7577-4dc4-b08d-5e4f4c454178 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:43.161223 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b357bf6-656c-46fe-8ec0-efc8d12f1644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:43.162230 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b357bf6-656c-46fe-8ec0-efc8d12f1644 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:43.162722 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b357bf6-656c-46fe-8ec0-efc8d12f1644 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:43.163197 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b357bf6-656c-46fe-8ec0-efc8d12f1644 None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:43.164315 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b357bf6-656c-46fe-8ec0-efc8d12f1644 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:43.164704 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 398/799] 10.222.0.67 () {56 vars in 1135 bytes} [Mon Apr 11 13:42:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:43.165108 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b357bf6-656c-46fe-8ec0-efc8d12f1644 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:43.166051 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae58e1-b67b-45c6-a63d-782ee6132acf None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:43.166343 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae58e1-b67b-45c6-a63d-782ee6132acf None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:43.166623 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae58e1-b67b-45c6-a63d-782ee6132acf None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:43.167504 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b357bf6-656c-46fe-8ec0-efc8d12f1644 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:43.177072 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 399/800] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:43.177072 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae58e1-b67b-45c6-a63d-782ee6132acf None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:43.191914 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 402/801] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:43.193660 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a44725-c6c5-4f89-9b0a-0acac747c305 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:43.193956 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a44725-c6c5-4f89-9b0a-0acac747c305 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:43.194238 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a44725-c6c5-4f89-9b0a-0acac747c305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:43.213521 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e5a44725-c6c5-4f89-9b0a-0acac747c305 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:43.215027 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e5a44725-c6c5-4f89-9b0a-0acac747c305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:43.286134 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 403/802] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:42:43.287393 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a44725-c6c5-4f89-9b0a-0acac747c305 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:43.287791 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae58e1-b67b-45c6-a63d-782ee6132acf None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:43.324034 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daa73a-58b4-4249-99b4-2ab900971970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:43.324901 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daa73a-58b4-4249-99b4-2ab900971970 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:43.331683 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daa73a-58b4-4249-99b4-2ab900971970 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:43.331683 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daa73a-58b4-4249-99b4-2ab900971970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:43.337530 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daa73a-58b4-4249-99b4-2ab900971970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:43.339051 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daa73a-58b4-4249-99b4-2ab900971970 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:43.356519 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-30daa73a-58b4-4249-99b4-2ab900971970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:43.358105 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 400/803] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:43.359034 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daa73a-58b4-4249-99b4-2ab900971970 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:43.411657 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a44725-c6c5-4f89-9b0a-0acac747c305 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:43.448379 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e541681-1f43-4b1a-bd9f-9864fbc3b39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:43.449585 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e541681-1f43-4b1a-bd9f-9864fbc3b39a None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:43.450047 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e541681-1f43-4b1a-bd9f-9864fbc3b39a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:43.450500 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e541681-1f43-4b1a-bd9f-9864fbc3b39a None admin] PATH_INFO: `/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/920ed843195243f8abd6dfb2ebb3a549/roles/c190a911c52940bb9b0fc255a4f7cad3` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:43.465251 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e541681-1f43-4b1a-bd9f-9864fbc3b39a None admin] RBAC: Authorizing `identity:create_grant(project_id=d46063ee60fd4f6dba86d1c5946e9381, user_id=920ed843195243f8abd6dfb2ebb3a549, role_id=c190a911c52940bb9b0fc255a4f7cad3)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:43.466402 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daa73a-58b4-4249-99b4-2ab900971970 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:43.467285 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e541681-1f43-4b1a-bd9f-9864fbc3b39a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:43.481909 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 404/804] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:42:43 2022] PUT /identity/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/920ed843195243f8abd6dfb2ebb3a549/roles/c190a911c52940bb9b0fc255a4f7cad3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:42:43.483305 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e541681-1f43-4b1a-bd9f-9864fbc3b39a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:43.502899 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a246e-24ea-492b-8aac-552174d55b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:43.503749 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a246e-24ea-492b-8aac-552174d55b8b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:43.504073 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a246e-24ea-492b-8aac-552174d55b8b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:43.504973 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a246e-24ea-492b-8aac-552174d55b8b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:43.505581 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a246e-24ea-492b-8aac-552174d55b8b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:43.507009 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a246e-24ea-492b-8aac-552174d55b8b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:43.519535 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-d18a246e-24ea-492b-8aac-552174d55b8b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 11 13:42:43.525818 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 401/805] 10.222.0.67 () {56 vars in 1129 bytes} [Mon Apr 11 13:42:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:43.532725 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a246e-24ea-492b-8aac-552174d55b8b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:43.600522 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e541681-1f43-4b1a-bd9f-9864fbc3b39a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:43.637168 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fc905-dccb-45ce-acfa-65538abc344b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:43.638284 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fc905-dccb-45ce-acfa-65538abc344b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:43.638772 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fc905-dccb-45ce-acfa-65538abc344b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:43.639249 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fc905-dccb-45ce-acfa-65538abc344b None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:43.640251 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fc905-dccb-45ce-acfa-65538abc344b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:43.640779 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fc905-dccb-45ce-acfa-65538abc344b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:43.642390 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fc905-dccb-45ce-acfa-65538abc344b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:43.655761 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 405/806] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:43.669243 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fc905-dccb-45ce-acfa-65538abc344b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:43.693952 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a246e-24ea-492b-8aac-552174d55b8b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:43.735069 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb1213-bcb4-42d3-bf0d-9b77a3e8babc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:43.735793 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb1213-bcb4-42d3-bf0d-9b77a3e8babc None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:43.736079 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb1213-bcb4-42d3-bf0d-9b77a3e8babc None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:43.736355 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb1213-bcb4-42d3-bf0d-9b77a3e8babc None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:43.737073 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb1213-bcb4-42d3-bf0d-9b77a3e8babc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:43.737380 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb1213-bcb4-42d3-bf0d-9b77a3e8babc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:43.739343 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb1213-bcb4-42d3-bf0d-9b77a3e8babc None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:43.750909 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 402/807] 10.222.0.67 () {56 vars in 1124 bytes} [Mon Apr 11 13:42:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:43.758188 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb1213-bcb4-42d3-bf0d-9b77a3e8babc None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:43.857894 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fc905-dccb-45ce-acfa-65538abc344b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:43.893123 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c0311-bc05-4e15-8f4a-b73b4725ed8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:43.894290 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c0311-bc05-4e15-8f4a-b73b4725ed8d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:43.895422 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c0311-bc05-4e15-8f4a-b73b4725ed8d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:43.895939 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c0311-bc05-4e15-8f4a-b73b4725ed8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:43.902898 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb1213-bcb4-42d3-bf0d-9b77a3e8babc None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:43.903469 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c0311-bc05-4e15-8f4a-b73b4725ed8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:43.905143 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c0311-bc05-4e15-8f4a-b73b4725ed8d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:43.919287 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-889c0311-bc05-4e15-8f4a-b73b4725ed8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:43.921147 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 406/808] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:43.930039 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c0311-bc05-4e15-8f4a-b73b4725ed8d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:43.946186 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40fe4c-dcdf-42f9-9d36-2ce3f5e87436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:43.947190 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40fe4c-dcdf-42f9-9d36-2ce3f5e87436 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:43.948084 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40fe4c-dcdf-42f9-9d36-2ce3f5e87436 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:43.948970 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40fe4c-dcdf-42f9-9d36-2ce3f5e87436 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:43.950186 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40fe4c-dcdf-42f9-9d36-2ce3f5e87436 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:43.950863 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40fe4c-dcdf-42f9-9d36-2ce3f5e87436 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:43.952887 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40fe4c-dcdf-42f9-9d36-2ce3f5e87436 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:43.963882 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 403/809] 10.222.0.67 () {56 vars in 1124 bytes} [Mon Apr 11 13:42:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:43.967252 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40fe4c-dcdf-42f9-9d36-2ce3f5e87436 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:44.100144 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40fe4c-dcdf-42f9-9d36-2ce3f5e87436 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:44.101659 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c0311-bc05-4e15-8f4a-b73b4725ed8d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:44.137949 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391e150-a54c-4d12-af39-357d055228d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:44.138622 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391e150-a54c-4d12-af39-357d055228d9 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:44.138907 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391e150-a54c-4d12-af39-357d055228d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:44.139186 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391e150-a54c-4d12-af39-357d055228d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:44.139961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391e150-a54c-4d12-af39-357d055228d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:44.141346 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391e150-a54c-4d12-af39-357d055228d9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:44.168052 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bb0a1-6370-4903-85bc-bc6e7afed2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:44.173157 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bb0a1-6370-4903-85bc-bc6e7afed2d6 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:44.174577 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bb0a1-6370-4903-85bc-bc6e7afed2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:44.174867 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bb0a1-6370-4903-85bc-bc6e7afed2d6 None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:44.175695 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89bb0a1-6370-4903-85bc-bc6e7afed2d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:44.178227 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 404/810] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Apr 11 13:42:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:42:44.178512 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89bb0a1-6370-4903-85bc-bc6e7afed2d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:44.179989 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89bb0a1-6370-4903-85bc-bc6e7afed2d6 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:44.202154 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 407/811] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:44.208284 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391e150-a54c-4d12-af39-357d055228d9 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:44.373282 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391e150-a54c-4d12-af39-357d055228d9 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:44.408470 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5433f-02d7-4870-9205-6b85cc0b38c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:44.409518 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5433f-02d7-4870-9205-6b85cc0b38c3 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:44.409803 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5433f-02d7-4870-9205-6b85cc0b38c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:44.410078 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5433f-02d7-4870-9205-6b85cc0b38c3 None admin] PATH_INFO: `/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/6660794b27ff4a7bbe9b6b043593598c/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:44.412752 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad5433f-02d7-4870-9205-6b85cc0b38c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d46063ee60fd4f6dba86d1c5946e9381, user_id=6660794b27ff4a7bbe9b6b043593598c, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:44.414204 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad5433f-02d7-4870-9205-6b85cc0b38c3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:44.432957 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 405/812] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:42:44 2022] PUT /identity/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/6660794b27ff4a7bbe9b6b043593598c/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:42:44.450037 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d7099-a8a6-4fba-8a1b-8d9aa0d329d9 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:44.450646 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d7099-a8a6-4fba-8a1b-8d9aa0d329d9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:44.451103 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d7099-a8a6-4fba-8a1b-8d9aa0d329d9 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:44.454418 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 408/813] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:44.459343 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e0cc8-989a-4c9a-94a2-64cf11bada41 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:44.459665 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e0cc8-989a-4c9a-94a2-64cf11bada41 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:44.459963 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e0cc8-989a-4c9a-94a2-64cf11bada41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:44.482032 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-702e0cc8-989a-4c9a-94a2-64cf11bada41 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:44.483297 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-702e0cc8-989a-4c9a-94a2-64cf11bada41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:44.564904 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 406/814] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:42:44.592695 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d7099-a8a6-4fba-8a1b-8d9aa0d329d9 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:44.712211 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d7099-a8a6-4fba-8a1b-8d9aa0d329d9 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:44.746689 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057a86c-378d-44b1-84e1-6a25eefb8320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:44.747487 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057a86c-378d-44b1-84e1-6a25eefb8320 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:44.747796 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057a86c-378d-44b1-84e1-6a25eefb8320 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:44.748071 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057a86c-378d-44b1-84e1-6a25eefb8320 None admin] PATH_INFO: `/v3/services/network` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:44.748723 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057a86c-378d-44b1-84e1-6a25eefb8320 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:44.750141 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057a86c-378d-44b1-84e1-6a25eefb8320 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:44.761821 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-e057a86c-378d-44b1-84e1-6a25eefb8320 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 11 13:42:44.763369 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 409/815] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:44 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:44.768851 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e0cc8-989a-4c9a-94a2-64cf11bada41 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:44.870101 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e0cc8-989a-4c9a-94a2-64cf11bada41 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:44.904714 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28178660-7ae5-46bf-9dde-78e99747c5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:44.905381 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28178660-7ae5-46bf-9dde-78e99747c5e6 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:44.905664 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28178660-7ae5-46bf-9dde-78e99747c5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:44.905938 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28178660-7ae5-46bf-9dde-78e99747c5e6 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:44.906647 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28178660-7ae5-46bf-9dde-78e99747c5e6 None admin] RBAC: Adding query filter params (name=network) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:44.906951 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28178660-7ae5-46bf-9dde-78e99747c5e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:44.908353 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28178660-7ae5-46bf-9dde-78e99747c5e6 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:44.913825 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 407/816] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Apr 11 13:42:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:44.921192 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057a86c-378d-44b1-84e1-6a25eefb8320 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:45.041423 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057a86c-378d-44b1-84e1-6a25eefb8320 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:45.085245 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedfd1f-0b66-4b60-b91b-04798e0fb553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:45.085919 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedfd1f-0b66-4b60-b91b-04798e0fb553 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:45.086204 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedfd1f-0b66-4b60-b91b-04798e0fb553 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:45.086478 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedfd1f-0b66-4b60-b91b-04798e0fb553 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:45.087181 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedfd1f-0b66-4b60-b91b-04798e0fb553 None admin] RBAC: Adding query filter params (type=network) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:45.087489 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedfd1f-0b66-4b60-b91b-04798e0fb553 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:45.088878 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedfd1f-0b66-4b60-b91b-04798e0fb553 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:45.099767 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 410/817] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Apr 11 13:42:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:45.105620 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28178660-7ae5-46bf-9dde-78e99747c5e6 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:45.215987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28178660-7ae5-46bf-9dde-78e99747c5e6 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:45.255712 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd213bd-7668-4cda-b34a-9a046acb66d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:45.256379 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd213bd-7668-4cda-b34a-9a046acb66d2 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:45.256659 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd213bd-7668-4cda-b34a-9a046acb66d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:45.256931 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd213bd-7668-4cda-b34a-9a046acb66d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:45.257688 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd213bd-7668-4cda-b34a-9a046acb66d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:45.259057 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd213bd-7668-4cda-b34a-9a046acb66d2 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:45.266924 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568670b1-36ed-46c4-a129-de2d4faa2033 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:45.267219 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568670b1-36ed-46c4-a129-de2d4faa2033 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:45.267500 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568670b1-36ed-46c4-a129-de2d4faa2033 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:45.269148 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 411/818] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:45.274819 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7d3cc-a05e-4cb3-b7ea-9487aab7a962 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:45.275758 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7d3cc-a05e-4cb3-b7ea-9487aab7a962 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:45.275758 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7d3cc-a05e-4cb3-b7ea-9487aab7a962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:45.291178 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 408/819] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Apr 11 13:42:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:42:45.302213 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-f1b7d3cc-a05e-4cb3-b7ea-9487aab7a962 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:45.303352 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f1b7d3cc-a05e-4cb3-b7ea-9487aab7a962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:45.398754 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 412/820] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:42:45.438494 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd213bd-7668-4cda-b34a-9a046acb66d2 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:45.570280 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd213bd-7668-4cda-b34a-9a046acb66d2 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:45.612794 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697b0e1-588a-433e-ba6d-16a921485f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:45.614901 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697b0e1-588a-433e-ba6d-16a921485f56 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:45.615429 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697b0e1-588a-433e-ba6d-16a921485f56 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:45.615928 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697b0e1-588a-433e-ba6d-16a921485f56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:45.630688 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697b0e1-588a-433e-ba6d-16a921485f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:45.638102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-1697b0e1-588a-433e-ba6d-16a921485f56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:42:45.639919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 409/821] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:42:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:45.650551 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7d3cc-a05e-4cb3-b7ea-9487aab7a962 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:45.759244 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7d3cc-a05e-4cb3-b7ea-9487aab7a962 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:45.798811 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10852b7f-c765-41d7-94c8-39bdcff9e328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:45.799496 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10852b7f-c765-41d7-94c8-39bdcff9e328 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:45.799814 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10852b7f-c765-41d7-94c8-39bdcff9e328 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:45.800315 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10852b7f-c765-41d7-94c8-39bdcff9e328 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:45.801410 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10852b7f-c765-41d7-94c8-39bdcff9e328 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:45.801823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10852b7f-c765-41d7-94c8-39bdcff9e328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:45.803799 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10852b7f-c765-41d7-94c8-39bdcff9e328 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:45.813797 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 413/822] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:42:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:45.819546 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697b0e1-588a-433e-ba6d-16a921485f56 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:45.928373 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697b0e1-588a-433e-ba6d-16a921485f56 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:45.963878 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb1815-120f-4114-a22e-d27881718f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:45.964701 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb1815-120f-4114-a22e-d27881718f23 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:45.965052 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb1815-120f-4114-a22e-d27881718f23 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:45.965334 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb1815-120f-4114-a22e-d27881718f23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:45.979536 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb1815-120f-4114-a22e-d27881718f23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:45.981156 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb1815-120f-4114-a22e-d27881718f23 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:46.000676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-d6eb1815-120f-4114-a22e-d27881718f23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:46.002253 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 410/823] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:46.008073 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10852b7f-c765-41d7-94c8-39bdcff9e328 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:46.123404 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10852b7f-c765-41d7-94c8-39bdcff9e328 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:46.158514 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c52b73-04aa-4074-bd9a-b0b5dd0e7dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:46.159187 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c52b73-04aa-4074-bd9a-b0b5dd0e7dec None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:46.159473 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c52b73-04aa-4074-bd9a-b0b5dd0e7dec None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:46.159783 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c52b73-04aa-4074-bd9a-b0b5dd0e7dec None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:46.161191 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c52b73-04aa-4074-bd9a-b0b5dd0e7dec None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:46.161537 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c52b73-04aa-4074-bd9a-b0b5dd0e7dec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:46.162931 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c52b73-04aa-4074-bd9a-b0b5dd0e7dec None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:46.176074 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 414/824] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:46.182143 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb1815-120f-4114-a22e-d27881718f23 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:46.290605 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb1815-120f-4114-a22e-d27881718f23 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:46.327338 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50a35d-e41f-4516-8060-c8fba9eebb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:46.328179 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50a35d-e41f-4516-8060-c8fba9eebb5b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:46.328522 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50a35d-e41f-4516-8060-c8fba9eebb5b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:46.328800 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50a35d-e41f-4516-8060-c8fba9eebb5b None admin] PATH_INFO: `/v3/users/nova` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:46.338224 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50a35d-e41f-4516-8060-c8fba9eebb5b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:46.339800 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50a35d-e41f-4516-8060-c8fba9eebb5b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:46.358313 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-ae50a35d-e41f-4516-8060-c8fba9eebb5b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 13:42:46.364043 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 411/825] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Apr 11 13:42:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:46.365968 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c52b73-04aa-4074-bd9a-b0b5dd0e7dec None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:46.471824 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c52b73-04aa-4074-bd9a-b0b5dd0e7dec None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:46.507834 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562c1e8-b0df-4bfa-aa8d-beb2d206f6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:46.508523 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562c1e8-b0df-4bfa-aa8d-beb2d206f6e6 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:46.508810 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562c1e8-b0df-4bfa-aa8d-beb2d206f6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:46.509087 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562c1e8-b0df-4bfa-aa8d-beb2d206f6e6 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:46.509936 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562c1e8-b0df-4bfa-aa8d-beb2d206f6e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:46.510246 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562c1e8-b0df-4bfa-aa8d-beb2d206f6e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:46.511699 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562c1e8-b0df-4bfa-aa8d-beb2d206f6e6 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:46.530927 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 415/826] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Apr 11 13:42:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:46.536979 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd011e-73d9-4d1f-a57c-d9519e223b06 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:46.537273 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd011e-73d9-4d1f-a57c-d9519e223b06 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:46.537753 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd011e-73d9-4d1f-a57c-d9519e223b06 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:46.539299 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 412/827] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:46.544736 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562c1e8-b0df-4bfa-aa8d-beb2d206f6e6 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:46.544898 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffb96c-4ed3-42c0-ac2c-4e04e182e73f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:46.545073 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffb96c-4ed3-42c0-ac2c-4e04e182e73f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:46.545644 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffb96c-4ed3-42c0-ac2c-4e04e182e73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:46.563096 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-42ffb96c-4ed3-42c0-ac2c-4e04e182e73f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:46.564447 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-42ffb96c-4ed3-42c0-ac2c-4e04e182e73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:46.648021 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 413/828] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:42:46.651845 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562c1e8-b0df-4bfa-aa8d-beb2d206f6e6 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:46.663937 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffb96c-4ed3-42c0-ac2c-4e04e182e73f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:46.687714 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c86921-096b-4dc1-9f09-a1b39630bcfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:46.688728 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c86921-096b-4dc1-9f09-a1b39630bcfd None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:46.689203 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c86921-096b-4dc1-9f09-a1b39630bcfd None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:46.689735 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c86921-096b-4dc1-9f09-a1b39630bcfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:46.759039 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c86921-096b-4dc1-9f09-a1b39630bcfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:46.760881 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c86921-096b-4dc1-9f09-a1b39630bcfd None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:46.765379 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffb96c-4ed3-42c0-ac2c-4e04e182e73f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:46.800219 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c1808-d0e4-4cc4-9c21-755c2f063407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:46.801567 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1808-d0e4-4cc4-9c21-755c2f063407 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:46.801847 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1808-d0e4-4cc4-9c21-755c2f063407 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:46.802128 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1808-d0e4-4cc4-9c21-755c2f063407 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:46.813119 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c1808-d0e4-4cc4-9c21-755c2f063407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:46.820030 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-5d3c1808-d0e4-4cc4-9c21-755c2f063407 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:42:46.826561 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 414/829] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:42:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:46.827699 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c1808-d0e4-4cc4-9c21-755c2f063407 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:46.869297 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 416/830] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:46 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:42:46.876735 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c86921-096b-4dc1-9f09-a1b39630bcfd None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:46.938673 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c1808-d0e4-4cc4-9c21-755c2f063407 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:46.974157 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ba386-2ad7-417d-a8db-a827a6ac4909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:46.974836 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ba386-2ad7-417d-a8db-a827a6ac4909 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:46.975163 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ba386-2ad7-417d-a8db-a827a6ac4909 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:46.975447 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ba386-2ad7-417d-a8db-a827a6ac4909 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:46.976249 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ba386-2ad7-417d-a8db-a827a6ac4909 None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:46.976559 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ba386-2ad7-417d-a8db-a827a6ac4909 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:46.977938 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ba386-2ad7-417d-a8db-a827a6ac4909 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:46.987806 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 415/831] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Apr 11 13:42:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:46.989740 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cd4f8-cbc8-49ef-9b43-4e63f690dde5 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:46.990030 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cd4f8-cbc8-49ef-9b43-4e63f690dde5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:46.990315 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423cd4f8-cbc8-49ef-9b43-4e63f690dde5 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:46.991582 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 416/832] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:46.992446 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cd4f8-cbc8-49ef-9b43-4e63f690dde5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:47.000518 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c86921-096b-4dc1-9f09-a1b39630bcfd None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:47.034360 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681143b-6f48-4ff5-8b09-c951294e195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:47.035746 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681143b-6f48-4ff5-8b09-c951294e195c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:47.036037 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681143b-6f48-4ff5-8b09-c951294e195c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:47.036296 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681143b-6f48-4ff5-8b09-c951294e195c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:47.046588 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681143b-6f48-4ff5-8b09-c951294e195c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:47.048104 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681143b-6f48-4ff5-8b09-c951294e195c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:47.065053 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-1681143b-6f48-4ff5-8b09-c951294e195c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:47.070745 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 417/833] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:47.070745 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912c21c-8434-47a2-bd00-4c3f734c3d8a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:47.070745 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912c21c-8434-47a2-bd00-4c3f734c3d8a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:47.070745 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912c21c-8434-47a2-bd00-4c3f734c3d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:47.087162 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c912c21c-8434-47a2-bd00-4c3f734c3d8a None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:47.088380 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c912c21c-8434-47a2-bd00-4c3f734c3d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:47.099837 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423cd4f8-cbc8-49ef-9b43-4e63f690dde5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:47.132671 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb5bf9-007b-4622-8bc1-122ffd278a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:47.133482 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb5bf9-007b-4622-8bc1-122ffd278a55 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:47.133763 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb5bf9-007b-4622-8bc1-122ffd278a55 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:47.134038 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb5bf9-007b-4622-8bc1-122ffd278a55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:47.144228 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb5bf9-007b-4622-8bc1-122ffd278a55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:47.146314 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb5bf9-007b-4622-8bc1-122ffd278a55 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:47.168202 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-dbbb5bf9-007b-4622-8bc1-122ffd278a55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:47.168386 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 418/834] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:42:47.168476 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 417/835] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:47.168544 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912c21c-8434-47a2-bd00-4c3f734c3d8a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:47.169336 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb5bf9-007b-4622-8bc1-122ffd278a55 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:47.265046 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912c21c-8434-47a2-bd00-4c3f734c3d8a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:47.267993 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb5bf9-007b-4622-8bc1-122ffd278a55 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:47.297530 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ddfe1-fe57-4c76-86e4-64c4cebb17ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:47.298125 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ddfe1-fe57-4c76-86e4-64c4cebb17ec None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:47.298407 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ddfe1-fe57-4c76-86e4-64c4cebb17ec None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:47.298684 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ddfe1-fe57-4c76-86e4-64c4cebb17ec None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:47.299401 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ddfe1-fe57-4c76-86e4-64c4cebb17ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:47.299736 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ddfe1-fe57-4c76-86e4-64c4cebb17ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:47.299907 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d49dd7-41fc-48a9-a445-4c74d8081741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:47.300597 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d49dd7-41fc-48a9-a445-4c74d8081741 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:47.300884 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d49dd7-41fc-48a9-a445-4c74d8081741 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:47.301099 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ddfe1-fe57-4c76-86e4-64c4cebb17ec None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:47.301195 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d49dd7-41fc-48a9-a445-4c74d8081741 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:47.301871 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d49dd7-41fc-48a9-a445-4c74d8081741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:47.302177 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d49dd7-41fc-48a9-a445-4c74d8081741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:47.303535 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d49dd7-41fc-48a9-a445-4c74d8081741 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:47.311800 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 419/836] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:47.312586 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ddfe1-fe57-4c76-86e4-64c4cebb17ec None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:47.319337 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 418/837] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:47.320714 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321b0ba-a8ac-4a49-9ece-d22f761275d6 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:47.321469 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321b0ba-a8ac-4a49-9ece-d22f761275d6 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:47.321758 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321b0ba-a8ac-4a49-9ece-d22f761275d6 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:47.323887 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 419/838] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:47.328308 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321b0ba-a8ac-4a49-9ece-d22f761275d6 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:47.406382 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ddfe1-fe57-4c76-86e4-64c4cebb17ec None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:47.425457 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321b0ba-a8ac-4a49-9ece-d22f761275d6 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:47.438396 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec496e0-17ff-40d0-bef5-cac23f1e7b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:47.439188 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec496e0-17ff-40d0-bef5-cac23f1e7b57 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:47.439469 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec496e0-17ff-40d0-bef5-cac23f1e7b57 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:47.439770 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec496e0-17ff-40d0-bef5-cac23f1e7b57 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:47.440415 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec496e0-17ff-40d0-bef5-cac23f1e7b57 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:47.442518 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec496e0-17ff-40d0-bef5-cac23f1e7b57 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:47.453362 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-3ec496e0-17ff-40d0-bef5-cac23f1e7b57 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 11 13:42:47.454517 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 420/839] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:42:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:47.455280 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec496e0-17ff-40d0-bef5-cac23f1e7b57 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:47.465640 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b133f-ef49-4bfb-8166-1dec4c93afa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:47.466443 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b133f-ef49-4bfb-8166-1dec4c93afa5 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:47.466730 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b133f-ef49-4bfb-8166-1dec4c93afa5 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:47.467009 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b133f-ef49-4bfb-8166-1dec4c93afa5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:47.474533 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b133f-ef49-4bfb-8166-1dec4c93afa5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:47.476016 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b133f-ef49-4bfb-8166-1dec4c93afa5 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:47.489526 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-840b133f-ef49-4bfb-8166-1dec4c93afa5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:47.490704 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 420/840] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:47.491884 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145ec98-280f-465f-a695-9cd82835d241 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:47.492174 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145ec98-280f-465f-a695-9cd82835d241 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:47.492450 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145ec98-280f-465f-a695-9cd82835d241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:47.508157 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-1145ec98-280f-465f-a695-9cd82835d241 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:47.509342 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1145ec98-280f-465f-a695-9cd82835d241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:47.548376 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec496e0-17ff-40d0-bef5-cac23f1e7b57 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:47.571643 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 421/841] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:42:47.572543 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145ec98-280f-465f-a695-9cd82835d241 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:47.580571 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2cfe0-ac27-4fd5-81e9-feb61c099c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:47.581584 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2cfe0-ac27-4fd5-81e9-feb61c099c67 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:47.582183 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2cfe0-ac27-4fd5-81e9-feb61c099c67 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:47.582717 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2cfe0-ac27-4fd5-81e9-feb61c099c67 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:47.590194 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2cfe0-ac27-4fd5-81e9-feb61c099c67 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:47.591883 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2cfe0-ac27-4fd5-81e9-feb61c099c67 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:47.606406 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-6ef2cfe0-ac27-4fd5-81e9-feb61c099c67 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 13:42:47.607600 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 421/842] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Apr 11 13:42:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:47.608379 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2cfe0-ac27-4fd5-81e9-feb61c099c67 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:47.665217 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145ec98-280f-465f-a695-9cd82835d241 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:47.697840 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44bd8d-5078-4403-8780-4f11aa15f84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:47.698504 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44bd8d-5078-4403-8780-4f11aa15f84b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:47.698789 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44bd8d-5078-4403-8780-4f11aa15f84b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:47.699070 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44bd8d-5078-4403-8780-4f11aa15f84b None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:47.699908 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44bd8d-5078-4403-8780-4f11aa15f84b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:47.700129 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44bd8d-5078-4403-8780-4f11aa15f84b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:47.701669 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2cfe0-ac27-4fd5-81e9-feb61c099c67 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:47.702485 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44bd8d-5078-4403-8780-4f11aa15f84b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:47.707358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 422/843] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:42:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:47.708179 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44bd8d-5078-4403-8780-4f11aa15f84b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:47.734469 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b247ac6-2af0-428f-88e4-01f41083cb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:47.735122 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b247ac6-2af0-428f-88e4-01f41083cb71 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:47.735401 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b247ac6-2af0-428f-88e4-01f41083cb71 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:47.735703 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b247ac6-2af0-428f-88e4-01f41083cb71 None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:47.736505 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b247ac6-2af0-428f-88e4-01f41083cb71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:47.736812 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b247ac6-2af0-428f-88e4-01f41083cb71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:47.738350 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b247ac6-2af0-428f-88e4-01f41083cb71 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:47.749839 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 422/844] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:47.750631 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b247ac6-2af0-428f-88e4-01f41083cb71 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:47.802676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44bd8d-5078-4403-8780-4f11aa15f84b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:47.834574 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406d17c-7329-4c35-9ce4-30241f77f02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:47.835369 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406d17c-7329-4c35-9ce4-30241f77f02f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:47.835675 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406d17c-7329-4c35-9ce4-30241f77f02f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:47.835947 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406d17c-7329-4c35-9ce4-30241f77f02f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:47.844944 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b247ac6-2af0-428f-88e4-01f41083cb71 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:47.845431 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406d17c-7329-4c35-9ce4-30241f77f02f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:47.852980 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-9406d17c-7329-4c35-9ce4-30241f77f02f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:42:47.854170 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 423/845] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:42:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:47.854931 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406d17c-7329-4c35-9ce4-30241f77f02f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:47.877973 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b851f4-4b85-4ea3-9aa2-abcfd963b249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:47.878704 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b851f4-4b85-4ea3-9aa2-abcfd963b249 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:47.879041 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b851f4-4b85-4ea3-9aa2-abcfd963b249 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:47.879325 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b851f4-4b85-4ea3-9aa2-abcfd963b249 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:47.880191 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b851f4-4b85-4ea3-9aa2-abcfd963b249 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:47.880506 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b851f4-4b85-4ea3-9aa2-abcfd963b249 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:47.881930 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b851f4-4b85-4ea3-9aa2-abcfd963b249 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:47.898517 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 423/846] 10.222.0.67 () {56 vars in 1149 bytes} [Mon Apr 11 13:42:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:47.899315 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b851f4-4b85-4ea3-9aa2-abcfd963b249 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:47.946883 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406d17c-7329-4c35-9ce4-30241f77f02f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:47.978341 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050dd60-3342-49f3-b965-b3ddbea2454a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:47.978994 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050dd60-3342-49f3-b965-b3ddbea2454a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:47.979272 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050dd60-3342-49f3-b965-b3ddbea2454a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:47.979542 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9050dd60-3342-49f3-b965-b3ddbea2454a None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:47.980297 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050dd60-3342-49f3-b965-b3ddbea2454a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:47.980600 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050dd60-3342-49f3-b965-b3ddbea2454a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:47.981969 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9050dd60-3342-49f3-b965-b3ddbea2454a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:47.986206 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 424/847] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:42:47 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:47.986959 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050dd60-3342-49f3-b965-b3ddbea2454a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:47.991877 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b851f4-4b85-4ea3-9aa2-abcfd963b249 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:48.027761 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483534d-a9e7-4379-9efc-2468525692b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:48.028437 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483534d-a9e7-4379-9efc-2468525692b2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:48.028832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483534d-a9e7-4379-9efc-2468525692b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:48.029027 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483534d-a9e7-4379-9efc-2468525692b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:48.029838 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483534d-a9e7-4379-9efc-2468525692b2 None admin] RBAC: Adding query filter params (role.id=e3333fcf22b040e3a1f0bfbfe657cffa, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=fedd2314dc594bcba749bf7b0d1e50fb) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:48.030149 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483534d-a9e7-4379-9efc-2468525692b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:48.031611 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483534d-a9e7-4379-9efc-2468525692b2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:48.038582 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 424/848] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:42:47 2022] GET /identity/v3/role_assignments?user.id=fedd2314dc594bcba749bf7b0d1e50fb&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=e3333fcf22b040e3a1f0bfbfe657cffa => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:48.039451 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483534d-a9e7-4379-9efc-2468525692b2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:48.126958 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9050dd60-3342-49f3-b965-b3ddbea2454a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:48.162495 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483534d-a9e7-4379-9efc-2468525692b2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:48.177155 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c43f4-3a26-46b9-bf5c-31173cc2feca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:48.178601 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c43f4-3a26-46b9-bf5c-31173cc2feca None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:48.179364 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c43f4-3a26-46b9-bf5c-31173cc2feca None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:48.179846 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c43f4-3a26-46b9-bf5c-31173cc2feca None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:48.180977 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c43f4-3a26-46b9-bf5c-31173cc2feca None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:48.181821 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c43f4-3a26-46b9-bf5c-31173cc2feca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:48.183599 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c43f4-3a26-46b9-bf5c-31173cc2feca None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:48.198646 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 425/849] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:42:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:48.204921 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c43f4-3a26-46b9-bf5c-31173cc2feca None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:48.208462 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d5604-cabe-4c26-8083-9c7927fef8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:48.209464 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d5604-cabe-4c26-8083-9c7927fef8a0 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:48.209814 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d5604-cabe-4c26-8083-9c7927fef8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:48.210158 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d5604-cabe-4c26-8083-9c7927fef8a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:48.293011 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d5604-cabe-4c26-8083-9c7927fef8a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:48.295033 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d5604-cabe-4c26-8083-9c7927fef8a0 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:48.320590 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c43f4-3a26-46b9-bf5c-31173cc2feca None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:48.361692 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441936a-1ecf-485e-9828-cc43dc4d6e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:48.363210 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441936a-1ecf-485e-9828-cc43dc4d6e0c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:48.363880 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441936a-1ecf-485e-9828-cc43dc4d6e0c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:48.364708 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441936a-1ecf-485e-9828-cc43dc4d6e0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:48.381963 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441936a-1ecf-485e-9828-cc43dc4d6e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:48.381963 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441936a-1ecf-485e-9828-cc43dc4d6e0c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:48.414506 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-2441936a-1ecf-485e-9828-cc43dc4d6e0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:48.420566 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 426/850] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:48.421674 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441936a-1ecf-485e-9828-cc43dc4d6e0c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:48.424670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 425/851] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:48 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:42:48.429985 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d5604-cabe-4c26-8083-9c7927fef8a0 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:48.524947 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441936a-1ecf-485e-9828-cc43dc4d6e0c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:48.526610 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d5604-cabe-4c26-8083-9c7927fef8a0 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:48.559030 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce958b4-57b4-4f84-aed7-599f39007d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:48.559741 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce958b4-57b4-4f84-aed7-599f39007d46 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:48.560085 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce958b4-57b4-4f84-aed7-599f39007d46 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:48.560371 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce958b4-57b4-4f84-aed7-599f39007d46 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:48.561099 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce958b4-57b4-4f84-aed7-599f39007d46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:48.561468 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce958b4-57b4-4f84-aed7-599f39007d46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:48.562413 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c03c5-4fad-4ffe-90a2-33091b746638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:48.562910 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce958b4-57b4-4f84-aed7-599f39007d46 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:48.563204 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c03c5-4fad-4ffe-90a2-33091b746638 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:48.563485 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c03c5-4fad-4ffe-90a2-33091b746638 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:48.563781 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c03c5-4fad-4ffe-90a2-33091b746638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:48.573940 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c03c5-4fad-4ffe-90a2-33091b746638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:48.575260 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 427/852] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:48.575375 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c03c5-4fad-4ffe-90a2-33091b746638 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:48.581031 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce958b4-57b4-4f84-aed7-599f39007d46 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:48.601165 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-bb2c03c5-4fad-4ffe-90a2-33091b746638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:48.602737 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 426/853] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:48.608193 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c03c5-4fad-4ffe-90a2-33091b746638 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:48.681185 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce958b4-57b4-4f84-aed7-599f39007d46 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:48.705510 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c03c5-4fad-4ffe-90a2-33091b746638 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:48.715766 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbce81-08b2-4844-b70e-a3464662a927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:48.716691 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbce81-08b2-4844-b70e-a3464662a927 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:48.717099 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbce81-08b2-4844-b70e-a3464662a927 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:48.717480 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbce81-08b2-4844-b70e-a3464662a927 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:48.725758 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbce81-08b2-4844-b70e-a3464662a927 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:48.727341 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbce81-08b2-4844-b70e-a3464662a927 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:48.741295 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be13a7-102d-462b-9d02-589a7980ca91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:48.741965 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be13a7-102d-462b-9d02-589a7980ca91 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:48.742248 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be13a7-102d-462b-9d02-589a7980ca91 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:48.742456 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-e8cbce81-08b2-4844-b70e-a3464662a927 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 13:42:48.742572 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be13a7-102d-462b-9d02-589a7980ca91 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:48.743238 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be13a7-102d-462b-9d02-589a7980ca91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:48.743546 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be13a7-102d-462b-9d02-589a7980ca91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:48.744353 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 428/854] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:42:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:48.744931 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be13a7-102d-462b-9d02-589a7980ca91 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:48.755653 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbce81-08b2-4844-b70e-a3464662a927 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:48.762880 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 427/855] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:48.767942 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be13a7-102d-462b-9d02-589a7980ca91 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:48.862622 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbce81-08b2-4844-b70e-a3464662a927 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:48.890937 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be13a7-102d-462b-9d02-589a7980ca91 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:48.914167 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0926e9e-7d0f-45fe-9e75-22c0575bdebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:48.915512 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0926e9e-7d0f-45fe-9e75-22c0575bdebe None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:48.916023 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0926e9e-7d0f-45fe-9e75-22c0575bdebe None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:48.916614 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0926e9e-7d0f-45fe-9e75-22c0575bdebe None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:48.918285 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0926e9e-7d0f-45fe-9e75-22c0575bdebe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:48.918819 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0926e9e-7d0f-45fe-9e75-22c0575bdebe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:48.921183 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0926e9e-7d0f-45fe-9e75-22c0575bdebe None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:48.928703 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab8815-c11a-461a-8b4e-dc020ef9608b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:48.929618 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab8815-c11a-461a-8b4e-dc020ef9608b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:48.929971 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab8815-c11a-461a-8b4e-dc020ef9608b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:48.930318 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab8815-c11a-461a-8b4e-dc020ef9608b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:48.937898 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab8815-c11a-461a-8b4e-dc020ef9608b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:48.939385 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab8815-c11a-461a-8b4e-dc020ef9608b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:48.945846 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 429/856] 10.222.0.67 () {56 vars in 1135 bytes} [Mon Apr 11 13:42:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:48.951930 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0926e9e-7d0f-45fe-9e75-22c0575bdebe None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:48.954262 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-30ab8815-c11a-461a-8b4e-dc020ef9608b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:48.956201 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 428/857] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:48.961585 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab8815-c11a-461a-8b4e-dc020ef9608b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:49.053993 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0926e9e-7d0f-45fe-9e75-22c0575bdebe None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:49.059914 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab8815-c11a-461a-8b4e-dc020ef9608b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:49.088708 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ba2c6-2723-4b52-8fac-e0c83c90fe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:49.089630 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ba2c6-2723-4b52-8fac-e0c83c90fe96 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:49.090067 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ba2c6-2723-4b52-8fac-e0c83c90fe96 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:49.090496 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ba2c6-2723-4b52-8fac-e0c83c90fe96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:49.093780 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc5a2d-10d8-4d0e-ba14-2f00279b3a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:49.094439 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc5a2d-10d8-4d0e-ba14-2f00279b3a57 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:49.094732 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc5a2d-10d8-4d0e-ba14-2f00279b3a57 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:49.095622 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc5a2d-10d8-4d0e-ba14-2f00279b3a57 None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:49.095799 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc5a2d-10d8-4d0e-ba14-2f00279b3a57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:49.096112 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc5a2d-10d8-4d0e-ba14-2f00279b3a57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:49.098102 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc5a2d-10d8-4d0e-ba14-2f00279b3a57 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:49.114943 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 429/858] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:49.116275 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc5a2d-10d8-4d0e-ba14-2f00279b3a57 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:49.161929 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ba2c6-2723-4b52-8fac-e0c83c90fe96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:49.163736 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ba2c6-2723-4b52-8fac-e0c83c90fe96 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:49.218888 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc5a2d-10d8-4d0e-ba14-2f00279b3a57 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:49.252852 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84c068-5b34-464b-807f-334dcb804422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:49.254074 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84c068-5b34-464b-807f-334dcb804422 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:49.254476 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84c068-5b34-464b-807f-334dcb804422 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:49.254749 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84c068-5b34-464b-807f-334dcb804422 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:49.255576 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84c068-5b34-464b-807f-334dcb804422 None admin] RBAC: Adding query filter params (role.id=c190a911c52940bb9b0fc255a4f7cad3, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=920ed843195243f8abd6dfb2ebb3a549) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:49.255914 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84c068-5b34-464b-807f-334dcb804422 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:49.257376 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84c068-5b34-464b-807f-334dcb804422 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:49.265602 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 430/859] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:42:49 2022] GET /identity/v3/role_assignments?user.id=920ed843195243f8abd6dfb2ebb3a549&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=c190a911c52940bb9b0fc255a4f7cad3 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:49.291712 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 430/860] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:48 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:42:49.294654 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84c068-5b34-464b-807f-334dcb804422 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:49.401986 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84c068-5b34-464b-807f-334dcb804422 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:49.437712 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225831d-1f74-4f76-bdf5-a19cb2142119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:49.438523 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225831d-1f74-4f76-bdf5-a19cb2142119 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:49.438810 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225831d-1f74-4f76-bdf5-a19cb2142119 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:49.439087 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225831d-1f74-4f76-bdf5-a19cb2142119 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:49.451276 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225831d-1f74-4f76-bdf5-a19cb2142119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:49.452771 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225831d-1f74-4f76-bdf5-a19cb2142119 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:49.470152 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-c225831d-1f74-4f76-bdf5-a19cb2142119 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:49.471503 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 431/861] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:49.477109 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ba2c6-2723-4b52-8fac-e0c83c90fe96 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:49.576154 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ba2c6-2723-4b52-8fac-e0c83c90fe96 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:49.610011 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacf412-3317-428d-81e9-5b845fa12d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:49.610974 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacf412-3317-428d-81e9-5b845fa12d56 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:49.611402 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacf412-3317-428d-81e9-5b845fa12d56 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:49.611874 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacf412-3317-428d-81e9-5b845fa12d56 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:49.612744 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacf412-3317-428d-81e9-5b845fa12d56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:49.613744 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacf412-3317-428d-81e9-5b845fa12d56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:49.615312 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacf412-3317-428d-81e9-5b845fa12d56 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:49.627104 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 431/862] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:49.632715 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225831d-1f74-4f76-bdf5-a19cb2142119 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:49.736190 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225831d-1f74-4f76-bdf5-a19cb2142119 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:49.770560 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21a4d9-403e-4a90-b3e2-6826199ef7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:49.771598 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21a4d9-403e-4a90-b3e2-6826199ef7e2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:49.772066 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21a4d9-403e-4a90-b3e2-6826199ef7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:49.772501 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21a4d9-403e-4a90-b3e2-6826199ef7e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:49.779456 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21a4d9-403e-4a90-b3e2-6826199ef7e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:49.781112 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21a4d9-403e-4a90-b3e2-6826199ef7e2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:49.795928 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-dd21a4d9-403e-4a90-b3e2-6826199ef7e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:49.797694 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 432/863] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:49.807651 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacf412-3317-428d-81e9-5b845fa12d56 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:49.904377 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacf412-3317-428d-81e9-5b845fa12d56 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:49.938175 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a967c-e4d8-4c96-a6cd-7c23f17b7176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:49.938842 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a967c-e4d8-4c96-a6cd-7c23f17b7176 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:49.939122 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a967c-e4d8-4c96-a6cd-7c23f17b7176 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:49.939401 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a967c-e4d8-4c96-a6cd-7c23f17b7176 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:49.940222 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a967c-e4d8-4c96-a6cd-7c23f17b7176 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:49.940533 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a967c-e4d8-4c96-a6cd-7c23f17b7176 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:49.942593 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a967c-e4d8-4c96-a6cd-7c23f17b7176 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:49.955470 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 432/864] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:49.961852 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21a4d9-403e-4a90-b3e2-6826199ef7e2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:50.065943 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21a4d9-403e-4a90-b3e2-6826199ef7e2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:50.102511 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbe171-5de6-4723-92eb-30afdef17726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:50.103591 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbe171-5de6-4723-92eb-30afdef17726 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:50.104120 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbe171-5de6-4723-92eb-30afdef17726 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:50.104612 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbe171-5de6-4723-92eb-30afdef17726 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:50.105672 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbe171-5de6-4723-92eb-30afdef17726 None admin] RBAC: Adding query filter params (role.id=e3333fcf22b040e3a1f0bfbfe657cffa, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=6660794b27ff4a7bbe9b6b043593598c) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:50.106194 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbe171-5de6-4723-92eb-30afdef17726 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:50.107897 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbe171-5de6-4723-92eb-30afdef17726 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:50.115944 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 433/865] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:42:49 2022] GET /identity/v3/role_assignments?user.id=6660794b27ff4a7bbe9b6b043593598c&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=e3333fcf22b040e3a1f0bfbfe657cffa => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:50.425031 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cd292-f719-4b19-8bde-028b9d8bcea5 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:50.426100 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cd292-f719-4b19-8bde-028b9d8bcea5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:50.426387 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cd292-f719-4b19-8bde-028b9d8bcea5 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:50.428129 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 433/866] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:50.433530 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8ccf4-a777-4d71-ac39-af6b1f8dbfb1 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:50.433828 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8ccf4-a777-4d71-ac39-af6b1f8dbfb1 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:50.434112 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8ccf4-a777-4d71-ac39-af6b1f8dbfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:50.451016 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-aac8ccf4-a777-4d71-ac39-af6b1f8dbfb1 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:50.452238 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-aac8ccf4-a777-4d71-ac39-af6b1f8dbfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:50.486273 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee3e12-d7bb-4ceb-a2eb-e0a64c6fda36 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:50.486809 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee3e12-d7bb-4ceb-a2eb-e0a64c6fda36 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:50.486809 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee3e12-d7bb-4ceb-a2eb-e0a64c6fda36 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:50.488265 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 434/867] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:42:50.493533 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd56cd3-dd72-4ecf-859b-ea2e64a9c30d None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:50.493899 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd56cd3-dd72-4ecf-859b-ea2e64a9c30d None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:50.494175 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd56cd3-dd72-4ecf-859b-ea2e64a9c30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:50.515969 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-2dd56cd3-dd72-4ecf-859b-ea2e64a9c30d None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:50.517727 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2dd56cd3-dd72-4ecf-859b-ea2e64a9c30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:50.520950 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 434/868] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:42:50.544635 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8ccf4-a777-4d71-ac39-af6b1f8dbfb1 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:50.611988 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 435/869] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:42:50.630886 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd56cd3-dd72-4ecf-859b-ea2e64a9c30d None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:50.660129 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8ccf4-a777-4d71-ac39-af6b1f8dbfb1 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:50.695002 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b11448-57e5-4401-bc86-4d9ea83283b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:50.696041 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b11448-57e5-4401-bc86-4d9ea83283b9 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:50.696526 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b11448-57e5-4401-bc86-4d9ea83283b9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:50.697009 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b11448-57e5-4401-bc86-4d9ea83283b9 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:50.698184 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b11448-57e5-4401-bc86-4d9ea83283b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:50.699861 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b11448-57e5-4401-bc86-4d9ea83283b9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:50.724096 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 435/870] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Apr 11 13:42:50 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:42:50.730561 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd56cd3-dd72-4ecf-859b-ea2e64a9c30d None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:50.774608 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf13a0-aaf6-4d0f-8ef8-a7ea722585f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:50.775441 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf13a0-aaf6-4d0f-8ef8-a7ea722585f5 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:50.775760 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf13a0-aaf6-4d0f-8ef8-a7ea722585f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:50.776125 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf13a0-aaf6-4d0f-8ef8-a7ea722585f5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:50.776770 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf13a0-aaf6-4d0f-8ef8-a7ea722585f5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:50.778175 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf13a0-aaf6-4d0f-8ef8-a7ea722585f5 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:50.791063 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-43bf13a0-aaf6-4d0f-8ef8-a7ea722585f5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 11 13:42:50.792699 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 436/871] 10.222.0.67 () {56 vars in 1132 bytes} [Mon Apr 11 13:42:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:50.799966 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b11448-57e5-4401-bc86-4d9ea83283b9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:50.908738 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b11448-57e5-4401-bc86-4d9ea83283b9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:50.944251 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42557556-42f8-4bbd-8489-58394e7d50fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:50.945239 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42557556-42f8-4bbd-8489-58394e7d50fc None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:50.945720 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42557556-42f8-4bbd-8489-58394e7d50fc None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:50.946207 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42557556-42f8-4bbd-8489-58394e7d50fc None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:50.947106 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42557556-42f8-4bbd-8489-58394e7d50fc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:50.947880 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42557556-42f8-4bbd-8489-58394e7d50fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:50.949450 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42557556-42f8-4bbd-8489-58394e7d50fc None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:50.954791 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 436/872] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Apr 11 13:42:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:50.961483 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf13a0-aaf6-4d0f-8ef8-a7ea722585f5 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:51.061052 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf13a0-aaf6-4d0f-8ef8-a7ea722585f5 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:51.095403 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4beae93-9ee4-44f9-8c52-10f2ba2103c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:51.096100 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4beae93-9ee4-44f9-8c52-10f2ba2103c3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:51.096386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4beae93-9ee4-44f9-8c52-10f2ba2103c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:51.096661 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4beae93-9ee4-44f9-8c52-10f2ba2103c3 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:51.097558 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4beae93-9ee4-44f9-8c52-10f2ba2103c3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:51.097863 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4beae93-9ee4-44f9-8c52-10f2ba2103c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:51.099241 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4beae93-9ee4-44f9-8c52-10f2ba2103c3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:51.104161 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 437/873] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Apr 11 13:42:50 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:51.804504 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fc119-be34-420c-9e8b-86f71e868b7f None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:51.804997 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fc119-be34-420c-9e8b-86f71e868b7f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:51.804997 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fc119-be34-420c-9e8b-86f71e868b7f None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:51.806728 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 437/874] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:51.812226 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a32fc-fbff-4af2-b2d7-356245794c1d None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:51.812668 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a32fc-fbff-4af2-b2d7-356245794c1d None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:51.812855 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a32fc-fbff-4af2-b2d7-356245794c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:51.830483 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-144a32fc-fbff-4af2-b2d7-356245794c1d None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:51.832228 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-144a32fc-fbff-4af2-b2d7-356245794c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:51.901726 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 438/875] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:51 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:42:51.926767 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fc119-be34-420c-9e8b-86f71e868b7f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:52.029506 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fc119-be34-420c-9e8b-86f71e868b7f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:52.062670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50828efd-c4b9-4f41-a0cc-79c0a9db40e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:52.063419 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50828efd-c4b9-4f41-a0cc-79c0a9db40e4 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:52.063725 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50828efd-c4b9-4f41-a0cc-79c0a9db40e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:52.063999 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50828efd-c4b9-4f41-a0cc-79c0a9db40e4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:52.074868 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50828efd-c4b9-4f41-a0cc-79c0a9db40e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:52.082981 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-50828efd-c4b9-4f41-a0cc-79c0a9db40e4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 13:42:52.084536 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 438/876] 10.222.0.67 () {56 vars in 1120 bytes} [Mon Apr 11 13:42:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:52.090398 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a32fc-fbff-4af2-b2d7-356245794c1d None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:52.193191 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a32fc-fbff-4af2-b2d7-356245794c1d None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:52.228711 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c41f0-c0b1-48ba-847e-84b85f6b149d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:52.229391 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c41f0-c0b1-48ba-847e-84b85f6b149d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:52.235658 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c41f0-c0b1-48ba-847e-84b85f6b149d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:52.235658 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c41f0-c0b1-48ba-847e-84b85f6b149d None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:52.235658 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c41f0-c0b1-48ba-847e-84b85f6b149d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:52.235658 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c41f0-c0b1-48ba-847e-84b85f6b149d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:52.235658 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c41f0-c0b1-48ba-847e-84b85f6b149d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:52.241214 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 439/877] 10.222.0.67 () {56 vars in 1115 bytes} [Mon Apr 11 13:42:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:52.252927 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50828efd-c4b9-4f41-a0cc-79c0a9db40e4 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:52.483209 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50828efd-c4b9-4f41-a0cc-79c0a9db40e4 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:52.528598 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a7d97-e3e2-4073-9dd8-7b72673e10fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:52.529405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a7d97-e3e2-4073-9dd8-7b72673e10fe None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:52.529686 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a7d97-e3e2-4073-9dd8-7b72673e10fe None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:52.529961 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a7d97-e3e2-4073-9dd8-7b72673e10fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:52.546510 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a7d97-e3e2-4073-9dd8-7b72673e10fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:52.551563 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b82a86-d1cc-4359-8cf2-2f62b81b1078 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:52.551563 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b82a86-d1cc-4359-8cf2-2f62b81b1078 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:52.551563 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b82a86-d1cc-4359-8cf2-2f62b81b1078 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:52.555663 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 440/878] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:52.555780 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a7d97-e3e2-4073-9dd8-7b72673e10fe None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:52.557294 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e548ffe-7353-4270-9895-e6b2969649e3 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:52.557678 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e548ffe-7353-4270-9895-e6b2969649e3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:52.557956 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e548ffe-7353-4270-9895-e6b2969649e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:52.590229 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-807a7d97-e3e2-4073-9dd8-7b72673e10fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:52.591794 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 439/879] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:52.592849 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-2e548ffe-7353-4270-9895-e6b2969649e3 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:52.594057 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2e548ffe-7353-4270-9895-e6b2969649e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:52.598311 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a7d97-e3e2-4073-9dd8-7b72673e10fe None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:52.711718 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a7d97-e3e2-4073-9dd8-7b72673e10fe None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:52.753772 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 441/880] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:52 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:42:52.754954 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93871aac-5232-483a-acf3-2940e2ddcc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:52.755725 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93871aac-5232-483a-acf3-2940e2ddcc99 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:52.755964 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93871aac-5232-483a-acf3-2940e2ddcc99 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:52.756240 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93871aac-5232-483a-acf3-2940e2ddcc99 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:52.756987 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93871aac-5232-483a-acf3-2940e2ddcc99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:52.757297 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93871aac-5232-483a-acf3-2940e2ddcc99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:52.758708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93871aac-5232-483a-acf3-2940e2ddcc99 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:52.775817 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 440/881] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:52.781287 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e548ffe-7353-4270-9895-e6b2969649e3 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:52.785157 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93871aac-5232-483a-acf3-2940e2ddcc99 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:52.881406 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e548ffe-7353-4270-9895-e6b2969649e3 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:52.884486 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93871aac-5232-483a-acf3-2940e2ddcc99 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:52.915350 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69969de-8d38-4b05-b365-cdb71357033d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:52.916261 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69969de-8d38-4b05-b365-cdb71357033d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:52.916543 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69969de-8d38-4b05-b365-cdb71357033d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:52.916832 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69969de-8d38-4b05-b365-cdb71357033d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:52.920426 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ddaa5-2dc5-4b1e-afb0-09132d13562b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:52.921482 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ddaa5-2dc5-4b1e-afb0-09132d13562b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:52.921969 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ddaa5-2dc5-4b1e-afb0-09132d13562b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:52.922437 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ddaa5-2dc5-4b1e-afb0-09132d13562b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:52.923283 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ddaa5-2dc5-4b1e-afb0-09132d13562b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:52.924276 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69969de-8d38-4b05-b365-cdb71357033d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:52.925322 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ddaa5-2dc5-4b1e-afb0-09132d13562b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:52.925967 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69969de-8d38-4b05-b365-cdb71357033d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:52.937123 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-039ddaa5-2dc5-4b1e-afb0-09132d13562b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 13:42:52.938935 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 441/882] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Apr 11 13:42:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:52.945483 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-a69969de-8d38-4b05-b365-cdb71357033d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 13:42:52.945483 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 442/883] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Apr 11 13:42:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:52.948290 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ddaa5-2dc5-4b1e-afb0-09132d13562b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:52.948421 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69969de-8d38-4b05-b365-cdb71357033d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:53.068051 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69969de-8d38-4b05-b365-cdb71357033d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:53.069804 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ddaa5-2dc5-4b1e-afb0-09132d13562b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:53.110128 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d0248-c153-4947-b87b-5ff8e195201b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:53.110900 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d0248-c153-4947-b87b-5ff8e195201b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:53.111261 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d0248-c153-4947-b87b-5ff8e195201b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:53.111615 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d0248-c153-4947-b87b-5ff8e195201b None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:53.112801 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d0248-c153-4947-b87b-5ff8e195201b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:53.113191 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d0248-c153-4947-b87b-5ff8e195201b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:53.114817 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d0248-c153-4947-b87b-5ff8e195201b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:53.115942 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9842aa7-a6a5-4d0a-b4d3-da5018a44bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:53.117010 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9842aa7-a6a5-4d0a-b4d3-da5018a44bcb None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:53.117475 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9842aa7-a6a5-4d0a-b4d3-da5018a44bcb None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:53.118751 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9842aa7-a6a5-4d0a-b4d3-da5018a44bcb None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:53.119671 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9842aa7-a6a5-4d0a-b4d3-da5018a44bcb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:53.120163 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9842aa7-a6a5-4d0a-b4d3-da5018a44bcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:53.121721 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9842aa7-a6a5-4d0a-b4d3-da5018a44bcb None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:53.128297 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 442/884] 10.222.0.67 () {56 vars in 1122 bytes} [Mon Apr 11 13:42:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:53.129988 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa402821-2d86-462f-a17e-13bde26353a4 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:53.130491 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa402821-2d86-462f-a17e-13bde26353a4 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:53.131496 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa402821-2d86-462f-a17e-13bde26353a4 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:53.133338 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 443/885] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:53.134241 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa402821-2d86-462f-a17e-13bde26353a4 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:53.139154 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 443/886] 10.222.0.67 () {56 vars in 1149 bytes} [Mon Apr 11 13:42:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:53.140622 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac238eeb-a5dc-4a42-9c88-162f0aecac44 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:53.140912 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac238eeb-a5dc-4a42-9c88-162f0aecac44 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:53.141187 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac238eeb-a5dc-4a42-9c88-162f0aecac44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:53.157621 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ac238eeb-a5dc-4a42-9c88-162f0aecac44 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:53.158801 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ac238eeb-a5dc-4a42-9c88-162f0aecac44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:53.227825 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 444/887] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:42:53.228538 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac238eeb-a5dc-4a42-9c88-162f0aecac44 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:53.248715 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa402821-2d86-462f-a17e-13bde26353a4 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:53.284183 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070afa8-c322-444e-ba0e-0fbab5d2f6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:53.285070 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070afa8-c322-444e-ba0e-0fbab5d2f6ea None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:53.285349 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070afa8-c322-444e-ba0e-0fbab5d2f6ea None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:53.285626 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070afa8-c322-444e-ba0e-0fbab5d2f6ea None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:53.286330 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070afa8-c322-444e-ba0e-0fbab5d2f6ea None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:53.286639 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070afa8-c322-444e-ba0e-0fbab5d2f6ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:53.288002 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070afa8-c322-444e-ba0e-0fbab5d2f6ea None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:53.292260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 444/888] 10.222.0.67 () {56 vars in 1122 bytes} [Mon Apr 11 13:42:53 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:53.293164 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070afa8-c322-444e-ba0e-0fbab5d2f6ea None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:53.331850 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac238eeb-a5dc-4a42-9c88-162f0aecac44 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:53.367741 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897995b4-8a4a-4476-bc77-74848c5c36a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:53.369261 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897995b4-8a4a-4476-bc77-74848c5c36a0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:53.369994 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897995b4-8a4a-4476-bc77-74848c5c36a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:53.370433 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897995b4-8a4a-4476-bc77-74848c5c36a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:53.433989 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070afa8-c322-444e-ba0e-0fbab5d2f6ea None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:53.448709 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897995b4-8a4a-4476-bc77-74848c5c36a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:53.450502 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897995b4-8a4a-4476-bc77-74848c5c36a0 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:53.471767 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a3ee0-d7c9-4cdc-8825-98fb9bd33394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:53.473486 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a3ee0-d7c9-4cdc-8825-98fb9bd33394 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:53.473988 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a3ee0-d7c9-4cdc-8825-98fb9bd33394 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:53.474458 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a3ee0-d7c9-4cdc-8825-98fb9bd33394 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:53.475387 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a3ee0-d7c9-4cdc-8825-98fb9bd33394 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:53.477001 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a3ee0-d7c9-4cdc-8825-98fb9bd33394 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:53.489471 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-468a3ee0-d7c9-4cdc-8825-98fb9bd33394 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 11 13:42:53.491374 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 445/889] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:42:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:53.497359 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a3ee0-d7c9-4cdc-8825-98fb9bd33394 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:53.558825 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 445/890] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:42:53 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:42:53.565034 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897995b4-8a4a-4476-bc77-74848c5c36a0 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:53.617810 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a3ee0-d7c9-4cdc-8825-98fb9bd33394 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:53.652241 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454af62-0c93-4919-b601-0b2fa8f19a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:53.652910 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454af62-0c93-4919-b601-0b2fa8f19a47 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:53.653190 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454af62-0c93-4919-b601-0b2fa8f19a47 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:53.653462 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454af62-0c93-4919-b601-0b2fa8f19a47 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:53.654157 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454af62-0c93-4919-b601-0b2fa8f19a47 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:53.654460 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454af62-0c93-4919-b601-0b2fa8f19a47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:53.655870 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454af62-0c93-4919-b601-0b2fa8f19a47 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:53.660886 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 446/891] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:42:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:53.662107 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0c4bc-a8e3-477b-aab3-fa128a885204 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:53.662396 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0c4bc-a8e3-477b-aab3-fa128a885204 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:53.662672 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0c4bc-a8e3-477b-aab3-fa128a885204 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:53.667748 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 447/892] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:53.667748 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0c4bc-a8e3-477b-aab3-fa128a885204 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:53.670086 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897995b4-8a4a-4476-bc77-74848c5c36a0 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:53.703231 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54f499-b472-4d90-af97-573bb438dd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:53.704072 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54f499-b472-4d90-af97-573bb438dd63 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:53.704357 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54f499-b472-4d90-af97-573bb438dd63 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:53.704632 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54f499-b472-4d90-af97-573bb438dd63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:53.714528 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54f499-b472-4d90-af97-573bb438dd63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:53.716008 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54f499-b472-4d90-af97-573bb438dd63 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:53.733060 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-bf54f499-b472-4d90-af97-573bb438dd63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:53.739401 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 446/893] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:53.739401 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7966f-92b7-4602-896f-3fcabb3b1b93 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:53.739401 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7966f-92b7-4602-896f-3fcabb3b1b93 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:53.739401 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7966f-92b7-4602-896f-3fcabb3b1b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:53.754619 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-94f7966f-92b7-4602-896f-3fcabb3b1b93 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:53.755846 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-94f7966f-92b7-4602-896f-3fcabb3b1b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:53.771415 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0c4bc-a8e3-477b-aab3-fa128a885204 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:53.805559 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233832e-5063-4334-b28d-7c693adf2176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:53.806447 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233832e-5063-4334-b28d-7c693adf2176 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:53.806869 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233832e-5063-4334-b28d-7c693adf2176 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:53.807305 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233832e-5063-4334-b28d-7c693adf2176 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:53.808179 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233832e-5063-4334-b28d-7c693adf2176 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:53.808634 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233832e-5063-4334-b28d-7c693adf2176 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:53.809978 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233832e-5063-4334-b28d-7c693adf2176 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:53.819301 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 448/894] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:42:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:53.819301 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233832e-5063-4334-b28d-7c693adf2176 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:53.826586 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 447/895] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:42:53.835664 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7966f-92b7-4602-896f-3fcabb3b1b93 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:53.916795 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233832e-5063-4334-b28d-7c693adf2176 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:53.931509 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7966f-92b7-4602-896f-3fcabb3b1b93 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:53.949617 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdebcf0-d515-4629-9beb-474d21fc623d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:53.950275 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdebcf0-d515-4629-9beb-474d21fc623d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:53.950557 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdebcf0-d515-4629-9beb-474d21fc623d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:53.950834 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdebcf0-d515-4629-9beb-474d21fc623d None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:53.951549 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdebcf0-d515-4629-9beb-474d21fc623d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:53.951896 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdebcf0-d515-4629-9beb-474d21fc623d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:53.953252 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdebcf0-d515-4629-9beb-474d21fc623d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:53.969524 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 449/896] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:53.969524 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdebcf0-d515-4629-9beb-474d21fc623d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:53.970755 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2352874-f285-4c50-b459-8443ac5853c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:53.971446 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2352874-f285-4c50-b459-8443ac5853c3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:53.971753 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2352874-f285-4c50-b459-8443ac5853c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:53.972595 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2352874-f285-4c50-b459-8443ac5853c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:53.973393 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2352874-f285-4c50-b459-8443ac5853c3 None admin] RBAC: Adding query filter params (interface=public, service_id=b4fcf961abbb4d38aede0757124f1f7e, region_id=RegionOne) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:53.973703 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2352874-f285-4c50-b459-8443ac5853c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:53.975078 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2352874-f285-4c50-b459-8443ac5853c3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:53.984477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 448/897] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Apr 11 13:42:53 2022] GET /identity/v3/endpoints?service_id=b4fcf961abbb4d38aede0757124f1f7e&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:53.984477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2352874-f285-4c50-b459-8443ac5853c3 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:54.072855 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdebcf0-d515-4629-9beb-474d21fc623d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:54.078260 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2352874-f285-4c50-b459-8443ac5853c3 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:54.106588 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576a90a-8426-4c62-8219-8c85d7f4b37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:54.107256 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576a90a-8426-4c62-8219-8c85d7f4b37e None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:54.107538 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576a90a-8426-4c62-8219-8c85d7f4b37e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:54.107841 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576a90a-8426-4c62-8219-8c85d7f4b37e None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:54.108557 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576a90a-8426-4c62-8219-8c85d7f4b37e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:54.109911 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576a90a-8426-4c62-8219-8c85d7f4b37e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:54.114892 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb3002-82f5-448b-bdf8-3988877366f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:54.116040 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb3002-82f5-448b-bdf8-3988877366f9 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:54.116308 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb3002-82f5-448b-bdf8-3988877366f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:54.116629 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb3002-82f5-448b-bdf8-3988877366f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:54.123444 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb3002-82f5-448b-bdf8-3988877366f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:54.124995 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb3002-82f5-448b-bdf8-3988877366f9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:54.131681 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 450/898] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Apr 11 13:42:53 2022] POST /identity/v3/services => generated 269 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:42:54.131681 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576a90a-8426-4c62-8219-8c85d7f4b37e None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:54.147557 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-a6eb3002-82f5-448b-bdf8-3988877366f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:54.151813 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 449/899] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:54.157377 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb3002-82f5-448b-bdf8-3988877366f9 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:54.247679 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576a90a-8426-4c62-8219-8c85d7f4b37e None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:54.275946 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb3002-82f5-448b-bdf8-3988877366f9 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:54.284852 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72cabf-39d8-486d-a7d6-a31b55a82cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:54.285591 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72cabf-39d8-486d-a7d6-a31b55a82cd3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:54.285875 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72cabf-39d8-486d-a7d6-a31b55a82cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:54.286148 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72cabf-39d8-486d-a7d6-a31b55a82cd3 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:54.287042 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72cabf-39d8-486d-a7d6-a31b55a82cd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:54.288751 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72cabf-39d8-486d-a7d6-a31b55a82cd3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:54.300645 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 451/900] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Apr 11 13:42:54 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:42:54.316469 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff5f65-0ca9-43d7-bbf2-d843a7b035db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:54.317303 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff5f65-0ca9-43d7-bbf2-d843a7b035db None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:54.317643 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff5f65-0ca9-43d7-bbf2-d843a7b035db None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:54.317980 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff5f65-0ca9-43d7-bbf2-d843a7b035db None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:54.318876 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff5f65-0ca9-43d7-bbf2-d843a7b035db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:54.319251 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff5f65-0ca9-43d7-bbf2-d843a7b035db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:54.320859 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff5f65-0ca9-43d7-bbf2-d843a7b035db None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:54.335961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 450/901] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:54.342089 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72cabf-39d8-486d-a7d6-a31b55a82cd3 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:54.461509 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72cabf-39d8-486d-a7d6-a31b55a82cd3 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:54.500365 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43371ea2-43e3-4b5f-8b1f-a4bd282932de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:54.501309 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43371ea2-43e3-4b5f-8b1f-a4bd282932de None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:54.501593 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43371ea2-43e3-4b5f-8b1f-a4bd282932de None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:54.501870 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43371ea2-43e3-4b5f-8b1f-a4bd282932de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:54.502706 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43371ea2-43e3-4b5f-8b1f-a4bd282932de None admin] RBAC: Adding query filter params (role.id=d761d545536542028c82c9ceb096b437, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=920ed843195243f8abd6dfb2ebb3a549) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:54.503519 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43371ea2-43e3-4b5f-8b1f-a4bd282932de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:54.505010 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43371ea2-43e3-4b5f-8b1f-a4bd282932de None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:54.511229 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 452/902] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:42:54 2022] GET /identity/v3/role_assignments?user.id=920ed843195243f8abd6dfb2ebb3a549&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=d761d545536542028c82c9ceb096b437 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:55.669730 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fef15c-3b8d-4af9-8684-a8c413491f40 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:55.670210 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fef15c-3b8d-4af9-8684-a8c413491f40 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:55.670210 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fef15c-3b8d-4af9-8684-a8c413491f40 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:55.671824 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 451/903] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:55.677832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79b37b-895c-4d2b-bcb5-6b4202009c5a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:55.678249 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79b37b-895c-4d2b-bcb5-6b4202009c5a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:55.678420 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79b37b-895c-4d2b-bcb5-6b4202009c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:55.695366 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-8c79b37b-895c-4d2b-bcb5-6b4202009c5a None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:55.696593 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8c79b37b-895c-4d2b-bcb5-6b4202009c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:55.763191 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 453/904] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:42:55.788101 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fef15c-3b8d-4af9-8684-a8c413491f40 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:55.889428 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fef15c-3b8d-4af9-8684-a8c413491f40 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:55.923494 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f6529-2668-4a47-9c46-f3cc5e73a5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:55.924133 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f6529-2668-4a47-9c46-f3cc5e73a5da None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:55.924415 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f6529-2668-4a47-9c46-f3cc5e73a5da None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:55.924687 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f6529-2668-4a47-9c46-f3cc5e73a5da None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:55.925963 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f6529-2668-4a47-9c46-f3cc5e73a5da None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:55.927339 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f6529-2668-4a47-9c46-f3cc5e73a5da None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:55.945115 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 452/905] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Apr 11 13:42:55 2022] POST /identity/v3/services => generated 241 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:42:56.576771 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107d163-a18b-4f70-9e1d-23ff0269f53a None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:56.576771 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107d163-a18b-4f70-9e1d-23ff0269f53a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:56.576771 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107d163-a18b-4f70-9e1d-23ff0269f53a None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:56.577522 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 454/906] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:56.585010 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7428a-8537-4cdd-af52-cab6f327be2f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:56.585010 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7428a-8537-4cdd-af52-cab6f327be2f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:56.585010 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7428a-8537-4cdd-af52-cab6f327be2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:56.601184 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-6ec7428a-8537-4cdd-af52-cab6f327be2f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:56.602676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6ec7428a-8537-4cdd-af52-cab6f327be2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:56.675489 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 453/907] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:42:56.700722 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107d163-a18b-4f70-9e1d-23ff0269f53a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:56.701667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c898e-51e6-4c4f-99ab-1ec267abaeac None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:56.702008 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c898e-51e6-4c4f-99ab-1ec267abaeac None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:56.702233 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c898e-51e6-4c4f-99ab-1ec267abaeac None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:56.703868 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 454/908] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:42:56.708826 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64866e33-b9ee-4905-9daf-425ae6df3ac2 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:56.709114 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64866e33-b9ee-4905-9daf-425ae6df3ac2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:56.709387 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64866e33-b9ee-4905-9daf-425ae6df3ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:56.726074 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-64866e33-b9ee-4905-9daf-425ae6df3ac2 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:56.727261 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-64866e33-b9ee-4905-9daf-425ae6df3ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:56.794926 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 455/909] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:42:56.819202 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64866e33-b9ee-4905-9daf-425ae6df3ac2 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:56.825149 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107d163-a18b-4f70-9e1d-23ff0269f53a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:56.863972 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f264e69-7724-44ff-8c65-270f92e5bb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:56.865095 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f264e69-7724-44ff-8c65-270f92e5bb21 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:56.865380 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f264e69-7724-44ff-8c65-270f92e5bb21 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:56.865658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f264e69-7724-44ff-8c65-270f92e5bb21 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:56.866314 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f264e69-7724-44ff-8c65-270f92e5bb21 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:56.867716 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f264e69-7724-44ff-8c65-270f92e5bb21 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:56.879769 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-4f264e69-7724-44ff-8c65-270f92e5bb21 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 11 13:42:56.881286 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 455/910] 10.222.0.67 () {56 vars in 1132 bytes} [Mon Apr 11 13:42:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:56.882565 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f501a-0a7b-44a6-8680-936e5a378723 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:56.882852 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f501a-0a7b-44a6-8680-936e5a378723 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:56.883125 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f501a-0a7b-44a6-8680-936e5a378723 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:56.884571 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 456/911] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:56.888730 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f501a-0a7b-44a6-8680-936e5a378723 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:56.922790 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64866e33-b9ee-4905-9daf-425ae6df3ac2 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:56.956778 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b45e7-e490-4f1b-92b8-93a03ac09686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:56.957584 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b45e7-e490-4f1b-92b8-93a03ac09686 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:56.957866 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b45e7-e490-4f1b-92b8-93a03ac09686 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:56.958144 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b45e7-e490-4f1b-92b8-93a03ac09686 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:56.958800 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b45e7-e490-4f1b-92b8-93a03ac09686 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:56.960205 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b45e7-e490-4f1b-92b8-93a03ac09686 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:56.971023 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-c61b45e7-e490-4f1b-92b8-93a03ac09686 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 11 13:42:56.977237 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 456/912] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:42:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:56.977237 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b719ad-9050-41ad-bea7-5a19e2dea813 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:56.977237 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b719ad-9050-41ad-bea7-5a19e2dea813 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:56.977237 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b719ad-9050-41ad-bea7-5a19e2dea813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:56.988960 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f501a-0a7b-44a6-8680-936e5a378723 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:56.993236 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-80b719ad-9050-41ad-bea7-5a19e2dea813 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:56.994496 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-80b719ad-9050-41ad-bea7-5a19e2dea813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:57.022469 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b06cd-ed01-49c3-871c-21311c205acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:57.023159 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b06cd-ed01-49c3-871c-21311c205acf None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:57.023449 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b06cd-ed01-49c3-871c-21311c205acf None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:57.023753 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b06cd-ed01-49c3-871c-21311c205acf None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:57.024460 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b06cd-ed01-49c3-871c-21311c205acf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:57.024768 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b06cd-ed01-49c3-871c-21311c205acf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:57.026129 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b06cd-ed01-49c3-871c-21311c205acf None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:57.030763 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 457/913] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Apr 11 13:42:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:57.031546 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b06cd-ed01-49c3-871c-21311c205acf None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:57.062447 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 457/914] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:42:57.063273 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b719ad-9050-41ad-bea7-5a19e2dea813 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:57.136160 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b06cd-ed01-49c3-871c-21311c205acf None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:57.167936 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b719ad-9050-41ad-bea7-5a19e2dea813 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:57.168879 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a229a1-9b7f-4f89-b373-aa9220ec4b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:57.169543 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a229a1-9b7f-4f89-b373-aa9220ec4b98 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:57.169828 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a229a1-9b7f-4f89-b373-aa9220ec4b98 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:57.170107 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a229a1-9b7f-4f89-b373-aa9220ec4b98 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:57.170805 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a229a1-9b7f-4f89-b373-aa9220ec4b98 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:57.171110 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a229a1-9b7f-4f89-b373-aa9220ec4b98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:57.172499 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a229a1-9b7f-4f89-b373-aa9220ec4b98 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:57.182395 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 458/915] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:42:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:57.182395 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a229a1-9b7f-4f89-b373-aa9220ec4b98 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:57.207526 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68fe0c-2a54-4b79-b803-0a7c7b4c17b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:57.208197 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68fe0c-2a54-4b79-b803-0a7c7b4c17b0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:57.208484 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68fe0c-2a54-4b79-b803-0a7c7b4c17b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:57.208758 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68fe0c-2a54-4b79-b803-0a7c7b4c17b0 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:57.209469 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68fe0c-2a54-4b79-b803-0a7c7b4c17b0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:57.209774 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68fe0c-2a54-4b79-b803-0a7c7b4c17b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:57.211195 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68fe0c-2a54-4b79-b803-0a7c7b4c17b0 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:57.220708 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 458/916] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Apr 11 13:42:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:57.220708 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68fe0c-2a54-4b79-b803-0a7c7b4c17b0 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:57.273881 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a229a1-9b7f-4f89-b373-aa9220ec4b98 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:57.306405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e343f-5627-4bd4-bfbb-5de7664a99bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:57.307215 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e343f-5627-4bd4-bfbb-5de7664a99bd None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:57.307503 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e343f-5627-4bd4-bfbb-5de7664a99bd None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:57.307808 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e343f-5627-4bd4-bfbb-5de7664a99bd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:57.313031 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68fe0c-2a54-4b79-b803-0a7c7b4c17b0 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:57.318241 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e343f-5627-4bd4-bfbb-5de7664a99bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:42:57.325899 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-408e343f-5627-4bd4-bfbb-5de7664a99bd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 13:42:57.327102 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 459/917] 10.222.0.67 () {56 vars in 1120 bytes} [Mon Apr 11 13:42:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:57.328531 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e343f-5627-4bd4-bfbb-5de7664a99bd None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:57.351436 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66578e6-4854-44b4-9edf-9acf878a323e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:57.352138 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66578e6-4854-44b4-9edf-9acf878a323e None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:57.352422 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66578e6-4854-44b4-9edf-9acf878a323e None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:57.352697 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66578e6-4854-44b4-9edf-9acf878a323e None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:57.353399 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66578e6-4854-44b4-9edf-9acf878a323e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:57.353705 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66578e6-4854-44b4-9edf-9acf878a323e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:57.355068 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66578e6-4854-44b4-9edf-9acf878a323e None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:57.365095 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 459/918] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Apr 11 13:42:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:57.365095 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66578e6-4854-44b4-9edf-9acf878a323e None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:57.428748 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e343f-5627-4bd4-bfbb-5de7664a99bd None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:57.458830 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66578e6-4854-44b4-9edf-9acf878a323e None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:57.461642 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918a5da-f0cb-406c-b2e6-61c12c40613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:57.462294 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918a5da-f0cb-406c-b2e6-61c12c40613d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:57.462580 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918a5da-f0cb-406c-b2e6-61c12c40613d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:57.462876 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918a5da-f0cb-406c-b2e6-61c12c40613d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:57.463672 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918a5da-f0cb-406c-b2e6-61c12c40613d None admin] RBAC: Adding query filter params (interface=public, service_id=3ab6fa92503049dc87ab360996ec9da9, region_id=RegionOne) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:57.463993 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918a5da-f0cb-406c-b2e6-61c12c40613d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:57.465369 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918a5da-f0cb-406c-b2e6-61c12c40613d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:57.475081 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 460/919] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Apr 11 13:42:57 2022] GET /identity/v3/endpoints?service_id=3ab6fa92503049dc87ab360996ec9da9&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:57.475081 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918a5da-f0cb-406c-b2e6-61c12c40613d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:57.496137 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f661ea7-de79-443c-8dd9-c716bd4654ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:57.496803 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f661ea7-de79-443c-8dd9-c716bd4654ab None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:57.497085 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f661ea7-de79-443c-8dd9-c716bd4654ab None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:57.497359 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f661ea7-de79-443c-8dd9-c716bd4654ab None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:57.498103 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f661ea7-de79-443c-8dd9-c716bd4654ab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:57.498408 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f661ea7-de79-443c-8dd9-c716bd4654ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:57.499813 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f661ea7-de79-443c-8dd9-c716bd4654ab None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:57.513763 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 460/920] 10.222.0.67 () {56 vars in 1115 bytes} [Mon Apr 11 13:42:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:57.513763 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f661ea7-de79-443c-8dd9-c716bd4654ab None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:57.578925 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918a5da-f0cb-406c-b2e6-61c12c40613d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:57.613434 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93e65e-2a24-4862-b209-627dc1e7b180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:57.613628 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f661ea7-de79-443c-8dd9-c716bd4654ab None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:57.614099 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93e65e-2a24-4862-b209-627dc1e7b180 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:57.614385 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93e65e-2a24-4862-b209-627dc1e7b180 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:57.614663 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93e65e-2a24-4862-b209-627dc1e7b180 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:57.616336 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93e65e-2a24-4862-b209-627dc1e7b180 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:57.617732 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93e65e-2a24-4862-b209-627dc1e7b180 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:57.647666 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 461/921] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Apr 11 13:42:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:42:57.647666 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93e65e-2a24-4862-b209-627dc1e7b180 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:57.663664 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdd2c8-945a-4753-a8e2-b5bffd45e993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:57.664379 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdd2c8-945a-4753-a8e2-b5bffd45e993 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:57.664663 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdd2c8-945a-4753-a8e2-b5bffd45e993 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:57.664943 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdd2c8-945a-4753-a8e2-b5bffd45e993 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:57.665739 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bdd2c8-945a-4753-a8e2-b5bffd45e993 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:57.667261 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bdd2c8-945a-4753-a8e2-b5bffd45e993 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:57.680168 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 461/922] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Apr 11 13:42:57 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:42:57.755418 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93e65e-2a24-4862-b209-627dc1e7b180 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:57.794759 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a40b0-2e08-4b9a-84b4-a89f92ce14d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:57.795584 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a40b0-2e08-4b9a-84b4-a89f92ce14d0 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:57.795898 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a40b0-2e08-4b9a-84b4-a89f92ce14d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:57.796175 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a40b0-2e08-4b9a-84b4-a89f92ce14d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:57.808777 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a40b0-2e08-4b9a-84b4-a89f92ce14d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:57.810273 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a40b0-2e08-4b9a-84b4-a89f92ce14d0 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:57.828777 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-050a40b0-2e08-4b9a-84b4-a89f92ce14d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:57.830298 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 462/923] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:57.836589 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdd2c8-945a-4753-a8e2-b5bffd45e993 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:57.944013 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdd2c8-945a-4753-a8e2-b5bffd45e993 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:57.981987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258e4a7-8077-4c4d-b26e-fb89957b6716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:57.982667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258e4a7-8077-4c4d-b26e-fb89957b6716 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:57.982952 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258e4a7-8077-4c4d-b26e-fb89957b6716 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:57.983229 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258e4a7-8077-4c4d-b26e-fb89957b6716 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:57.984005 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258e4a7-8077-4c4d-b26e-fb89957b6716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:57.984311 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258e4a7-8077-4c4d-b26e-fb89957b6716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:57.985694 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258e4a7-8077-4c4d-b26e-fb89957b6716 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:57.998400 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 462/924] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:58.004706 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a40b0-2e08-4b9a-84b4-a89f92ce14d0 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:58.106576 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a40b0-2e08-4b9a-84b4-a89f92ce14d0 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:58.139818 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11028b3c-be42-4f71-8baa-bd9fa5288a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:58.140638 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11028b3c-be42-4f71-8baa-bd9fa5288a93 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:58.140920 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11028b3c-be42-4f71-8baa-bd9fa5288a93 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:58.141195 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11028b3c-be42-4f71-8baa-bd9fa5288a93 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:58.148953 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11028b3c-be42-4f71-8baa-bd9fa5288a93 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:58.150401 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11028b3c-be42-4f71-8baa-bd9fa5288a93 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:58.164845 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-11028b3c-be42-4f71-8baa-bd9fa5288a93 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 13:42:58.166326 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 463/925] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Apr 11 13:42:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:58.171926 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258e4a7-8077-4c4d-b26e-fb89957b6716 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:58.271457 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258e4a7-8077-4c4d-b26e-fb89957b6716 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:58.305630 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb85c9c-8551-4231-b1b7-ae3c0428357a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:58.306305 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb85c9c-8551-4231-b1b7-ae3c0428357a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:58.306589 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb85c9c-8551-4231-b1b7-ae3c0428357a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:58.306861 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb85c9c-8551-4231-b1b7-ae3c0428357a None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:58.307722 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb85c9c-8551-4231-b1b7-ae3c0428357a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:58.308032 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb85c9c-8551-4231-b1b7-ae3c0428357a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:58.309463 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb85c9c-8551-4231-b1b7-ae3c0428357a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:58.332042 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 463/926] 10.222.0.67 () {56 vars in 1149 bytes} [Mon Apr 11 13:42:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:42:58.334196 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11028b3c-be42-4f71-8baa-bd9fa5288a93 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:58.349929 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999fa46-57da-4a4d-95ae-aa58c3cde3bc None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:58.350195 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999fa46-57da-4a4d-95ae-aa58c3cde3bc None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:58.350478 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999fa46-57da-4a4d-95ae-aa58c3cde3bc None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:58.352103 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 464/927] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:42:58.359023 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648ac0f-11f5-4514-b9c2-065f17abc707 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:58.359247 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648ac0f-11f5-4514-b9c2-065f17abc707 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:58.359516 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648ac0f-11f5-4514-b9c2-065f17abc707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:58.379559 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-2648ac0f-11f5-4514-b9c2-065f17abc707 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:42:58.381105 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2648ac0f-11f5-4514-b9c2-065f17abc707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:42:58.461971 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11028b3c-be42-4f71-8baa-bd9fa5288a93 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:58.466430 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 465/928] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:42:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:42:58.490866 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648ac0f-11f5-4514-b9c2-065f17abc707 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:58.499888 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3e50c-9b66-4ec8-b46c-7765a2a76fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:58.501271 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3e50c-9b66-4ec8-b46c-7765a2a76fc9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:58.501699 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3e50c-9b66-4ec8-b46c-7765a2a76fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:58.502428 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3e50c-9b66-4ec8-b46c-7765a2a76fc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:58.516974 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3e50c-9b66-4ec8-b46c-7765a2a76fc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:58.519657 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3e50c-9b66-4ec8-b46c-7765a2a76fc9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:58.540846 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-37f3e50c-9b66-4ec8-b46c-7765a2a76fc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:42:58.542629 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 464/929] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:58.551676 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3e50c-9b66-4ec8-b46c-7765a2a76fc9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:58.597236 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648ac0f-11f5-4514-b9c2-065f17abc707 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:58.632595 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ef54b-f483-4568-b467-73bd70321950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:58.633458 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ef54b-f483-4568-b467-73bd70321950 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:58.633746 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ef54b-f483-4568-b467-73bd70321950 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:58.634020 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ef54b-f483-4568-b467-73bd70321950 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:58.634679 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ef54b-f483-4568-b467-73bd70321950 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:58.636102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ef54b-f483-4568-b467-73bd70321950 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:58.648108 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-485ef54b-f483-4568-b467-73bd70321950 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 13:42:58.651824 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3e50c-9b66-4ec8-b46c-7765a2a76fc9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:58.654327 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 466/930] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Apr 11 13:42:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:42:58.655563 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ef54b-f483-4568-b467-73bd70321950 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:58.693900 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6c52d-99b3-46d8-9409-d1b1e170a98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:58.694684 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6c52d-99b3-46d8-9409-d1b1e170a98b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:58.695035 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6c52d-99b3-46d8-9409-d1b1e170a98b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:58.695660 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6c52d-99b3-46d8-9409-d1b1e170a98b None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:58.696233 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6c52d-99b3-46d8-9409-d1b1e170a98b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:58.696612 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6c52d-99b3-46d8-9409-d1b1e170a98b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:58.698493 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6c52d-99b3-46d8-9409-d1b1e170a98b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:58.715005 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 465/931] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:58.716594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6c52d-99b3-46d8-9409-d1b1e170a98b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:58.762301 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ef54b-f483-4568-b467-73bd70321950 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:58.796843 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0586a87-6caa-485b-86a1-c697eb1881d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:58.797521 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0586a87-6caa-485b-86a1-c697eb1881d7 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:58.797863 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0586a87-6caa-485b-86a1-c697eb1881d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:58.798125 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0586a87-6caa-485b-86a1-c697eb1881d7 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:58.798849 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0586a87-6caa-485b-86a1-c697eb1881d7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:58.799159 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0586a87-6caa-485b-86a1-c697eb1881d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:58.801371 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0586a87-6caa-485b-86a1-c697eb1881d7 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:58.811318 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 467/932] 10.222.0.67 () {56 vars in 1122 bytes} [Mon Apr 11 13:42:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:58.812299 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0586a87-6caa-485b-86a1-c697eb1881d7 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:58.820441 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6c52d-99b3-46d8-9409-d1b1e170a98b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:58.855803 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2afed-dd54-4826-a5bb-6756db7d2556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:58.856968 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2afed-dd54-4826-a5bb-6756db7d2556 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:58.857453 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2afed-dd54-4826-a5bb-6756db7d2556 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:58.857961 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2afed-dd54-4826-a5bb-6756db7d2556 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:58.865810 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2afed-dd54-4826-a5bb-6756db7d2556 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:58.867683 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2afed-dd54-4826-a5bb-6756db7d2556 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:58.882037 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-f5d2afed-dd54-4826-a5bb-6756db7d2556 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:42:58.887931 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 466/933] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:42:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:42:58.889834 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2afed-dd54-4826-a5bb-6756db7d2556 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:58.918418 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0586a87-6caa-485b-86a1-c697eb1881d7 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:58.957771 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f53f6-587d-4521-8113-311c438fe901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:58.958618 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f53f6-587d-4521-8113-311c438fe901 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:58.958912 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f53f6-587d-4521-8113-311c438fe901 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:58.959190 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f53f6-587d-4521-8113-311c438fe901 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:58.959934 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f53f6-587d-4521-8113-311c438fe901 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:58.960243 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f53f6-587d-4521-8113-311c438fe901 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:58.961627 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f53f6-587d-4521-8113-311c438fe901 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:58.971820 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 468/934] 10.222.0.67 () {56 vars in 1122 bytes} [Mon Apr 11 13:42:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:58.973344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f53f6-587d-4521-8113-311c438fe901 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:58.995474 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2afed-dd54-4826-a5bb-6756db7d2556 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:59.030021 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565afd4-a9e9-47c2-a5ae-1507de2f537d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:59.030975 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565afd4-a9e9-47c2-a5ae-1507de2f537d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:59.031467 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565afd4-a9e9-47c2-a5ae-1507de2f537d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:59.032106 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565afd4-a9e9-47c2-a5ae-1507de2f537d None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:59.033099 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565afd4-a9e9-47c2-a5ae-1507de2f537d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:59.033609 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565afd4-a9e9-47c2-a5ae-1507de2f537d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:59.035598 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565afd4-a9e9-47c2-a5ae-1507de2f537d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:59.051768 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 467/935] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:42:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:59.055246 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565afd4-a9e9-47c2-a5ae-1507de2f537d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:59.077597 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f53f6-587d-4521-8113-311c438fe901 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:59.110888 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e138e5-659f-478c-afe0-94afc6fcd584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:59.111553 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e138e5-659f-478c-afe0-94afc6fcd584 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:59.111881 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e138e5-659f-478c-afe0-94afc6fcd584 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:59.112695 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e138e5-659f-478c-afe0-94afc6fcd584 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:59.113648 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e138e5-659f-478c-afe0-94afc6fcd584 None admin] RBAC: Adding query filter params (interface=public, service_id=6bbc311c87ae4d748301d3b3e912d7b6, region_id=RegionOne) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:42:59.113966 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e138e5-659f-478c-afe0-94afc6fcd584 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:59.115343 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e138e5-659f-478c-afe0-94afc6fcd584 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:59.125143 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 469/936] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Apr 11 13:42:58 2022] GET /identity/v3/endpoints?service_id=6bbc311c87ae4d748301d3b3e912d7b6&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:42:59.126531 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e138e5-659f-478c-afe0-94afc6fcd584 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:42:59.162064 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565afd4-a9e9-47c2-a5ae-1507de2f537d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:59.201725 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa21c78-ec68-4423-9f59-b2d5675ff1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:59.202876 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa21c78-ec68-4423-9f59-b2d5675ff1d2 None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:59.203154 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa21c78-ec68-4423-9f59-b2d5675ff1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:59.203427 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa21c78-ec68-4423-9f59-b2d5675ff1d2 None admin] PATH_INFO: `/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/920ed843195243f8abd6dfb2ebb3a549/roles/d761d545536542028c82c9ceb096b437` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:59.207313 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa21c78-ec68-4423-9f59-b2d5675ff1d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d46063ee60fd4f6dba86d1c5946e9381, user_id=920ed843195243f8abd6dfb2ebb3a549, role_id=d761d545536542028c82c9ceb096b437)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:59.208850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa21c78-ec68-4423-9f59-b2d5675ff1d2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:59.226459 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 468/937] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:42:59 2022] PUT /identity/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/920ed843195243f8abd6dfb2ebb3a549/roles/d761d545536542028c82c9ceb096b437 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:42:59.244984 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e138e5-659f-478c-afe0-94afc6fcd584 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:42:59.284188 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ebcb6-d2be-401d-b592-5bfd5f03679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:42:59.285078 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ebcb6-d2be-401d-b592-5bfd5f03679c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:42:59.285369 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ebcb6-d2be-401d-b592-5bfd5f03679c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:42:59.285644 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ebcb6-d2be-401d-b592-5bfd5f03679c None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:42:59.286391 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ebcb6-d2be-401d-b592-5bfd5f03679c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:42:59.288701 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ebcb6-d2be-401d-b592-5bfd5f03679c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:42:59.301171 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 470/938] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Apr 11 13:42:59 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:43:00.085738 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6bc4b-81ae-467b-a1ff-5a0a1f72b82f None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:00.086277 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6bc4b-81ae-467b-a1ff-5a0a1f72b82f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:00.086277 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6bc4b-81ae-467b-a1ff-5a0a1f72b82f None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:00.087866 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 469/939] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:00.093129 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdc708-9850-4e5b-89b3-3e99c6a7c05f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:00.093534 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdc708-9850-4e5b-89b3-3e99c6a7c05f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:00.093702 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdc708-9850-4e5b-89b3-3e99c6a7c05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:00.111079 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-debdc708-9850-4e5b-89b3-3e99c6a7c05f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:00.112976 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-debdc708-9850-4e5b-89b3-3e99c6a7c05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:00.155913 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420fa93-f2b5-4a98-b15c-129a6a27dd38 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:00.156206 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420fa93-f2b5-4a98-b15c-129a6a27dd38 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:00.156485 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420fa93-f2b5-4a98-b15c-129a6a27dd38 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:00.158102 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 470/940] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:43:00.163649 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ae577-ee2c-4e98-83c3-a1056b3a6a3b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:00.163948 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ae577-ee2c-4e98-83c3-a1056b3a6a3b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:00.164227 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ae577-ee2c-4e98-83c3-a1056b3a6a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:00.181827 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-3e9ae577-ee2c-4e98-83c3-a1056b3a6a3b None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:00.182029 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 471/941] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:00.183075 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3e9ae577-ee2c-4e98-83c3-a1056b3a6a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:00.207072 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdc708-9850-4e5b-89b3-3e99c6a7c05f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:00.251564 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 471/942] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:00.280703 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ae577-ee2c-4e98-83c3-a1056b3a6a3b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:00.309832 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdc708-9850-4e5b-89b3-3e99c6a7c05f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:00.346442 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f3a39-5b7f-423a-b35b-5d0c8e0b4b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:00.347163 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f3a39-5b7f-423a-b35b-5d0c8e0b4b15 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:00.347450 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f3a39-5b7f-423a-b35b-5d0c8e0b4b15 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:00.347754 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f3a39-5b7f-423a-b35b-5d0c8e0b4b15 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:00.348417 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f3a39-5b7f-423a-b35b-5d0c8e0b4b15 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:00.349800 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f3a39-5b7f-423a-b35b-5d0c8e0b4b15 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:00.361506 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-8a1f3a39-5b7f-423a-b35b-5d0c8e0b4b15 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 11 13:43:00.363273 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 472/943] 10.222.0.67 () {56 vars in 1132 bytes} [Mon Apr 11 13:43:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:00.372607 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f3a39-5b7f-423a-b35b-5d0c8e0b4b15 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:00.387402 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ae577-ee2c-4e98-83c3-a1056b3a6a3b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:00.437908 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ee773-547f-4b9c-b696-ccc008e78675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:00.439075 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ee773-547f-4b9c-b696-ccc008e78675 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:00.439376 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ee773-547f-4b9c-b696-ccc008e78675 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:00.439833 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ee773-547f-4b9c-b696-ccc008e78675 None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:00.441610 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ee773-547f-4b9c-b696-ccc008e78675 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:00.443867 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ee773-547f-4b9c-b696-ccc008e78675 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:00.445700 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.common [None req-574ee773-547f-4b9c-b696-ccc008e78675 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 11 13:43:00.467170 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.sql.core [None req-574ee773-547f-4b9c-b696-ccc008e78675 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 11 13:43:00.467170 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 11 13:43:00.467170 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [parameters: {'id': 'cfa8211cc16d45d7ad1faca61daf890c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 11 13:43:00.467170 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79785) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 11 13:43:00.487945 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-574ee773-547f-4b9c-b696-ccc008e78675 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cfa8211cc16d45d7ad1faca61daf890c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cfa8211cc16d45d7ad1faca61daf890c. Apr 11 13:43:00.488910 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f3a39-5b7f-423a-b35b-5d0c8e0b4b15 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:00.489476 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 472/944] 10.222.0.67 () {60 vars in 1140 bytes} [Mon Apr 11 13:43:00 2022] POST /identity/v3/projects => generated 262 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:43:00.496025 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ee773-547f-4b9c-b696-ccc008e78675 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:00.534860 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4fa61-c4f4-4fcd-916f-5177bf7854a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:00.535908 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4fa61-c4f4-4fcd-916f-5177bf7854a0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:00.536360 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4fa61-c4f4-4fcd-916f-5177bf7854a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:00.536640 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4fa61-c4f4-4fcd-916f-5177bf7854a0 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:00.538224 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4fa61-c4f4-4fcd-916f-5177bf7854a0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:00.538540 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4fa61-c4f4-4fcd-916f-5177bf7854a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:00.540026 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4fa61-c4f4-4fcd-916f-5177bf7854a0 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:00.546957 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 473/945] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Apr 11 13:43:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:00.556035 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4fa61-c4f4-4fcd-916f-5177bf7854a0 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:00.609517 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ee773-547f-4b9c-b696-ccc008e78675 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:00.647052 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071a851-e83c-44e3-a59f-c499250ebc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:00.648340 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071a851-e83c-44e3-a59f-c499250ebc3c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:00.648900 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071a851-e83c-44e3-a59f-c499250ebc3c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:00.649470 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071a851-e83c-44e3-a59f-c499250ebc3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:00.657049 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071a851-e83c-44e3-a59f-c499250ebc3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:00.659397 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071a851-e83c-44e3-a59f-c499250ebc3c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:00.672784 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-4071a851-e83c-44e3-a59f-c499250ebc3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:43:00.674377 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 473/946] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:43:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:00.676830 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4fa61-c4f4-4fcd-916f-5177bf7854a0 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:00.681307 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071a851-e83c-44e3-a59f-c499250ebc3c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:00.713106 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217dc902-ef4f-433b-867c-5dd485cbd552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:00.713789 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dc902-ef4f-433b-867c-5dd485cbd552 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:00.714235 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dc902-ef4f-433b-867c-5dd485cbd552 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:00.714513 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dc902-ef4f-433b-867c-5dd485cbd552 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:00.715709 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217dc902-ef4f-433b-867c-5dd485cbd552 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:00.716143 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217dc902-ef4f-433b-867c-5dd485cbd552 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:00.717980 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217dc902-ef4f-433b-867c-5dd485cbd552 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:00.725086 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 474/947] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Apr 11 13:43:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:00.730699 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217dc902-ef4f-433b-867c-5dd485cbd552 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:00.803527 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071a851-e83c-44e3-a59f-c499250ebc3c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:00.840554 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217dc902-ef4f-433b-867c-5dd485cbd552 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:00.849859 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710bd4b3-7fb8-4f74-b027-2839f0b41b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:00.850902 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bd4b3-7fb8-4f74-b027-2839f0b41b32 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:00.851188 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bd4b3-7fb8-4f74-b027-2839f0b41b32 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:00.851469 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bd4b3-7fb8-4f74-b027-2839f0b41b32 None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:00.852578 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710bd4b3-7fb8-4f74-b027-2839f0b41b32 None admin] RBAC: Adding query filter params (name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:00.853174 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710bd4b3-7fb8-4f74-b027-2839f0b41b32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:00.854789 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710bd4b3-7fb8-4f74-b027-2839f0b41b32 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:00.875470 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3877e-249c-4580-881d-174ab6a2913f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:00.876367 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3877e-249c-4580-881d-174ab6a2913f None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:00.876745 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3877e-249c-4580-881d-174ab6a2913f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:00.877117 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3877e-249c-4580-881d-174ab6a2913f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:00.877992 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3877e-249c-4580-881d-174ab6a2913f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:00.879459 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 474/948] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Apr 11 13:43:00 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:00.879580 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3877e-249c-4580-881d-174ab6a2913f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:00.907069 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 475/949] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Apr 11 13:43:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:43:01.625447 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707afa18-ab2d-4045-ada2-cabcbe105af8 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:01.626136 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707afa18-ab2d-4045-ada2-cabcbe105af8 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:01.626136 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707afa18-ab2d-4045-ada2-cabcbe105af8 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:01.628274 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 475/950] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:01.633662 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7869e-e621-451f-8514-0c84fd1f4a26 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:01.634277 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7869e-e621-451f-8514-0c84fd1f4a26 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:01.634277 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7869e-e621-451f-8514-0c84fd1f4a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:01.651349 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-35b7869e-e621-451f-8514-0c84fd1f4a26 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:01.652500 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-35b7869e-e621-451f-8514-0c84fd1f4a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:01.727572 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 476/951] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:01.752711 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707afa18-ab2d-4045-ada2-cabcbe105af8 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:01.767039 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1633bc8-a137-44d0-8dc6-48875032c177 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:01.767325 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1633bc8-a137-44d0-8dc6-48875032c177 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:01.767604 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1633bc8-a137-44d0-8dc6-48875032c177 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:01.769544 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 477/952] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:01.776484 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430e933-f7d1-4d42-a02a-a95b7fce1654 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:01.776775 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430e933-f7d1-4d42-a02a-a95b7fce1654 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:01.777057 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430e933-f7d1-4d42-a02a-a95b7fce1654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:01.794878 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-2430e933-f7d1-4d42-a02a-a95b7fce1654 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:01.796065 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2430e933-f7d1-4d42-a02a-a95b7fce1654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:01.879659 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 478/953] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:43:01.880177 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707afa18-ab2d-4045-ada2-cabcbe105af8 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:01.897260 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430e933-f7d1-4d42-a02a-a95b7fce1654 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:01.918747 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b974950-9043-4454-9634-3598f45e1a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:01.919892 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b974950-9043-4454-9634-3598f45e1a88 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:01.920445 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b974950-9043-4454-9634-3598f45e1a88 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:01.920730 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b974950-9043-4454-9634-3598f45e1a88 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:01.934263 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b974950-9043-4454-9634-3598f45e1a88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:43:01.942496 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-2b974950-9043-4454-9634-3598f45e1a88 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 13:43:01.944099 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 476/954] 10.222.0.67 () {56 vars in 1120 bytes} [Mon Apr 11 13:43:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:01.953453 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b974950-9043-4454-9634-3598f45e1a88 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:02.034809 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430e933-f7d1-4d42-a02a-a95b7fce1654 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:02.067411 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b974950-9043-4454-9634-3598f45e1a88 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:02.079990 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53629451-58ba-4fbd-9335-24de8f8fd4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:02.081439 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53629451-58ba-4fbd-9335-24de8f8fd4c3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:02.081930 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53629451-58ba-4fbd-9335-24de8f8fd4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:02.082576 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53629451-58ba-4fbd-9335-24de8f8fd4c3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:02.083863 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53629451-58ba-4fbd-9335-24de8f8fd4c3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:02.085849 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53629451-58ba-4fbd-9335-24de8f8fd4c3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:02.101118 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-53629451-58ba-4fbd-9335-24de8f8fd4c3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 13:43:02.103218 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b4781-bc3c-4b24-a996-f7297b0a1f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:02.103494 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 479/955] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Apr 11 13:43:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:02.108946 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b4781-bc3c-4b24-a996-f7297b0a1f50 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:02.109260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b4781-bc3c-4b24-a996-f7297b0a1f50 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:02.109523 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b4781-bc3c-4b24-a996-f7297b0a1f50 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:02.110314 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b4781-bc3c-4b24-a996-f7297b0a1f50 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:02.110628 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b4781-bc3c-4b24-a996-f7297b0a1f50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:02.112928 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b4781-bc3c-4b24-a996-f7297b0a1f50 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:02.113973 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53629451-58ba-4fbd-9335-24de8f8fd4c3 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:02.132167 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 477/956] 10.222.0.67 () {56 vars in 1115 bytes} [Mon Apr 11 13:43:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:02.133352 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b4781-bc3c-4b24-a996-f7297b0a1f50 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:02.235238 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b4781-bc3c-4b24-a996-f7297b0a1f50 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:02.246398 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53629451-58ba-4fbd-9335-24de8f8fd4c3 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:02.273028 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92331a07-92f5-4741-bf2c-bc6c1bcd2236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:02.274002 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92331a07-92f5-4741-bf2c-bc6c1bcd2236 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:02.274391 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92331a07-92f5-4741-bf2c-bc6c1bcd2236 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:02.274771 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92331a07-92f5-4741-bf2c-bc6c1bcd2236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:02.285702 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92331a07-92f5-4741-bf2c-bc6c1bcd2236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:02.288024 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92331a07-92f5-4741-bf2c-bc6c1bcd2236 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:02.289070 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c808e-4095-4ce1-a1e0-9d86f956fd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:02.290093 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c808e-4095-4ce1-a1e0-9d86f956fd24 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:02.290527 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c808e-4095-4ce1-a1e0-9d86f956fd24 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:02.291267 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c808e-4095-4ce1-a1e0-9d86f956fd24 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:02.292185 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c808e-4095-4ce1-a1e0-9d86f956fd24 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:02.292637 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c808e-4095-4ce1-a1e0-9d86f956fd24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:02.294135 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c808e-4095-4ce1-a1e0-9d86f956fd24 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:02.304767 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 480/957] 10.222.0.67 () {56 vars in 1122 bytes} [Mon Apr 11 13:43:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:02.305772 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c808e-4095-4ce1-a1e0-9d86f956fd24 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:02.306128 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-92331a07-92f5-4741-bf2c-bc6c1bcd2236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:43:02.307786 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 478/958] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:43:02.313936 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92331a07-92f5-4741-bf2c-bc6c1bcd2236 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:02.410722 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c808e-4095-4ce1-a1e0-9d86f956fd24 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:02.414156 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92331a07-92f5-4741-bf2c-bc6c1bcd2236 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:02.447385 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317989b-5cf9-4a59-ad5f-5ac080df0f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:02.448241 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317989b-5cf9-4a59-ad5f-5ac080df0f06 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:02.448650 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317989b-5cf9-4a59-ad5f-5ac080df0f06 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:02.449028 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317989b-5cf9-4a59-ad5f-5ac080df0f06 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:02.449944 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317989b-5cf9-4a59-ad5f-5ac080df0f06 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:02.450227 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b7638-9ef9-4d2a-8f41-6c7f1cddeb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:02.450438 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317989b-5cf9-4a59-ad5f-5ac080df0f06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:02.451202 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b7638-9ef9-4d2a-8f41-6c7f1cddeb69 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:02.451664 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b7638-9ef9-4d2a-8f41-6c7f1cddeb69 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:02.452080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b7638-9ef9-4d2a-8f41-6c7f1cddeb69 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:02.452189 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317989b-5cf9-4a59-ad5f-5ac080df0f06 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:02.453109 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b7638-9ef9-4d2a-8f41-6c7f1cddeb69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:02.453576 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b7638-9ef9-4d2a-8f41-6c7f1cddeb69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:02.455095 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b7638-9ef9-4d2a-8f41-6c7f1cddeb69 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:02.462512 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 481/959] 10.222.0.67 () {56 vars in 1122 bytes} [Mon Apr 11 13:43:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:02.463853 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317989b-5cf9-4a59-ad5f-5ac080df0f06 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:02.471774 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 479/960] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:02.474160 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b7638-9ef9-4d2a-8f41-6c7f1cddeb69 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:02.567578 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317989b-5cf9-4a59-ad5f-5ac080df0f06 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:02.574635 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b7638-9ef9-4d2a-8f41-6c7f1cddeb69 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:02.602217 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94b83e-f56c-4e21-b800-ce7e5e0e0228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:02.602955 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94b83e-f56c-4e21-b800-ce7e5e0e0228 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:02.603161 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94b83e-f56c-4e21-b800-ce7e5e0e0228 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:02.603443 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94b83e-f56c-4e21-b800-ce7e5e0e0228 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:02.604238 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94b83e-f56c-4e21-b800-ce7e5e0e0228 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:02.605618 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94b83e-f56c-4e21-b800-ce7e5e0e0228 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:02.611103 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fff002-6748-4138-b92d-1599175ec8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:02.612343 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fff002-6748-4138-b92d-1599175ec8db None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:02.612881 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fff002-6748-4138-b92d-1599175ec8db None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:02.613360 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fff002-6748-4138-b92d-1599175ec8db None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:02.621998 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fff002-6748-4138-b92d-1599175ec8db None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:02.623914 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fff002-6748-4138-b92d-1599175ec8db None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:02.631722 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 482/961] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Apr 11 13:43:02 2022] POST /identity/v3/endpoints => generated 349 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:43:02.645140 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-25fff002-6748-4138-b92d-1599175ec8db None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 13:43:02.647466 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 480/962] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Apr 11 13:43:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:02.653528 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94b83e-f56c-4e21-b800-ce7e5e0e0228 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:02.769325 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94b83e-f56c-4e21-b800-ce7e5e0e0228 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:02.806896 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d35d73-5b7c-4dc0-a8a7-32c440c3ffc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:02.808023 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d35d73-5b7c-4dc0-a8a7-32c440c3ffc9 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:02.808508 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d35d73-5b7c-4dc0-a8a7-32c440c3ffc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:02.808976 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d35d73-5b7c-4dc0-a8a7-32c440c3ffc9 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:02.810026 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d35d73-5b7c-4dc0-a8a7-32c440c3ffc9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:02.810535 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d35d73-5b7c-4dc0-a8a7-32c440c3ffc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:02.812313 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d35d73-5b7c-4dc0-a8a7-32c440c3ffc9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:02.832527 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 483/963] 10.222.0.67 () {56 vars in 1149 bytes} [Mon Apr 11 13:43:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:02.838378 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fff002-6748-4138-b92d-1599175ec8db None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:02.942870 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fff002-6748-4138-b92d-1599175ec8db None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:02.981837 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9aad3a-3aab-4096-9fe2-32b89073b24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:02.982492 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9aad3a-3aab-4096-9fe2-32b89073b24e None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:02.982775 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9aad3a-3aab-4096-9fe2-32b89073b24e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:02.983048 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9aad3a-3aab-4096-9fe2-32b89073b24e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:03.053765 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9aad3a-3aab-4096-9fe2-32b89073b24e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:03.055687 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9aad3a-3aab-4096-9fe2-32b89073b24e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:03.158111 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 481/964] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:43:02 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:43:03.163793 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d35d73-5b7c-4dc0-a8a7-32c440c3ffc9 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:03.262971 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d35d73-5b7c-4dc0-a8a7-32c440c3ffc9 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:03.297515 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94068f79-2cc9-47bd-ba2e-870a594051f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:03.298333 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c13ec-1470-47c7-8589-62f199111e1f None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:03.298622 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c13ec-1470-47c7-8589-62f199111e1f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:03.298902 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c13ec-1470-47c7-8589-62f199111e1f None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:03.299374 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94068f79-2cc9-47bd-ba2e-870a594051f4 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:03.299894 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94068f79-2cc9-47bd-ba2e-870a594051f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:03.300364 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94068f79-2cc9-47bd-ba2e-870a594051f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:03.300619 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 482/965] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:03.305534 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfefe6a-2088-4f48-9003-a9c00f8c86c0 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:03.305819 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfefe6a-2088-4f48-9003-a9c00f8c86c0 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:03.306095 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfefe6a-2088-4f48-9003-a9c00f8c86c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:03.311928 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94068f79-2cc9-47bd-ba2e-870a594051f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:03.313395 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94068f79-2cc9-47bd-ba2e-870a594051f4 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:03.323952 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-dbfefe6a-2088-4f48-9003-a9c00f8c86c0 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:03.325459 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-dbfefe6a-2088-4f48-9003-a9c00f8c86c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:03.332639 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-94068f79-2cc9-47bd-ba2e-870a594051f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:43:03.334136 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 484/966] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:03.335378 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa20716-f757-48f0-ab8a-9d732de668e3 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:03.335886 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa20716-f757-48f0-ab8a-9d732de668e3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:03.336020 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa20716-f757-48f0-ab8a-9d732de668e3 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:03.337377 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 485/967] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:03.341380 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa20716-f757-48f0-ab8a-9d732de668e3 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:03.404153 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 483/968] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:03.405687 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863848c7-4d20-4ef4-8fa9-dac9fabb3abb None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:03.406185 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863848c7-4d20-4ef4-8fa9-dac9fabb3abb None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:03.406656 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863848c7-4d20-4ef4-8fa9-dac9fabb3abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:03.425354 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-863848c7-4d20-4ef4-8fa9-dac9fabb3abb None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:03.426499 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-863848c7-4d20-4ef4-8fa9-dac9fabb3abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:03.451218 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa20716-f757-48f0-ab8a-9d732de668e3 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:03.485021 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7affde-1864-4026-85fd-fc71931d1162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:03.485712 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7affde-1864-4026-85fd-fc71931d1162 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:03.485995 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7affde-1864-4026-85fd-fc71931d1162 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:03.486268 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7affde-1864-4026-85fd-fc71931d1162 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:03.487657 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7affde-1864-4026-85fd-fc71931d1162 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:03.487972 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7affde-1864-4026-85fd-fc71931d1162 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:03.489343 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7affde-1864-4026-85fd-fc71931d1162 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:03.492561 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 484/969] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:03.496711 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863848c7-4d20-4ef4-8fa9-dac9fabb3abb None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:03.505664 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 486/970] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:03.506824 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7affde-1864-4026-85fd-fc71931d1162 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:03.598459 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863848c7-4d20-4ef4-8fa9-dac9fabb3abb None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:03.613610 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7affde-1864-4026-85fd-fc71931d1162 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:03.633205 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5eee1f-4b79-426c-95dc-94d31d66bbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:03.634014 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eee1f-4b79-426c-95dc-94d31d66bbf4 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:03.634290 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eee1f-4b79-426c-95dc-94d31d66bbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:03.634529 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5eee1f-4b79-426c-95dc-94d31d66bbf4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:03.635166 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5eee1f-4b79-426c-95dc-94d31d66bbf4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:03.636574 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5eee1f-4b79-426c-95dc-94d31d66bbf4 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:03.646690 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80435545-95da-4b11-a5c2-528dc2dde00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:03.647487 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80435545-95da-4b11-a5c2-528dc2dde00d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:03.647797 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80435545-95da-4b11-a5c2-528dc2dde00d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:03.648073 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80435545-95da-4b11-a5c2-528dc2dde00d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:03.648175 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-ce5eee1f-4b79-426c-95dc-94d31d66bbf4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 11 13:43:03.655405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 485/971] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:43:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:03.655405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5eee1f-4b79-426c-95dc-94d31d66bbf4 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:03.661064 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80435545-95da-4b11-a5c2-528dc2dde00d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:03.662524 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80435545-95da-4b11-a5c2-528dc2dde00d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:03.676632 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-80435545-95da-4b11-a5c2-528dc2dde00d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:43:03.682620 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 487/972] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:43:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:03.682620 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80435545-95da-4b11-a5c2-528dc2dde00d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:03.749717 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5eee1f-4b79-426c-95dc-94d31d66bbf4 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:03.778580 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80435545-95da-4b11-a5c2-528dc2dde00d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:03.783467 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d4961-d86c-41e6-a7a8-034c4113f806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:03.784850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d4961-d86c-41e6-a7a8-034c4113f806 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:03.785292 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d4961-d86c-41e6-a7a8-034c4113f806 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:03.785707 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d4961-d86c-41e6-a7a8-034c4113f806 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:03.786575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d4961-d86c-41e6-a7a8-034c4113f806 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:03.788034 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d4961-d86c-41e6-a7a8-034c4113f806 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:03.801097 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.sql.core [None req-9c1d4961-d86c-41e6-a7a8-034c4113f806 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 11 13:43:03.801097 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 11 13:43:03.801097 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [parameters: {'user_id': '12bc17f22da24d67a314d514534fbae7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 11 13:43:03.801097 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79785) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 11 13:43:03.807037 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-9c1d4961-d86c-41e6-a7a8-034c4113f806 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 11 13:43:03.813017 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 486/973] 10.222.0.67 () {60 vars in 1131 bytes} [Mon Apr 11 13:43:03 2022] POST /identity/v3/users => generated 160 bytes in 159 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:03.813017 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d4961-d86c-41e6-a7a8-034c4113f806 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:03.817744 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfc507-90aa-49b9-88ac-606d1ae0e305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:03.818410 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfc507-90aa-49b9-88ac-606d1ae0e305 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:03.818690 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfc507-90aa-49b9-88ac-606d1ae0e305 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:03.818959 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfc507-90aa-49b9-88ac-606d1ae0e305 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:03.819682 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfc507-90aa-49b9-88ac-606d1ae0e305 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:03.819987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfc507-90aa-49b9-88ac-606d1ae0e305 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:03.821350 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfc507-90aa-49b9-88ac-606d1ae0e305 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:03.832808 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 488/974] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Apr 11 13:43:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:03.832808 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfc507-90aa-49b9-88ac-606d1ae0e305 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:03.920316 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d4961-d86c-41e6-a7a8-034c4113f806 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:03.932009 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfc507-90aa-49b9-88ac-606d1ae0e305 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:03.953210 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e3a28-cf82-4459-adde-0c8fb349dbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:03.953868 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e3a28-cf82-4459-adde-0c8fb349dbd7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:03.954146 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e3a28-cf82-4459-adde-0c8fb349dbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:03.954671 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e3a28-cf82-4459-adde-0c8fb349dbd7 None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:03.955181 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e3a28-cf82-4459-adde-0c8fb349dbd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:03.956216 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e3a28-cf82-4459-adde-0c8fb349dbd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:03.957875 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630e3a28-cf82-4459-adde-0c8fb349dbd7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:03.965710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad81b9-1391-4aa1-96a8-e04bff6d5688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:03.966504 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad81b9-1391-4aa1-96a8-e04bff6d5688 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:03.966791 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad81b9-1391-4aa1-96a8-e04bff6d5688 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:03.967066 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad81b9-1391-4aa1-96a8-e04bff6d5688 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:03.978966 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 487/975] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:43:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:03.979128 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad81b9-1391-4aa1-96a8-e04bff6d5688 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:03.979254 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e3a28-cf82-4459-adde-0c8fb349dbd7 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:03.979348 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad81b9-1391-4aa1-96a8-e04bff6d5688 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:03.994026 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-1aad81b9-1391-4aa1-96a8-e04bff6d5688 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 11 13:43:04.000041 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 489/976] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:43:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:04.000041 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad81b9-1391-4aa1-96a8-e04bff6d5688 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:04.080239 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630e3a28-cf82-4459-adde-0c8fb349dbd7 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:04.092126 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad81b9-1391-4aa1-96a8-e04bff6d5688 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:04.113624 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d1f63-3684-4614-bf44-63a1cbaf640d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:04.114282 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d1f63-3684-4614-bf44-63a1cbaf640d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:04.114558 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d1f63-3684-4614-bf44-63a1cbaf640d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:04.114887 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d1f63-3684-4614-bf44-63a1cbaf640d None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:04.115515 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d1f63-3684-4614-bf44-63a1cbaf640d None admin] RBAC: Adding query filter params (type=compute) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:04.115842 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d1f63-3684-4614-bf44-63a1cbaf640d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:04.117211 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d1f63-3684-4614-bf44-63a1cbaf640d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:04.121545 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 488/977] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Apr 11 13:43:03 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:04.122266 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d1f63-3684-4614-bf44-63a1cbaf640d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:04.135507 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a29fd6-cb01-4376-88b7-0d94fb4f87a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:04.136307 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a29fd6-cb01-4376-88b7-0d94fb4f87a9 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:04.136681 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a29fd6-cb01-4376-88b7-0d94fb4f87a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:04.137027 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a29fd6-cb01-4376-88b7-0d94fb4f87a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:04.137958 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a29fd6-cb01-4376-88b7-0d94fb4f87a9 None admin] RBAC: Adding query filter params (role.id=d761d545536542028c82c9ceb096b437, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=920ed843195243f8abd6dfb2ebb3a549) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:04.138341 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a29fd6-cb01-4376-88b7-0d94fb4f87a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:04.139936 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a29fd6-cb01-4376-88b7-0d94fb4f87a9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:04.156182 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 490/978] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:43:03 2022] GET /identity/v3/role_assignments?user.id=920ed843195243f8abd6dfb2ebb3a549&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=d761d545536542028c82c9ceb096b437 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:04.250019 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d1f63-3684-4614-bf44-63a1cbaf640d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:04.289130 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db5a9e-e52f-4b7c-a3f0-369f57628801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:04.289955 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db5a9e-e52f-4b7c-a3f0-369f57628801 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:04.290243 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db5a9e-e52f-4b7c-a3f0-369f57628801 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:04.290522 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db5a9e-e52f-4b7c-a3f0-369f57628801 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:04.291359 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db5a9e-e52f-4b7c-a3f0-369f57628801 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:04.291697 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db5a9e-e52f-4b7c-a3f0-369f57628801 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:04.293199 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db5a9e-e52f-4b7c-a3f0-369f57628801 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:04.334458 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 489/979] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Apr 11 13:43:04 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:05.099753 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7d8fb-6358-4f2a-8f1d-0491c101eaf9 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:05.100270 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7d8fb-6358-4f2a-8f1d-0491c101eaf9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:05.100348 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7d8fb-6358-4f2a-8f1d-0491c101eaf9 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:05.101704 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 491/980] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:05.107070 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab668b92-0dc5-45d3-8fcc-84f7dd536e2d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:05.107502 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab668b92-0dc5-45d3-8fcc-84f7dd536e2d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:05.107672 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab668b92-0dc5-45d3-8fcc-84f7dd536e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:05.124322 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-ab668b92-0dc5-45d3-8fcc-84f7dd536e2d None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:05.125959 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ab668b92-0dc5-45d3-8fcc-84f7dd536e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:05.189891 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 490/981] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:05.214046 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7d8fb-6358-4f2a-8f1d-0491c101eaf9 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:05.312369 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7d8fb-6358-4f2a-8f1d-0491c101eaf9 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:05.349548 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6dcb52-a37f-460d-b0e3-ad1a2f0ee674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:05.350425 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dcb52-a37f-460d-b0e3-ad1a2f0ee674 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:05.350654 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dcb52-a37f-460d-b0e3-ad1a2f0ee674 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:05.350932 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dcb52-a37f-460d-b0e3-ad1a2f0ee674 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:05.351587 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6dcb52-a37f-460d-b0e3-ad1a2f0ee674 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:05.352992 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6dcb52-a37f-460d-b0e3-ad1a2f0ee674 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:05.364733 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-af6dcb52-a37f-460d-b0e3-ad1a2f0ee674 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 13:43:05.366118 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 492/982] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Apr 11 13:43:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:05.371761 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab668b92-0dc5-45d3-8fcc-84f7dd536e2d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:05.472444 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab668b92-0dc5-45d3-8fcc-84f7dd536e2d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:05.504724 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae67aa6-896a-4933-9282-9bff38194e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:05.505387 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae67aa6-896a-4933-9282-9bff38194e75 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:05.505669 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae67aa6-896a-4933-9282-9bff38194e75 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:05.505945 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae67aa6-896a-4933-9282-9bff38194e75 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:05.506648 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae67aa6-896a-4933-9282-9bff38194e75 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:05.506955 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae67aa6-896a-4933-9282-9bff38194e75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:05.508354 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae67aa6-896a-4933-9282-9bff38194e75 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:05.513080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 491/983] 10.222.0.67 () {56 vars in 1122 bytes} [Mon Apr 11 13:43:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:05.519260 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6dcb52-a37f-460d-b0e3-ad1a2f0ee674 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:05.613116 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6dcb52-a37f-460d-b0e3-ad1a2f0ee674 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:05.645516 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c48c5-6c05-492b-9ee4-169c8fc2c313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:05.646180 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c48c5-6c05-492b-9ee4-169c8fc2c313 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:05.646455 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c48c5-6c05-492b-9ee4-169c8fc2c313 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:05.646735 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c48c5-6c05-492b-9ee4-169c8fc2c313 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:05.647452 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c48c5-6c05-492b-9ee4-169c8fc2c313 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:05.647796 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c48c5-6c05-492b-9ee4-169c8fc2c313 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:05.649170 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c48c5-6c05-492b-9ee4-169c8fc2c313 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:05.659063 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 493/984] 10.222.0.67 () {56 vars in 1122 bytes} [Mon Apr 11 13:43:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:05.660152 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae67aa6-896a-4933-9282-9bff38194e75 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:05.759692 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae67aa6-896a-4933-9282-9bff38194e75 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:05.792304 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ee93f-29ab-490e-9075-0d948288c2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:05.792972 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ee93f-29ab-490e-9075-0d948288c2a8 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:05.793256 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ee93f-29ab-490e-9075-0d948288c2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:05.793531 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ee93f-29ab-490e-9075-0d948288c2a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:05.794327 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ee93f-29ab-490e-9075-0d948288c2a8 None admin] RBAC: Adding query filter params (interface=admin, service_id=6bbc311c87ae4d748301d3b3e912d7b6, region_id=RegionOne) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:05.794642 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ee93f-29ab-490e-9075-0d948288c2a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:05.796035 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ee93f-29ab-490e-9075-0d948288c2a8 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:05.805395 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 492/985] 10.222.0.67 () {56 vars in 1249 bytes} [Mon Apr 11 13:43:05 2022] GET /identity/v3/endpoints?service_id=6bbc311c87ae4d748301d3b3e912d7b6&interface=admin®ion_id=RegionOne => generated 193 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:05.806539 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c48c5-6c05-492b-9ee4-169c8fc2c313 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:05.910812 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c48c5-6c05-492b-9ee4-169c8fc2c313 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:05.950792 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11189c8-d1de-4567-8140-817a1df3b53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:05.951465 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11189c8-d1de-4567-8140-817a1df3b53d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:05.951782 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11189c8-d1de-4567-8140-817a1df3b53d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:05.952061 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11189c8-d1de-4567-8140-817a1df3b53d None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:05.952752 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11189c8-d1de-4567-8140-817a1df3b53d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:05.954132 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11189c8-d1de-4567-8140-817a1df3b53d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:05.967829 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 494/986] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Apr 11 13:43:05 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:43:06.496236 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7afbac-4c5a-4718-bce8-62a84b240697 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:06.496745 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7afbac-4c5a-4718-bce8-62a84b240697 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:06.496854 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7afbac-4c5a-4718-bce8-62a84b240697 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:06.498309 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 493/987] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:06.503753 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d0997-ad6a-42b4-97d3-f7eda6617987 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:06.504135 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d0997-ad6a-42b4-97d3-f7eda6617987 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:06.504322 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d0997-ad6a-42b4-97d3-f7eda6617987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:06.513485 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f3689-64e1-411c-a1c8-e3c31b7ba714 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:06.513775 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f3689-64e1-411c-a1c8-e3c31b7ba714 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:06.514096 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f3689-64e1-411c-a1c8-e3c31b7ba714 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:06.515535 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 494/988] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:43:06.520745 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173ee40-20ce-4f0d-8a20-77f6c96d79c1 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:06.521026 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173ee40-20ce-4f0d-8a20-77f6c96d79c1 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:06.521306 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173ee40-20ce-4f0d-8a20-77f6c96d79c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:06.521410 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-f24d0997-ad6a-42b4-97d3-f7eda6617987 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:06.522616 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f24d0997-ad6a-42b4-97d3-f7eda6617987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:06.537800 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-9173ee40-20ce-4f0d-8a20-77f6c96d79c1 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:06.538981 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9173ee40-20ce-4f0d-8a20-77f6c96d79c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:06.588887 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 495/989] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:06.605336 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 495/990] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:43:06.612742 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d0997-ad6a-42b4-97d3-f7eda6617987 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:06.628307 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173ee40-20ce-4f0d-8a20-77f6c96d79c1 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:06.708995 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d0997-ad6a-42b4-97d3-f7eda6617987 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:06.723431 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173ee40-20ce-4f0d-8a20-77f6c96d79c1 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:06.741446 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55751c-ff3d-4aee-bd91-b2bbd9f23abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:06.742108 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55751c-ff3d-4aee-bd91-b2bbd9f23abe None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:06.742386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55751c-ff3d-4aee-bd91-b2bbd9f23abe None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:06.742656 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55751c-ff3d-4aee-bd91-b2bbd9f23abe None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:06.743382 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55751c-ff3d-4aee-bd91-b2bbd9f23abe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:06.744768 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55751c-ff3d-4aee-bd91-b2bbd9f23abe None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:06.756693 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192dadb-0040-440e-bdce-f555fd6250ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:06.757465 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192dadb-0040-440e-bdce-f555fd6250ed None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:06.757740 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192dadb-0040-440e-bdce-f555fd6250ed None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:06.758868 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192dadb-0040-440e-bdce-f555fd6250ed None admin] PATH_INFO: `/v3/services/image` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:06.758997 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 496/991] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Apr 11 13:43:06 2022] POST /identity/v3/services => generated 242 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:43:06.759075 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192dadb-0040-440e-bdce-f555fd6250ed None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:06.760027 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192dadb-0040-440e-bdce-f555fd6250ed None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:06.772059 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-3192dadb-0040-440e-bdce-f555fd6250ed None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 11 13:43:06.775670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 496/992] 10.222.0.67 () {56 vars in 1105 bytes} [Mon Apr 11 13:43:06 2022] GET /identity/v3/services/image => generated 86 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:43:06.781224 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55751c-ff3d-4aee-bd91-b2bbd9f23abe None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:06.891791 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55751c-ff3d-4aee-bd91-b2bbd9f23abe None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:06.927288 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1118f-85ef-4e99-8a1e-5c75d93b819a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:06.928026 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1118f-85ef-4e99-8a1e-5c75d93b819a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:06.928312 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1118f-85ef-4e99-8a1e-5c75d93b819a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:06.928590 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1118f-85ef-4e99-8a1e-5c75d93b819a None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:06.929314 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1118f-85ef-4e99-8a1e-5c75d93b819a None admin] RBAC: Adding query filter params (name=image) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:06.929622 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1118f-85ef-4e99-8a1e-5c75d93b819a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:06.931020 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1118f-85ef-4e99-8a1e-5c75d93b819a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:06.942283 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 497/993] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:43:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:06.943363 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192dadb-0040-440e-bdce-f555fd6250ed None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:07.043506 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192dadb-0040-440e-bdce-f555fd6250ed None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:07.076700 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b7361-a306-491a-9c8f-f2c8a024974c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:07.077707 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b7361-a306-491a-9c8f-f2c8a024974c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:07.078138 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b7361-a306-491a-9c8f-f2c8a024974c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:07.078570 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b7361-a306-491a-9c8f-f2c8a024974c None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:07.079420 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b7361-a306-491a-9c8f-f2c8a024974c None admin] RBAC: Adding query filter params (type=image) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:07.079905 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b7361-a306-491a-9c8f-f2c8a024974c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:07.081979 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b7361-a306-491a-9c8f-f2c8a024974c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:07.087350 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 497/994] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:43:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:08.281021 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9a018-81cc-4575-be98-55c93556cd7b None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:08.281538 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9a018-81cc-4575-be98-55c93556cd7b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:08.281650 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9a018-81cc-4575-be98-55c93556cd7b None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:08.283087 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 498/995] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:08.288073 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d1657-e1e7-40c0-8ca2-77e2a4b687ed None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:08.288482 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d1657-e1e7-40c0-8ca2-77e2a4b687ed None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:08.288639 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d1657-e1e7-40c0-8ca2-77e2a4b687ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:08.305181 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a56d1657-e1e7-40c0-8ca2-77e2a4b687ed None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:08.306349 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a56d1657-e1e7-40c0-8ca2-77e2a4b687ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:08.372359 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 498/996] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:08.396668 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9a018-81cc-4575-be98-55c93556cd7b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:08.493300 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9a018-81cc-4575-be98-55c93556cd7b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:08.524491 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9ab3d-a32c-423d-a27c-7c31d5b45ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:08.525320 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9ab3d-a32c-423d-a27c-7c31d5b45ab8 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:08.525604 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9ab3d-a32c-423d-a27c-7c31d5b45ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:08.525878 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9ab3d-a32c-423d-a27c-7c31d5b45ab8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:08.526522 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9ab3d-a32c-423d-a27c-7c31d5b45ab8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:08.527916 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9ab3d-a32c-423d-a27c-7c31d5b45ab8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:08.539621 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-e1f9ab3d-a32c-423d-a27c-7c31d5b45ab8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 13:43:08.545611 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 499/997] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Apr 11 13:43:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:08.546850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d1657-e1e7-40c0-8ca2-77e2a4b687ed None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:08.641486 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d1657-e1e7-40c0-8ca2-77e2a4b687ed None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:08.674776 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39b2c9-1d2e-4631-ab1b-44fce9787e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:08.675442 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39b2c9-1d2e-4631-ab1b-44fce9787e35 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:08.675755 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39b2c9-1d2e-4631-ab1b-44fce9787e35 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:08.676036 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39b2c9-1d2e-4631-ab1b-44fce9787e35 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:08.676744 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39b2c9-1d2e-4631-ab1b-44fce9787e35 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:08.677052 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39b2c9-1d2e-4631-ab1b-44fce9787e35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:08.678430 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39b2c9-1d2e-4631-ab1b-44fce9787e35 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:08.687853 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 499/998] 10.222.0.67 () {56 vars in 1122 bytes} [Mon Apr 11 13:43:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:08.689069 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9ab3d-a32c-423d-a27c-7c31d5b45ab8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:08.788821 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9ab3d-a32c-423d-a27c-7c31d5b45ab8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:08.821517 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee496bff-d372-45f6-9847-2231e4adac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:08.822107 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee496bff-d372-45f6-9847-2231e4adac69 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:08.822390 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee496bff-d372-45f6-9847-2231e4adac69 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:08.822669 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee496bff-d372-45f6-9847-2231e4adac69 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:08.823371 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee496bff-d372-45f6-9847-2231e4adac69 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:08.823706 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee496bff-d372-45f6-9847-2231e4adac69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:08.825166 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee496bff-d372-45f6-9847-2231e4adac69 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:08.830506 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 500/999] 10.222.0.67 () {56 vars in 1122 bytes} [Mon Apr 11 13:43:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:08.835923 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39b2c9-1d2e-4631-ab1b-44fce9787e35 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:08.931980 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39b2c9-1d2e-4631-ab1b-44fce9787e35 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:08.964597 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747758bb-5210-49da-953c-ef65b1a6e999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:08.965261 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747758bb-5210-49da-953c-ef65b1a6e999 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:08.965544 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747758bb-5210-49da-953c-ef65b1a6e999 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:08.965821 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747758bb-5210-49da-953c-ef65b1a6e999 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:08.966565 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747758bb-5210-49da-953c-ef65b1a6e999 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:08.967967 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747758bb-5210-49da-953c-ef65b1a6e999 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:08.984476 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 500/1000] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Apr 11 13:43:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:43:09.105927 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af175c0-2755-40ea-a484-d272a7f60474 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:09.106118 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af175c0-2755-40ea-a484-d272a7f60474 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:09.106393 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af175c0-2755-40ea-a484-d272a7f60474 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:09.107844 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 501/1001] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:09.113490 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9972e7a-a92d-466f-a183-53ef6195cf1a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:09.113767 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9972e7a-a92d-466f-a183-53ef6195cf1a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:09.114043 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9972e7a-a92d-466f-a183-53ef6195cf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:09.131591 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-f9972e7a-a92d-466f-a183-53ef6195cf1a None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:09.132828 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f9972e7a-a92d-466f-a183-53ef6195cf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:09.208316 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 501/1002] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:09 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:09.232315 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af175c0-2755-40ea-a484-d272a7f60474 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:09.333465 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af175c0-2755-40ea-a484-d272a7f60474 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:09.365371 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92510ca7-87f6-4258-bd52-85e3ff84aaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:09.366102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92510ca7-87f6-4258-bd52-85e3ff84aaf5 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:09.366381 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92510ca7-87f6-4258-bd52-85e3ff84aaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:09.366652 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92510ca7-87f6-4258-bd52-85e3ff84aaf5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:09.367301 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92510ca7-87f6-4258-bd52-85e3ff84aaf5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:09.368747 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92510ca7-87f6-4258-bd52-85e3ff84aaf5 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:09.380816 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-92510ca7-87f6-4258-bd52-85e3ff84aaf5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 11 13:43:09.386336 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 502/1003] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:43:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:09.387769 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9972e7a-a92d-466f-a183-53ef6195cf1a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:09.445661 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da244116-147c-44e4-98c2-a0b9305071a9 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:09.446194 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da244116-147c-44e4-98c2-a0b9305071a9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:09.446483 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da244116-147c-44e4-98c2-a0b9305071a9 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:09.451460 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 503/1004] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:43:09.452952 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433a30e-cc62-40d2-8ade-ba47b259b946 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:09.453241 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433a30e-cc62-40d2-8ade-ba47b259b946 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:09.453516 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433a30e-cc62-40d2-8ade-ba47b259b946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:09.471715 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0433a30e-cc62-40d2-8ade-ba47b259b946 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:09.472931 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0433a30e-cc62-40d2-8ade-ba47b259b946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:09.486119 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9972e7a-a92d-466f-a183-53ef6195cf1a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:09.519549 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c38fd-cd88-4fad-970c-3c4d13d53cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:09.520185 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c38fd-cd88-4fad-970c-3c4d13d53cec None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:09.520654 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c38fd-cd88-4fad-970c-3c4d13d53cec None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:09.520760 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c38fd-cd88-4fad-970c-3c4d13d53cec None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:09.521440 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c38fd-cd88-4fad-970c-3c4d13d53cec None admin] RBAC: Adding query filter params (name=compute) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:09.521725 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c38fd-cd88-4fad-970c-3c4d13d53cec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:09.523080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c38fd-cd88-4fad-970c-3c4d13d53cec None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:09.527819 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 502/1005] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Apr 11 13:43:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:09.533337 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c38fd-cd88-4fad-970c-3c4d13d53cec None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:09.540369 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 504/1006] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:09 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:09.566227 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433a30e-cc62-40d2-8ade-ba47b259b946 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:09.631189 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c38fd-cd88-4fad-970c-3c4d13d53cec None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:09.662065 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433a30e-cc62-40d2-8ade-ba47b259b946 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:09.666733 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad9973-6de1-45a5-807f-3966acc34168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:09.667400 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad9973-6de1-45a5-807f-3966acc34168 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:09.667710 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad9973-6de1-45a5-807f-3966acc34168 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:09.667986 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad9973-6de1-45a5-807f-3966acc34168 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:09.668689 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad9973-6de1-45a5-807f-3966acc34168 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:09.669000 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad9973-6de1-45a5-807f-3966acc34168 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:09.670345 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad9973-6de1-45a5-807f-3966acc34168 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:09.676976 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 503/1007] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Apr 11 13:43:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:09.682433 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad9973-6de1-45a5-807f-3966acc34168 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:09.699221 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff86b9-b2cb-42c1-b9c9-93fffdca84cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:09.699919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff86b9-b2cb-42c1-b9c9-93fffdca84cc None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:09.700199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff86b9-b2cb-42c1-b9c9-93fffdca84cc None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:09.700472 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff86b9-b2cb-42c1-b9c9-93fffdca84cc None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:09.701208 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff86b9-b2cb-42c1-b9c9-93fffdca84cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:09.702581 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff86b9-b2cb-42c1-b9c9-93fffdca84cc None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:09.719675 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 505/1008] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Apr 11 13:43:09 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:43:09.790064 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad9973-6de1-45a5-807f-3966acc34168 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:09.834208 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbf4f1-ef5d-4f51-bd7d-3ee1d4d2d725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:09.834931 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbf4f1-ef5d-4f51-bd7d-3ee1d4d2d725 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:09.835217 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbf4f1-ef5d-4f51-bd7d-3ee1d4d2d725 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:09.835488 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbf4f1-ef5d-4f51-bd7d-3ee1d4d2d725 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:09.836338 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbf4f1-ef5d-4f51-bd7d-3ee1d4d2d725 None admin] RBAC: Adding query filter params (interface=public, service_id=e8d38c7538f043999b1e7ac1dd298082, region_id=RegionOne) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:09.836650 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbf4f1-ef5d-4f51-bd7d-3ee1d4d2d725 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:09.838087 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbf4f1-ef5d-4f51-bd7d-3ee1d4d2d725 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:09.848885 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 504/1009] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Apr 11 13:43:09 2022] GET /identity/v3/endpoints?service_id=e8d38c7538f043999b1e7ac1dd298082&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:09.850196 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff86b9-b2cb-42c1-b9c9-93fffdca84cc None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:09.954364 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff86b9-b2cb-42c1-b9c9-93fffdca84cc None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:09.996200 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d2046-4b9b-4096-9a18-3495096ce6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:09.996871 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d2046-4b9b-4096-9a18-3495096ce6af None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:09.997155 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d2046-4b9b-4096-9a18-3495096ce6af None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:09.997432 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d2046-4b9b-4096-9a18-3495096ce6af None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:09.998115 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d2046-4b9b-4096-9a18-3495096ce6af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:09.999500 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d2046-4b9b-4096-9a18-3495096ce6af None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:10.015736 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 506/1010] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Apr 11 13:43:09 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:43:11.327815 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326efd2-a41f-4bcf-afc2-e64b07962a6e None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:11.328332 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326efd2-a41f-4bcf-afc2-e64b07962a6e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:11.328443 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326efd2-a41f-4bcf-afc2-e64b07962a6e None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:11.330550 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 505/1011] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:11.335667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e2b3b-eb61-4f16-a615-f10e0cb2caaa None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:11.336112 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e2b3b-eb61-4f16-a615-f10e0cb2caaa None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:11.336278 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e2b3b-eb61-4f16-a615-f10e0cb2caaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:11.353293 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ca3e2b3b-eb61-4f16-a615-f10e0cb2caaa None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:11.354503 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ca3e2b3b-eb61-4f16-a615-f10e0cb2caaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:11.423491 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 507/1012] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:11 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:11.449242 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326efd2-a41f-4bcf-afc2-e64b07962a6e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:11.546682 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326efd2-a41f-4bcf-afc2-e64b07962a6e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:11.580725 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5cfde-8da6-48ef-b3f1-458a8f1b3842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:11.581455 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5cfde-8da6-48ef-b3f1-458a8f1b3842 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:11.581735 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5cfde-8da6-48ef-b3f1-458a8f1b3842 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:11.582009 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5cfde-8da6-48ef-b3f1-458a8f1b3842 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:11.583208 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5cfde-8da6-48ef-b3f1-458a8f1b3842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:11.584655 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5cfde-8da6-48ef-b3f1-458a8f1b3842 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:11.586440 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 506/1013] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:43:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:11.593499 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e2b3b-eb61-4f16-a615-f10e0cb2caaa None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:11.691089 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e2b3b-eb61-4f16-a615-f10e0cb2caaa None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:11.724822 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4919e-e415-4132-9e43-903aa5c4dc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:11.725487 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4919e-e415-4132-9e43-903aa5c4dc89 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:11.725773 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4919e-e415-4132-9e43-903aa5c4dc89 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:11.726047 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4919e-e415-4132-9e43-903aa5c4dc89 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:11.726764 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4919e-e415-4132-9e43-903aa5c4dc89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:11.728234 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4919e-e415-4132-9e43-903aa5c4dc89 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:11.759249 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 508/1014] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Apr 11 13:43:11 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:43:12.048926 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6471896-86a9-4ac5-a444-2fb24be42ffd None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:12.049303 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6471896-86a9-4ac5-a444-2fb24be42ffd None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:12.049543 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6471896-86a9-4ac5-a444-2fb24be42ffd None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:12.051169 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 507/1015] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:43:12.056618 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b927cee-290f-431c-aadd-73db7e3af06f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:12.057003 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b927cee-290f-431c-aadd-73db7e3af06f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:12.057385 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b927cee-290f-431c-aadd-73db7e3af06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:12.074902 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-6b927cee-290f-431c-aadd-73db7e3af06f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:12.076115 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6b927cee-290f-431c-aadd-73db7e3af06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:12.140396 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 509/1016] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:12 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:12.164952 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6471896-86a9-4ac5-a444-2fb24be42ffd None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:12.262032 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6471896-86a9-4ac5-a444-2fb24be42ffd None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:12.294761 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8322bf5-350a-4417-b992-04bff40756a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:12.295546 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8322bf5-350a-4417-b992-04bff40756a5 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:12.295865 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8322bf5-350a-4417-b992-04bff40756a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:12.296137 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8322bf5-350a-4417-b992-04bff40756a5 None admin] PATH_INFO: `/v3/services/image` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:12.296777 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8322bf5-350a-4417-b992-04bff40756a5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:12.298121 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8322bf5-350a-4417-b992-04bff40756a5 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:12.309299 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-e8322bf5-350a-4417-b992-04bff40756a5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 11 13:43:12.315341 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 508/1017] 10.222.0.67 () {56 vars in 1105 bytes} [Mon Apr 11 13:43:12 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:12.316366 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b927cee-290f-431c-aadd-73db7e3af06f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:12.370187 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd35b5-3d9a-43bb-a3ba-a17d29bfe6ea None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:12.370701 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd35b5-3d9a-43bb-a3ba-a17d29bfe6ea None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:12.370816 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd35b5-3d9a-43bb-a3ba-a17d29bfe6ea None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:12.372161 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 509/1018] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:43:12.377585 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb080044-49cf-4a5d-a724-837894adc90b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:12.377869 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb080044-49cf-4a5d-a724-837894adc90b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:12.378197 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb080044-49cf-4a5d-a724-837894adc90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:12.397723 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-cb080044-49cf-4a5d-a724-837894adc90b None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:12.399202 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-cb080044-49cf-4a5d-a724-837894adc90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:12.420956 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b927cee-290f-431c-aadd-73db7e3af06f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:12.455123 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738628e-d73c-4a23-8b4a-4d73ba94f718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:12.455931 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738628e-d73c-4a23-8b4a-4d73ba94f718 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:12.456216 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738628e-d73c-4a23-8b4a-4d73ba94f718 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:12.456492 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738628e-d73c-4a23-8b4a-4d73ba94f718 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:12.457199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738628e-d73c-4a23-8b4a-4d73ba94f718 None admin] RBAC: Adding query filter params (name=image) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:12.457501 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738628e-d73c-4a23-8b4a-4d73ba94f718 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:12.458874 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738628e-d73c-4a23-8b4a-4d73ba94f718 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:12.463902 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 510/1019] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:43:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:12.467321 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 510/1020] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:12 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:43:12.469190 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738628e-d73c-4a23-8b4a-4d73ba94f718 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:12.491930 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb080044-49cf-4a5d-a724-837894adc90b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:12.564017 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738628e-d73c-4a23-8b4a-4d73ba94f718 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:12.589662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb080044-49cf-4a5d-a724-837894adc90b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:12.597884 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c804c7-4f49-45e5-b4c7-134421011b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:12.598550 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c804c7-4f49-45e5-b4c7-134421011b3b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:12.598834 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c804c7-4f49-45e5-b4c7-134421011b3b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:12.599107 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c804c7-4f49-45e5-b4c7-134421011b3b None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:12.599837 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c804c7-4f49-45e5-b4c7-134421011b3b None admin] RBAC: Adding query filter params (type=image) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:12.600139 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c804c7-4f49-45e5-b4c7-134421011b3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:12.601508 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c804c7-4f49-45e5-b4c7-134421011b3b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:12.608012 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 511/1021] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:43:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:12.612662 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c804c7-4f49-45e5-b4c7-134421011b3b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:12.623486 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be0c54-8ced-4d38-a77d-d2c941e9d32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:12.624316 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be0c54-8ced-4d38-a77d-d2c941e9d32d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:12.624597 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be0c54-8ced-4d38-a77d-d2c941e9d32d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:12.624868 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be0c54-8ced-4d38-a77d-d2c941e9d32d None admin] PATH_INFO: `/v3/services/compute` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:12.625517 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be0c54-8ced-4d38-a77d-d2c941e9d32d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:12.626945 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be0c54-8ced-4d38-a77d-d2c941e9d32d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:12.638018 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-50be0c54-8ced-4d38-a77d-d2c941e9d32d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 11 13:43:12.639341 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 511/1022] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:43:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:43:12.645556 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be0c54-8ced-4d38-a77d-d2c941e9d32d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:12.707797 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c804c7-4f49-45e5-b4c7-134421011b3b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:12.740635 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eef38f-80fa-490a-983e-85fd8e5bef9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:12.741299 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eef38f-80fa-490a-983e-85fd8e5bef9c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:12.741402 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be0c54-8ced-4d38-a77d-d2c941e9d32d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:12.741589 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eef38f-80fa-490a-983e-85fd8e5bef9c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:12.741863 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eef38f-80fa-490a-983e-85fd8e5bef9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:12.742722 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eef38f-80fa-490a-983e-85fd8e5bef9c None admin] RBAC: Adding query filter params (interface=public, service_id=ae1db16ddc7b43a794262f1469284eac, region_id=RegionOne) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:12.742949 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eef38f-80fa-490a-983e-85fd8e5bef9c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:12.744343 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eef38f-80fa-490a-983e-85fd8e5bef9c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:12.749302 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 512/1023] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Apr 11 13:43:12 2022] GET /identity/v3/endpoints?service_id=ae1db16ddc7b43a794262f1469284eac&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:12.754647 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eef38f-80fa-490a-983e-85fd8e5bef9c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:12.774512 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a89cf9-a726-4318-83c0-9a9caf4377de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:12.775183 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a89cf9-a726-4318-83c0-9a9caf4377de None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:12.775469 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a89cf9-a726-4318-83c0-9a9caf4377de None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:12.775779 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a89cf9-a726-4318-83c0-9a9caf4377de None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:12.776485 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a89cf9-a726-4318-83c0-9a9caf4377de None admin] RBAC: Adding query filter params (name=compute) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:12.776794 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a89cf9-a726-4318-83c0-9a9caf4377de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:12.778152 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a89cf9-a726-4318-83c0-9a9caf4377de None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:12.787961 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 512/1024] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Apr 11 13:43:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:12.789329 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a89cf9-a726-4318-83c0-9a9caf4377de None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:12.850757 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eef38f-80fa-490a-983e-85fd8e5bef9c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:12.883578 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de4277-4b08-46a8-8d28-cb0a4fc35c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:12.883828 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a89cf9-a726-4318-83c0-9a9caf4377de None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:12.884330 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de4277-4b08-46a8-8d28-cb0a4fc35c19 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:12.884610 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de4277-4b08-46a8-8d28-cb0a4fc35c19 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:12.884883 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de4277-4b08-46a8-8d28-cb0a4fc35c19 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:12.885560 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de4277-4b08-46a8-8d28-cb0a4fc35c19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:12.886911 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de4277-4b08-46a8-8d28-cb0a4fc35c19 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:12.893988 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 513/1025] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Apr 11 13:43:12 2022] GET /identity/v3/services => generated 1957 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:43:12.918662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd3506-0b04-4e14-b858-1789c93fdc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:12.919348 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd3506-0b04-4e14-b858-1789c93fdc7a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:12.919664 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd3506-0b04-4e14-b858-1789c93fdc7a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:12.919938 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd3506-0b04-4e14-b858-1789c93fdc7a None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:12.920665 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd3506-0b04-4e14-b858-1789c93fdc7a None admin] RBAC: Adding query filter params (type=compute) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:12.920973 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd3506-0b04-4e14-b858-1789c93fdc7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:12.922415 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cd3506-0b04-4e14-b858-1789c93fdc7a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:12.928909 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 513/1026] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Apr 11 13:43:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:12.934744 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de4277-4b08-46a8-8d28-cb0a4fc35c19 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:13.037861 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de4277-4b08-46a8-8d28-cb0a4fc35c19 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:13.072780 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bc61a-e001-47f8-b647-61fe7ae68845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:13.073454 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bc61a-e001-47f8-b647-61fe7ae68845 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:13.073736 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bc61a-e001-47f8-b647-61fe7ae68845 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:13.074014 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bc61a-e001-47f8-b647-61fe7ae68845 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:13.074758 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bc61a-e001-47f8-b647-61fe7ae68845 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:13.076197 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bc61a-e001-47f8-b647-61fe7ae68845 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:13.096145 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 514/1027] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Apr 11 13:43:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:43:14.152781 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9f818-ee87-4f6e-88a0-d4f99111df6a None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:14.153329 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9f818-ee87-4f6e-88a0-d4f99111df6a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:14.153329 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9f818-ee87-4f6e-88a0-d4f99111df6a None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:14.154726 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 514/1028] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:14.159945 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a4219-ac57-4ccd-a386-43adb621fb99 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:14.160341 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a4219-ac57-4ccd-a386-43adb621fb99 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:14.160509 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a4219-ac57-4ccd-a386-43adb621fb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:14.177231 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b60a4219-ac57-4ccd-a386-43adb621fb99 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:14.178428 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b60a4219-ac57-4ccd-a386-43adb621fb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:14.247982 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 515/1029] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:14.274168 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9f818-ee87-4f6e-88a0-d4f99111df6a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:14.376753 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9f818-ee87-4f6e-88a0-d4f99111df6a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:14.417908 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def7796-c632-428d-9104-c7a0e7f83ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:14.418630 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def7796-c632-428d-9104-c7a0e7f83ea8 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:14.418916 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def7796-c632-428d-9104-c7a0e7f83ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:14.419191 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def7796-c632-428d-9104-c7a0e7f83ea8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:14.420551 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def7796-c632-428d-9104-c7a0e7f83ea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:14.421986 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def7796-c632-428d-9104-c7a0e7f83ea8 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:14.424107 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 515/1030] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:43:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:14.429537 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a4219-ac57-4ccd-a386-43adb621fb99 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:14.524715 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a4219-ac57-4ccd-a386-43adb621fb99 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:14.557009 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82529b-d403-4b8f-8c06-dbe56a46bac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:14.557682 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82529b-d403-4b8f-8c06-dbe56a46bac9 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:14.557964 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82529b-d403-4b8f-8c06-dbe56a46bac9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:14.558241 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82529b-d403-4b8f-8c06-dbe56a46bac9 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:14.558959 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82529b-d403-4b8f-8c06-dbe56a46bac9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:14.560425 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82529b-d403-4b8f-8c06-dbe56a46bac9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:14.582608 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 516/1031] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Apr 11 13:43:14 2022] POST /identity/v3/users => generated 285 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:43:15.259871 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a99db5-5480-417b-9cd2-6bfbcd2444a6 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:15.260387 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a99db5-5480-417b-9cd2-6bfbcd2444a6 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:15.260466 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a99db5-5480-417b-9cd2-6bfbcd2444a6 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:15.261944 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 516/1032] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:15.266900 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e0970-c00b-4cee-bebc-1d1594200c41 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:15.267280 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e0970-c00b-4cee-bebc-1d1594200c41 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:15.267594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e0970-c00b-4cee-bebc-1d1594200c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:15.284248 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-499e0970-c00b-4cee-bebc-1d1594200c41 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:15.285426 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-499e0970-c00b-4cee-bebc-1d1594200c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:15.350526 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 517/1033] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:43:15.375684 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a99db5-5480-417b-9cd2-6bfbcd2444a6 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:15.483984 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a99db5-5480-417b-9cd2-6bfbcd2444a6 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:15.499697 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1817c-df19-4ed0-b521-51e68481a0f1 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:15.500231 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1817c-df19-4ed0-b521-51e68481a0f1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:15.500689 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1817c-df19-4ed0-b521-51e68481a0f1 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:15.503378 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 518/1034] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:43:15.510721 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fb08e-13c4-4a1d-82c6-1c4a8dae1150 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:15.510939 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fb08e-13c4-4a1d-82c6-1c4a8dae1150 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:15.511216 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fb08e-13c4-4a1d-82c6-1c4a8dae1150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:15.520642 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0969e7-1bb5-4d19-aded-03969ab87e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:15.521740 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0969e7-1bb5-4d19-aded-03969ab87e28 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:15.522217 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0969e7-1bb5-4d19-aded-03969ab87e28 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:15.522490 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0969e7-1bb5-4d19-aded-03969ab87e28 None admin] PATH_INFO: `/v3/services/image` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:15.523141 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0969e7-1bb5-4d19-aded-03969ab87e28 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:15.524553 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0969e7-1bb5-4d19-aded-03969ab87e28 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:15.528195 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-cb1fb08e-13c4-4a1d-82c6-1c4a8dae1150 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:15.529361 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-cb1fb08e-13c4-4a1d-82c6-1c4a8dae1150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:15.535340 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-1d0969e7-1bb5-4d19-aded-03969ab87e28 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 11 13:43:15.536556 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 517/1035] 10.222.0.67 () {56 vars in 1105 bytes} [Mon Apr 11 13:43:15 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:15.543564 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0969e7-1bb5-4d19-aded-03969ab87e28 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:15.594351 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 519/1036] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:43:15.618730 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fb08e-13c4-4a1d-82c6-1c4a8dae1150 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:15.641385 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0969e7-1bb5-4d19-aded-03969ab87e28 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:15.674946 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf56f3-ede3-4cc6-a50c-1c6b69cfa973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:15.675608 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf56f3-ede3-4cc6-a50c-1c6b69cfa973 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:15.675914 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf56f3-ede3-4cc6-a50c-1c6b69cfa973 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:15.676186 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf56f3-ede3-4cc6-a50c-1c6b69cfa973 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:15.676883 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf56f3-ede3-4cc6-a50c-1c6b69cfa973 None admin] RBAC: Adding query filter params (name=image) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:15.677183 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf56f3-ede3-4cc6-a50c-1c6b69cfa973 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:15.678538 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf56f3-ede3-4cc6-a50c-1c6b69cfa973 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:15.683466 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 518/1037] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:43:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:15.689559 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf56f3-ede3-4cc6-a50c-1c6b69cfa973 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:15.716372 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fb08e-13c4-4a1d-82c6-1c4a8dae1150 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:15.751881 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e013aff-5004-46fa-b952-a7765cd31441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:15.752696 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e013aff-5004-46fa-b952-a7765cd31441 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:15.752972 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e013aff-5004-46fa-b952-a7765cd31441 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:15.753241 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e013aff-5004-46fa-b952-a7765cd31441 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:15.763821 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e013aff-5004-46fa-b952-a7765cd31441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:43:15.772028 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-0e013aff-5004-46fa-b952-a7765cd31441 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 13:43:15.773632 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 520/1038] 10.222.0.67 () {56 vars in 1120 bytes} [Mon Apr 11 13:43:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:43:15.779530 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e013aff-5004-46fa-b952-a7765cd31441 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:15.794824 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf56f3-ede3-4cc6-a50c-1c6b69cfa973 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:15.827084 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a8f1a-47f5-43cb-ae71-7d185701d918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:15.827775 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a8f1a-47f5-43cb-ae71-7d185701d918 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:15.828056 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a8f1a-47f5-43cb-ae71-7d185701d918 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:15.828333 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a8f1a-47f5-43cb-ae71-7d185701d918 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:15.829027 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a8f1a-47f5-43cb-ae71-7d185701d918 None admin] RBAC: Adding query filter params (type=image) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:15.829877 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a8f1a-47f5-43cb-ae71-7d185701d918 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:15.831337 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a8f1a-47f5-43cb-ae71-7d185701d918 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:15.835985 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 519/1039] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:43:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:15.841476 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a8f1a-47f5-43cb-ae71-7d185701d918 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:15.880366 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e013aff-5004-46fa-b952-a7765cd31441 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:15.917142 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4ba66-f3c9-4138-916c-d0553d2aeea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:15.918043 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4ba66-f3c9-4138-916c-d0553d2aeea4 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:15.918476 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4ba66-f3c9-4138-916c-d0553d2aeea4 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:15.918926 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4ba66-f3c9-4138-916c-d0553d2aeea4 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:15.919907 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4ba66-f3c9-4138-916c-d0553d2aeea4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:15.920358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4ba66-f3c9-4138-916c-d0553d2aeea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:15.921934 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4ba66-f3c9-4138-916c-d0553d2aeea4 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:15.931093 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 521/1040] 10.222.0.67 () {56 vars in 1115 bytes} [Mon Apr 11 13:43:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:15.936666 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4ba66-f3c9-4138-916c-d0553d2aeea4 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:15.947274 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a8f1a-47f5-43cb-ae71-7d185701d918 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:15.980074 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe66945-eb34-41c9-85ef-894eede2ad36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:15.980736 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe66945-eb34-41c9-85ef-894eede2ad36 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:15.981017 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe66945-eb34-41c9-85ef-894eede2ad36 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:15.981292 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe66945-eb34-41c9-85ef-894eede2ad36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:15.982024 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe66945-eb34-41c9-85ef-894eede2ad36 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:15.983382 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe66945-eb34-41c9-85ef-894eede2ad36 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:16.003592 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 520/1041] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Apr 11 13:43:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:43:16.040274 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4ba66-f3c9-4138-916c-d0553d2aeea4 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:16.083250 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa785d-814b-405a-a51e-fee035d2b2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:16.084161 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa785d-814b-405a-a51e-fee035d2b2ee None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:16.084444 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa785d-814b-405a-a51e-fee035d2b2ee None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:16.084767 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa785d-814b-405a-a51e-fee035d2b2ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:16.097558 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa785d-814b-405a-a51e-fee035d2b2ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:16.099041 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa785d-814b-405a-a51e-fee035d2b2ee None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:16.117008 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-f9fa785d-814b-405a-a51e-fee035d2b2ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:43:16.118455 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 522/1042] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:43:16.124080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe66945-eb34-41c9-85ef-894eede2ad36 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:16.225738 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe66945-eb34-41c9-85ef-894eede2ad36 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:16.258703 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bad591-f707-44ce-98a3-4243b78f1d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:16.259372 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bad591-f707-44ce-98a3-4243b78f1d79 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:16.259676 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bad591-f707-44ce-98a3-4243b78f1d79 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:16.259960 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bad591-f707-44ce-98a3-4243b78f1d79 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:16.260684 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bad591-f707-44ce-98a3-4243b78f1d79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:16.260993 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bad591-f707-44ce-98a3-4243b78f1d79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:16.262369 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bad591-f707-44ce-98a3-4243b78f1d79 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:16.274032 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 521/1043] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:16.279894 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa785d-814b-405a-a51e-fee035d2b2ee None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:16.380117 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa785d-814b-405a-a51e-fee035d2b2ee None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:16.412792 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde3c39-01af-450a-b7f5-2fd44e8ee6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:16.413589 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde3c39-01af-450a-b7f5-2fd44e8ee6e4 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:16.413870 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde3c39-01af-450a-b7f5-2fd44e8ee6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:16.414144 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde3c39-01af-450a-b7f5-2fd44e8ee6e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:16.421518 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde3c39-01af-450a-b7f5-2fd44e8ee6e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:16.423474 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde3c39-01af-450a-b7f5-2fd44e8ee6e4 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:16.436722 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-2bde3c39-01af-450a-b7f5-2fd44e8ee6e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 13:43:16.438089 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 523/1044] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Apr 11 13:43:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:43:16.444514 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bad591-f707-44ce-98a3-4243b78f1d79 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:16.538375 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bad591-f707-44ce-98a3-4243b78f1d79 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:16.572017 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb8ed8-a024-4e66-9cc3-41d93bfa1a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:16.572686 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb8ed8-a024-4e66-9cc3-41d93bfa1a09 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:16.572972 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb8ed8-a024-4e66-9cc3-41d93bfa1a09 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:16.573246 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb8ed8-a024-4e66-9cc3-41d93bfa1a09 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:16.574075 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb8ed8-a024-4e66-9cc3-41d93bfa1a09 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:16.574385 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb8ed8-a024-4e66-9cc3-41d93bfa1a09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:16.575827 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb8ed8-a024-4e66-9cc3-41d93bfa1a09 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:16.598835 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 522/1045] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Apr 11 13:43:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:16.600177 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde3c39-01af-450a-b7f5-2fd44e8ee6e4 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:16.698336 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde3c39-01af-450a-b7f5-2fd44e8ee6e4 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:16.731029 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b5678-27bf-4f33-bc5b-2ac9b82e48a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:16.731718 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b5678-27bf-4f33-bc5b-2ac9b82e48a3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:16.732005 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b5678-27bf-4f33-bc5b-2ac9b82e48a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:16.732279 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b5678-27bf-4f33-bc5b-2ac9b82e48a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:16.795970 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b5678-27bf-4f33-bc5b-2ac9b82e48a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:16.797442 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b5678-27bf-4f33-bc5b-2ac9b82e48a3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:16.897156 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 524/1046] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:43:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:43:16.898344 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb8ed8-a024-4e66-9cc3-41d93bfa1a09 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:16.978949 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca818fa0-9cc9-4094-803a-97df48f86d16 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:16.979147 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca818fa0-9cc9-4094-803a-97df48f86d16 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:16.979405 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca818fa0-9cc9-4094-803a-97df48f86d16 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:16.980967 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 525/1047] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:16.986396 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b82846-7629-4885-9614-8fb138a9061e None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:16.986854 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b82846-7629-4885-9614-8fb138a9061e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:16.987136 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b82846-7629-4885-9614-8fb138a9061e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:16.997643 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb8ed8-a024-4e66-9cc3-41d93bfa1a09 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:17.003937 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-58b82846-7629-4885-9614-8fb138a9061e None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:17.005126 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-58b82846-7629-4885-9614-8fb138a9061e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:17.034658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71aebfe-a185-4014-885e-a903d64ca663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:17.035459 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71aebfe-a185-4014-885e-a903d64ca663 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:17.035785 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71aebfe-a185-4014-885e-a903d64ca663 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:17.036065 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71aebfe-a185-4014-885e-a903d64ca663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:17.046599 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71aebfe-a185-4014-885e-a903d64ca663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:17.048717 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71aebfe-a185-4014-885e-a903d64ca663 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:17.066139 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-f71aebfe-a185-4014-885e-a903d64ca663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:43:17.067548 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 523/1048] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:43:17.075672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 526/1049] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:43:17.075831 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71aebfe-a185-4014-885e-a903d64ca663 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:17.097830 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b82846-7629-4885-9614-8fb138a9061e None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:17.174670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71aebfe-a185-4014-885e-a903d64ca663 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:17.195670 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b82846-7629-4885-9614-8fb138a9061e None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:17.208370 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6861c07-faf6-4364-9921-f4b2a0678d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:17.209022 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6861c07-faf6-4364-9921-f4b2a0678d07 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:17.209312 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6861c07-faf6-4364-9921-f4b2a0678d07 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:17.209582 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6861c07-faf6-4364-9921-f4b2a0678d07 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:17.210295 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6861c07-faf6-4364-9921-f4b2a0678d07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:17.210599 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6861c07-faf6-4364-9921-f4b2a0678d07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:17.211984 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6861c07-faf6-4364-9921-f4b2a0678d07 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:17.226204 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 524/1050] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:17.229983 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67283ea7-d5b3-46d5-9d74-53c735383a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:17.231087 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67283ea7-d5b3-46d5-9d74-53c735383a76 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:17.231374 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67283ea7-d5b3-46d5-9d74-53c735383a76 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:17.231539 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6861c07-faf6-4364-9921-f4b2a0678d07 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:17.231692 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67283ea7-d5b3-46d5-9d74-53c735383a76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:17.242140 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67283ea7-d5b3-46d5-9d74-53c735383a76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:43:17.248995 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-67283ea7-d5b3-46d5-9d74-53c735383a76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:43:17.250214 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 527/1051] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:43:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:43:17.256358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67283ea7-d5b3-46d5-9d74-53c735383a76 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:17.330134 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6861c07-faf6-4364-9921-f4b2a0678d07 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:17.353737 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67283ea7-d5b3-46d5-9d74-53c735383a76 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:17.363250 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b3a3b-0fea-4ef3-adce-f7f23aa933a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:17.364082 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b3a3b-0fea-4ef3-adce-f7f23aa933a2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:17.364371 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b3a3b-0fea-4ef3-adce-f7f23aa933a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:17.364645 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b3a3b-0fea-4ef3-adce-f7f23aa933a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:17.371262 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b3a3b-0fea-4ef3-adce-f7f23aa933a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:17.372753 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b3a3b-0fea-4ef3-adce-f7f23aa933a2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:17.387708 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213462d8-2813-4056-8c94-f57de90dd2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:17.388378 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213462d8-2813-4056-8c94-f57de90dd2ef None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:17.388633 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-749b3a3b-0fea-4ef3-adce-f7f23aa933a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:43:17.388758 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213462d8-2813-4056-8c94-f57de90dd2ef None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:17.388920 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213462d8-2813-4056-8c94-f57de90dd2ef None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:17.389658 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213462d8-2813-4056-8c94-f57de90dd2ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:17.389825 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 525/1052] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:43:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:43:17.390302 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213462d8-2813-4056-8c94-f57de90dd2ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:17.392335 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213462d8-2813-4056-8c94-f57de90dd2ef None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:17.396110 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b3a3b-0fea-4ef3-adce-f7f23aa933a2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:17.403513 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 528/1053] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:43:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:17.409887 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213462d8-2813-4056-8c94-f57de90dd2ef None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:17.495734 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b3a3b-0fea-4ef3-adce-f7f23aa933a2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:17.508073 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213462d8-2813-4056-8c94-f57de90dd2ef None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:17.528281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1268b7-a415-4794-aa29-acde81a277ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:17.528942 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1268b7-a415-4794-aa29-acde81a277ad None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:17.529222 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1268b7-a415-4794-aa29-acde81a277ad None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:17.529502 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1268b7-a415-4794-aa29-acde81a277ad None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:17.530284 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1268b7-a415-4794-aa29-acde81a277ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:17.530594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1268b7-a415-4794-aa29-acde81a277ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:17.532040 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1268b7-a415-4794-aa29-acde81a277ad None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:17.544134 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed4ba9-9eb4-4c0b-968e-b770f271ae78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:17.544804 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 526/1054] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:43:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:17.545423 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed4ba9-9eb4-4c0b-968e-b770f271ae78 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:17.545751 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed4ba9-9eb4-4c0b-968e-b770f271ae78 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:17.545973 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed4ba9-9eb4-4c0b-968e-b770f271ae78 None admin] PATH_INFO: `/v3/users/97bc749e5dfd4923919265e783cdbed8` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:17.551199 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1268b7-a415-4794-aa29-acde81a277ad None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:17.559438 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed4ba9-9eb4-4c0b-968e-b770f271ae78 None admin] RBAC: Authorizing `identity:get_user(user_id=97bc749e5dfd4923919265e783cdbed8)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:17.560923 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed4ba9-9eb4-4c0b-968e-b770f271ae78 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:17.562742 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 529/1055] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:43:17 2022] GET /identity/v3/users/97bc749e5dfd4923919265e783cdbed8 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:17.569433 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed4ba9-9eb4-4c0b-968e-b770f271ae78 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:17.670537 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed4ba9-9eb4-4c0b-968e-b770f271ae78 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:17.706498 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0a086-615e-4d05-990d-f8d29c44f301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:17.707164 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0a086-615e-4d05-990d-f8d29c44f301 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:17.707444 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0a086-615e-4d05-990d-f8d29c44f301 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:17.707746 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0a086-615e-4d05-990d-f8d29c44f301 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:17.772427 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1268b7-a415-4794-aa29-acde81a277ad None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:17.775832 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0a086-615e-4d05-990d-f8d29c44f301 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:17.777320 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0a086-615e-4d05-990d-f8d29c44f301 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:17.807076 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d099c-6667-4149-8bfd-7a2435e9447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:17.807766 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d099c-6667-4149-8bfd-7a2435e9447d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:17.808051 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d099c-6667-4149-8bfd-7a2435e9447d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:17.808327 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d099c-6667-4149-8bfd-7a2435e9447d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:17.809152 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d099c-6667-4149-8bfd-7a2435e9447d None admin] RBAC: Adding query filter params (role.id=d761d545536542028c82c9ceb096b437, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=fedd2314dc594bcba749bf7b0d1e50fb) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:17.809457 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d099c-6667-4149-8bfd-7a2435e9447d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:17.810879 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d099c-6667-4149-8bfd-7a2435e9447d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:17.816362 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 527/1056] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:43:17 2022] GET /identity/v3/role_assignments?user.id=fedd2314dc594bcba749bf7b0d1e50fb&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=d761d545536542028c82c9ceb096b437 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:17.878163 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 530/1057] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:43:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:43:17.884091 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d099c-6667-4149-8bfd-7a2435e9447d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:18.002553 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d099c-6667-4149-8bfd-7a2435e9447d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:18.037921 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac4a5e-bd11-4bb8-8bf8-f336a54ffd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:18.038810 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac4a5e-bd11-4bb8-8bf8-f336a54ffd51 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:18.039031 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac4a5e-bd11-4bb8-8bf8-f336a54ffd51 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:18.039320 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac4a5e-bd11-4bb8-8bf8-f336a54ffd51 None admin] PATH_INFO: `/v3/projects/33a25a6ff5604c4f95de10d22c1fcba9` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:18.040674 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac4a5e-bd11-4bb8-8bf8-f336a54ffd51 None admin] RBAC: Authorizing `identity:get_project(project_id=33a25a6ff5604c4f95de10d22c1fcba9)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:18.042237 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac4a5e-bd11-4bb8-8bf8-f336a54ffd51 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:18.044327 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 528/1058] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:43:17 2022] GET /identity/v3/projects/33a25a6ff5604c4f95de10d22c1fcba9 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:18.050724 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0a086-615e-4d05-990d-f8d29c44f301 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:18.147307 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0a086-615e-4d05-990d-f8d29c44f301 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:18.179891 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db68337-26ba-4863-a63f-5fa2c84e4336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:18.180550 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db68337-26ba-4863-a63f-5fa2c84e4336 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:18.180831 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db68337-26ba-4863-a63f-5fa2c84e4336 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:18.181107 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db68337-26ba-4863-a63f-5fa2c84e4336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:18.181937 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db68337-26ba-4863-a63f-5fa2c84e4336 None admin] RBAC: Adding query filter params (role.id=e3333fcf22b040e3a1f0bfbfe657cffa, scope.project.id=33a25a6ff5604c4f95de10d22c1fcba9, user.id=97bc749e5dfd4923919265e783cdbed8) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:18.182250 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db68337-26ba-4863-a63f-5fa2c84e4336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:18.183715 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db68337-26ba-4863-a63f-5fa2c84e4336 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:18.195653 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 531/1059] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:43:18 2022] GET /identity/v3/role_assignments?user.id=97bc749e5dfd4923919265e783cdbed8&scope.project.id=33a25a6ff5604c4f95de10d22c1fcba9&role.id=e3333fcf22b040e3a1f0bfbfe657cffa => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:18.372829 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090148f6-427a-49f9-95c9-806503c4cee9 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:18.373309 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090148f6-427a-49f9-95c9-806503c4cee9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:18.373309 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090148f6-427a-49f9-95c9-806503c4cee9 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:18.374647 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 529/1060] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:18.382720 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a4729-4d9b-4437-8109-5987e8b8870d None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:18.382720 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a4729-4d9b-4437-8109-5987e8b8870d None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:18.382720 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a4729-4d9b-4437-8109-5987e8b8870d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:18.400262 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-459a4729-4d9b-4437-8109-5987e8b8870d None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:18.401470 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-459a4729-4d9b-4437-8109-5987e8b8870d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:18.465548 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 532/1061] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:43:18.488960 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090148f6-427a-49f9-95c9-806503c4cee9 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:18.586330 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090148f6-427a-49f9-95c9-806503c4cee9 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:18.619831 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a3526-e6d1-4b07-aaab-a43f2bbc5da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:18.620483 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a3526-e6d1-4b07-aaab-a43f2bbc5da6 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:18.620770 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a3526-e6d1-4b07-aaab-a43f2bbc5da6 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:18.621048 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a3526-e6d1-4b07-aaab-a43f2bbc5da6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:18.684287 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a3526-e6d1-4b07-aaab-a43f2bbc5da6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:18.685732 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a3526-e6d1-4b07-aaab-a43f2bbc5da6 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:18.785038 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 530/1062] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:43:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:43:18.786319 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a4729-4d9b-4437-8109-5987e8b8870d None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:18.879835 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a4729-4d9b-4437-8109-5987e8b8870d None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:18.911889 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e6ae3-1cc2-47ac-83e9-049755957b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:18.912677 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e6ae3-1cc2-47ac-83e9-049755957b03 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:18.912953 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e6ae3-1cc2-47ac-83e9-049755957b03 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:18.913220 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e6ae3-1cc2-47ac-83e9-049755957b03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:18.924042 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e6ae3-1cc2-47ac-83e9-049755957b03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:18.925626 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e6ae3-1cc2-47ac-83e9-049755957b03 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:18.943524 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-bb5e6ae3-1cc2-47ac-83e9-049755957b03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:43:18.944850 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 533/1063] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:18.950772 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a3526-e6d1-4b07-aaab-a43f2bbc5da6 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:19.046425 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a3526-e6d1-4b07-aaab-a43f2bbc5da6 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:19.079238 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfcafdd-f244-4ca6-8fba-6898236f967f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:19.079937 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcafdd-f244-4ca6-8fba-6898236f967f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:19.080243 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcafdd-f244-4ca6-8fba-6898236f967f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:19.080532 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcafdd-f244-4ca6-8fba-6898236f967f None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:19.081253 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfcafdd-f244-4ca6-8fba-6898236f967f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:19.081559 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfcafdd-f244-4ca6-8fba-6898236f967f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:19.082914 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfcafdd-f244-4ca6-8fba-6898236f967f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:19.099672 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 531/1064] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:20.113223 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68fa6f-c6c8-492e-8875-d1a141e37583 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:20.113882 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68fa6f-c6c8-492e-8875-d1a141e37583 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:20.113882 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68fa6f-c6c8-492e-8875-d1a141e37583 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:20.115173 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 534/1065] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:20.121323 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c24aba-b809-4656-8fb1-a1126c69600f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:20.121885 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c24aba-b809-4656-8fb1-a1126c69600f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:20.121885 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c24aba-b809-4656-8fb1-a1126c69600f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:20.139447 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-f7c24aba-b809-4656-8fb1-a1126c69600f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:20.140666 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f7c24aba-b809-4656-8fb1-a1126c69600f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:20.204471 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 532/1066] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:43:20.226376 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68fa6f-c6c8-492e-8875-d1a141e37583 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:20.323861 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68fa6f-c6c8-492e-8875-d1a141e37583 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:20.357031 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb136f-0266-4d6a-8f99-c908a3291555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:20.357839 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb136f-0266-4d6a-8f99-c908a3291555 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:20.358123 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb136f-0266-4d6a-8f99-c908a3291555 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:20.358396 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb136f-0266-4d6a-8f99-c908a3291555 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:20.368565 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb136f-0266-4d6a-8f99-c908a3291555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:43:20.376015 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-05bb136f-0266-4d6a-8f99-c908a3291555 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 13:43:20.377365 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 535/1067] 10.222.0.67 () {56 vars in 1120 bytes} [Mon Apr 11 13:43:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:20.384552 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c24aba-b809-4656-8fb1-a1126c69600f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:20.478912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c24aba-b809-4656-8fb1-a1126c69600f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:20.489605 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953ddfb-772b-4818-a4dc-c73838384b10 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:20.489978 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953ddfb-772b-4818-a4dc-c73838384b10 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:20.490283 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953ddfb-772b-4818-a4dc-c73838384b10 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:20.491662 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 536/1068] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:43:20.496699 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa08e25-e701-432f-bfd6-e9122f38941b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:20.496987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa08e25-e701-432f-bfd6-e9122f38941b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:20.497269 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa08e25-e701-432f-bfd6-e9122f38941b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:20.511255 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1c7b7-24dd-4ef5-a8e3-f9c54e029bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:20.511943 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1c7b7-24dd-4ef5-a8e3-f9c54e029bbd None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:20.512228 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1c7b7-24dd-4ef5-a8e3-f9c54e029bbd None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:20.512505 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1c7b7-24dd-4ef5-a8e3-f9c54e029bbd None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:20.513250 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1c7b7-24dd-4ef5-a8e3-f9c54e029bbd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:20.513355 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4aa08e25-e701-432f-bfd6-e9122f38941b None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:20.513556 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1c7b7-24dd-4ef5-a8e3-f9c54e029bbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:20.514437 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4aa08e25-e701-432f-bfd6-e9122f38941b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:20.514914 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1c7b7-24dd-4ef5-a8e3-f9c54e029bbd None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:20.527409 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 533/1069] 10.222.0.67 () {56 vars in 1115 bytes} [Mon Apr 11 13:43:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:20.528470 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1c7b7-24dd-4ef5-a8e3-f9c54e029bbd None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:20.579198 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 537/1070] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:43:20.602336 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa08e25-e701-432f-bfd6-e9122f38941b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:20.621449 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1c7b7-24dd-4ef5-a8e3-f9c54e029bbd None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:20.653956 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250358c4-ee5c-4fff-a9fe-dc989a7fbec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:20.654745 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250358c4-ee5c-4fff-a9fe-dc989a7fbec0 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:20.655025 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250358c4-ee5c-4fff-a9fe-dc989a7fbec0 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:20.655299 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250358c4-ee5c-4fff-a9fe-dc989a7fbec0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:20.665554 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250358c4-ee5c-4fff-a9fe-dc989a7fbec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:20.666984 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250358c4-ee5c-4fff-a9fe-dc989a7fbec0 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:20.682925 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-250358c4-ee5c-4fff-a9fe-dc989a7fbec0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:43:20.684133 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 534/1071] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:20.690450 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250358c4-ee5c-4fff-a9fe-dc989a7fbec0 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:20.694963 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa08e25-e701-432f-bfd6-e9122f38941b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:20.727393 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b377b6-7945-47de-8add-2515e9b8905a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:20.728208 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b377b6-7945-47de-8add-2515e9b8905a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:20.728493 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b377b6-7945-47de-8add-2515e9b8905a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:20.728774 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b377b6-7945-47de-8add-2515e9b8905a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:20.738669 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b377b6-7945-47de-8add-2515e9b8905a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:43:20.745605 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-56b377b6-7945-47de-8add-2515e9b8905a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:43:20.746795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 538/1072] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:43:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:43:20.754725 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b377b6-7945-47de-8add-2515e9b8905a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:20.784596 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250358c4-ee5c-4fff-a9fe-dc989a7fbec0 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:20.816319 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b774ff-476e-452c-899d-42ee8b5d0d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:20.816980 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b774ff-476e-452c-899d-42ee8b5d0d5c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:20.817263 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b774ff-476e-452c-899d-42ee8b5d0d5c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:20.817540 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b774ff-476e-452c-899d-42ee8b5d0d5c None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:20.818260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b774ff-476e-452c-899d-42ee8b5d0d5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:20.818563 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b774ff-476e-452c-899d-42ee8b5d0d5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:20.819955 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b774ff-476e-452c-899d-42ee8b5d0d5c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:20.831399 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 535/1073] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:20.836946 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b774ff-476e-452c-899d-42ee8b5d0d5c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:20.848587 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b377b6-7945-47de-8add-2515e9b8905a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:20.879861 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf257d-bc11-484d-9a23-8fbde44b9505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:20.880522 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf257d-bc11-484d-9a23-8fbde44b9505 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:20.880801 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf257d-bc11-484d-9a23-8fbde44b9505 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:20.881072 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf257d-bc11-484d-9a23-8fbde44b9505 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:20.881817 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf257d-bc11-484d-9a23-8fbde44b9505 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:20.882122 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf257d-bc11-484d-9a23-8fbde44b9505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:20.883513 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf257d-bc11-484d-9a23-8fbde44b9505 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:20.891109 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 539/1074] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:43:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:20.897358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf257d-bc11-484d-9a23-8fbde44b9505 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:20.929024 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b774ff-476e-452c-899d-42ee8b5d0d5c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:20.961256 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeee193-1639-4ab8-8415-cef3a9aab843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:20.962035 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeee193-1639-4ab8-8415-cef3a9aab843 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:20.962314 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeee193-1639-4ab8-8415-cef3a9aab843 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:20.962588 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeee193-1639-4ab8-8415-cef3a9aab843 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:20.969352 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeee193-1639-4ab8-8415-cef3a9aab843 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:20.970778 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeee193-1639-4ab8-8415-cef3a9aab843 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:20.983955 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-fbeee193-1639-4ab8-8415-cef3a9aab843 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 13:43:20.985679 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 536/1075] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Apr 11 13:43:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:43:20.990468 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf257d-bc11-484d-9a23-8fbde44b9505 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:20.991329 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeee193-1639-4ab8-8415-cef3a9aab843 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:21.022476 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab149d-ccac-4973-97ba-729f5f6c19be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:21.023338 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab149d-ccac-4973-97ba-729f5f6c19be None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:21.023614 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab149d-ccac-4973-97ba-729f5f6c19be None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:21.023949 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab149d-ccac-4973-97ba-729f5f6c19be None admin] PATH_INFO: `/v3/users/97bc749e5dfd4923919265e783cdbed8` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:21.025083 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab149d-ccac-4973-97ba-729f5f6c19be None admin] RBAC: Authorizing `identity:get_user(user_id=97bc749e5dfd4923919265e783cdbed8)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:21.026532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ab149d-ccac-4973-97ba-729f5f6c19be None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:21.028186 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 540/1076] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:43:20 2022] GET /identity/v3/users/97bc749e5dfd4923919265e783cdbed8 => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:21.034478 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab149d-ccac-4973-97ba-729f5f6c19be None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:21.085118 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeee193-1639-4ab8-8415-cef3a9aab843 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:21.116841 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b5866-34a3-4f45-94d2-895c5611b249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:21.117501 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b5866-34a3-4f45-94d2-895c5611b249 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:21.117782 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b5866-34a3-4f45-94d2-895c5611b249 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:21.118079 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b5866-34a3-4f45-94d2-895c5611b249 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:21.118904 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b5866-34a3-4f45-94d2-895c5611b249 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:21.119210 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b5866-34a3-4f45-94d2-895c5611b249 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:21.120656 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b5866-34a3-4f45-94d2-895c5611b249 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:21.128961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab149d-ccac-4973-97ba-729f5f6c19be None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:21.137442 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 537/1077] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Apr 11 13:43:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:21.143433 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b5866-34a3-4f45-94d2-895c5611b249 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:21.161691 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce74a1-0a0b-4cd6-8b0f-ad4f2ccca24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:21.162551 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce74a1-0a0b-4cd6-8b0f-ad4f2ccca24a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:21.162835 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce74a1-0a0b-4cd6-8b0f-ad4f2ccca24a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:21.163134 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce74a1-0a0b-4cd6-8b0f-ad4f2ccca24a None admin] PATH_INFO: `/v3/projects/33a25a6ff5604c4f95de10d22c1fcba9` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:21.164430 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce74a1-0a0b-4cd6-8b0f-ad4f2ccca24a None admin] RBAC: Authorizing `identity:get_project(project_id=33a25a6ff5604c4f95de10d22c1fcba9)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:21.165868 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce74a1-0a0b-4cd6-8b0f-ad4f2ccca24a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:21.167730 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 541/1078] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:43:21 2022] GET /identity/v3/projects/33a25a6ff5604c4f95de10d22c1fcba9 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:21.173440 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce74a1-0a0b-4cd6-8b0f-ad4f2ccca24a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:21.236618 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b5866-34a3-4f45-94d2-895c5611b249 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:21.267179 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce74a1-0a0b-4cd6-8b0f-ad4f2ccca24a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:21.267353 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31b468-9871-4415-b813-8866b5ba23d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:21.268094 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31b468-9871-4415-b813-8866b5ba23d6 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:21.268376 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31b468-9871-4415-b813-8866b5ba23d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:21.268650 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31b468-9871-4415-b813-8866b5ba23d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:21.277986 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31b468-9871-4415-b813-8866b5ba23d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:21.279411 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31b468-9871-4415-b813-8866b5ba23d6 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:21.295949 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-4a31b468-9871-4415-b813-8866b5ba23d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:43:21.297107 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 538/1079] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:43:21.303252 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31b468-9871-4415-b813-8866b5ba23d6 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:21.304386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a5f8f-b737-4058-8025-3009f235ddb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:21.305265 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a5f8f-b737-4058-8025-3009f235ddb8 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:21.305542 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a5f8f-b737-4058-8025-3009f235ddb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:21.305813 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a5f8f-b737-4058-8025-3009f235ddb8 None admin] PATH_INFO: `/v3/projects/33a25a6ff5604c4f95de10d22c1fcba9/users/97bc749e5dfd4923919265e783cdbed8/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:21.307781 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a5f8f-b737-4058-8025-3009f235ddb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=33a25a6ff5604c4f95de10d22c1fcba9, user_id=97bc749e5dfd4923919265e783cdbed8, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:21.309193 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a5f8f-b737-4058-8025-3009f235ddb8 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:21.323288 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 542/1080] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:43:21 2022] PUT /identity/v3/projects/33a25a6ff5604c4f95de10d22c1fcba9/users/97bc749e5dfd4923919265e783cdbed8/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:43:21.403718 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31b468-9871-4415-b813-8866b5ba23d6 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:21.440987 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae0651-9683-4b50-a5e5-65fd9818189b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:21.441667 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae0651-9683-4b50-a5e5-65fd9818189b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:21.441951 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae0651-9683-4b50-a5e5-65fd9818189b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:21.442229 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae0651-9683-4b50-a5e5-65fd9818189b None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:21.442962 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae0651-9683-4b50-a5e5-65fd9818189b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:21.443271 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae0651-9683-4b50-a5e5-65fd9818189b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:21.444682 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae0651-9683-4b50-a5e5-65fd9818189b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:21.457756 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 539/1081] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:21.463486 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a5f8f-b737-4058-8025-3009f235ddb8 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:21.562903 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a5f8f-b737-4058-8025-3009f235ddb8 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:21.596304 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a505117-9ff9-4ba7-a789-a818316dd470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:21.597102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a505117-9ff9-4ba7-a789-a818316dd470 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:21.597382 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a505117-9ff9-4ba7-a789-a818316dd470 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:21.597655 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a505117-9ff9-4ba7-a789-a818316dd470 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:21.604134 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a505117-9ff9-4ba7-a789-a818316dd470 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:21.605578 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a505117-9ff9-4ba7-a789-a818316dd470 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:21.618718 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-4a505117-9ff9-4ba7-a789-a818316dd470 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:43:21.619956 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 543/1082] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:43:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:21.625815 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae0651-9683-4b50-a5e5-65fd9818189b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:21.721630 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae0651-9683-4b50-a5e5-65fd9818189b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:21.752080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be68117-cf97-488d-8377-166432edce72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:21.752729 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be68117-cf97-488d-8377-166432edce72 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:21.753006 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be68117-cf97-488d-8377-166432edce72 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:21.753277 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be68117-cf97-488d-8377-166432edce72 None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:21.754051 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be68117-cf97-488d-8377-166432edce72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:21.754355 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be68117-cf97-488d-8377-166432edce72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:21.755793 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be68117-cf97-488d-8377-166432edce72 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:21.767613 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 540/1083] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:43:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:21.773603 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a505117-9ff9-4ba7-a789-a818316dd470 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:21.867639 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a505117-9ff9-4ba7-a789-a818316dd470 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:21.899345 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a935bbd-30b6-4ccb-b754-e5385bd2e665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:21.900259 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a935bbd-30b6-4ccb-b754-e5385bd2e665 None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:21.900543 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a935bbd-30b6-4ccb-b754-e5385bd2e665 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:21.900814 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a935bbd-30b6-4ccb-b754-e5385bd2e665 None admin] PATH_INFO: `/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/fedd2314dc594bcba749bf7b0d1e50fb/roles/d761d545536542028c82c9ceb096b437` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:21.903020 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a935bbd-30b6-4ccb-b754-e5385bd2e665 None admin] RBAC: Authorizing `identity:create_grant(project_id=d46063ee60fd4f6dba86d1c5946e9381, user_id=fedd2314dc594bcba749bf7b0d1e50fb, role_id=d761d545536542028c82c9ceb096b437)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:21.904485 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a935bbd-30b6-4ccb-b754-e5385bd2e665 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:21.917635 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 544/1084] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:43:21 2022] PUT /identity/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/fedd2314dc594bcba749bf7b0d1e50fb/roles/d761d545536542028c82c9ceb096b437 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:43:23.621338 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeb5a8-9ec5-42f7-a6f3-7e26464272e5 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:23.621850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeb5a8-9ec5-42f7-a6f3-7e26464272e5 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:23.621957 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeb5a8-9ec5-42f7-a6f3-7e26464272e5 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:23.623386 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 541/1085] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:43:23.629095 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b53d55-8148-49c0-9fef-e32ff482a95e None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:23.629535 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b53d55-8148-49c0-9fef-e32ff482a95e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:23.629638 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b53d55-8148-49c0-9fef-e32ff482a95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:23.646954 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-79b53d55-8148-49c0-9fef-e32ff482a95e None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:23.648211 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-79b53d55-8148-49c0-9fef-e32ff482a95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:23.711256 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 545/1086] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:23.735571 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbeb5a8-9ec5-42f7-a6f3-7e26464272e5 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:23.833920 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbeb5a8-9ec5-42f7-a6f3-7e26464272e5 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:23.868597 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c75b9-17f8-4156-8ccb-48e7fcbb9308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:23.869384 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c75b9-17f8-4156-8ccb-48e7fcbb9308 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:23.869666 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c75b9-17f8-4156-8ccb-48e7fcbb9308 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:23.869940 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c75b9-17f8-4156-8ccb-48e7fcbb9308 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:23.879655 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c75b9-17f8-4156-8ccb-48e7fcbb9308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:43:23.886551 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-796c75b9-17f8-4156-8ccb-48e7fcbb9308 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:43:23.887930 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 542/1087] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:43:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:23.894323 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b53d55-8148-49c0-9fef-e32ff482a95e None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:23.987388 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b53d55-8148-49c0-9fef-e32ff482a95e None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:24.020138 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035504ad-dd00-4115-bc4a-03bd0675f7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:24.020804 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035504ad-dd00-4115-bc4a-03bd0675f7c6 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:24.021085 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035504ad-dd00-4115-bc4a-03bd0675f7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:24.021357 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035504ad-dd00-4115-bc4a-03bd0675f7c6 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:24.022099 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035504ad-dd00-4115-bc4a-03bd0675f7c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:24.022402 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035504ad-dd00-4115-bc4a-03bd0675f7c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:24.023804 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035504ad-dd00-4115-bc4a-03bd0675f7c6 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:24.031474 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 546/1088] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:43:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:24.037745 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c75b9-17f8-4156-8ccb-48e7fcbb9308 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:24.134036 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c75b9-17f8-4156-8ccb-48e7fcbb9308 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:24.165894 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1c570-a005-4625-8b81-7be04646d2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:24.166765 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1c570-a005-4625-8b81-7be04646d2e4 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:24.167045 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1c570-a005-4625-8b81-7be04646d2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:24.167317 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1c570-a005-4625-8b81-7be04646d2e4 None admin] PATH_INFO: `/v3/users/97bc749e5dfd4923919265e783cdbed8` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:24.168507 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1c570-a005-4625-8b81-7be04646d2e4 None admin] RBAC: Authorizing `identity:get_user(user_id=97bc749e5dfd4923919265e783cdbed8)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:24.169917 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1c570-a005-4625-8b81-7be04646d2e4 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:24.171526 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 543/1089] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:43:24 2022] GET /identity/v3/users/97bc749e5dfd4923919265e783cdbed8 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:24.177410 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035504ad-dd00-4115-bc4a-03bd0675f7c6 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:24.207441 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0c0d8-7b37-4823-afd1-87dd8de78f3d None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:24.207760 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0c0d8-7b37-4823-afd1-87dd8de78f3d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:24.208041 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df0c0d8-7b37-4823-afd1-87dd8de78f3d None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:24.209396 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 544/1090] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:43:24.214405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cce3f-3d2c-4a2c-a4a3-056880236495 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:24.214705 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cce3f-3d2c-4a2c-a4a3-056880236495 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:24.214985 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cce3f-3d2c-4a2c-a4a3-056880236495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:24.230790 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-dd5cce3f-3d2c-4a2c-a4a3-056880236495 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:24.232003 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-dd5cce3f-3d2c-4a2c-a4a3-056880236495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:24.272555 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035504ad-dd00-4115-bc4a-03bd0675f7c6 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:24.295309 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 545/1091] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:43:24.303480 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b931dd-35d7-47cc-8cca-5a57bc26a8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:24.304152 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b931dd-35d7-47cc-8cca-5a57bc26a8d5 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:24.304433 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b931dd-35d7-47cc-8cca-5a57bc26a8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:24.304707 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b931dd-35d7-47cc-8cca-5a57bc26a8d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:24.322125 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cce3f-3d2c-4a2c-a4a3-056880236495 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:24.368483 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b931dd-35d7-47cc-8cca-5a57bc26a8d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:24.369958 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b931dd-35d7-47cc-8cca-5a57bc26a8d5 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:24.416140 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cce3f-3d2c-4a2c-a4a3-056880236495 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:24.448800 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702c564-50d3-471f-8be0-2179bcd18dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:24.449614 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702c564-50d3-471f-8be0-2179bcd18dc1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:24.449901 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702c564-50d3-471f-8be0-2179bcd18dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:24.450179 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702c564-50d3-471f-8be0-2179bcd18dc1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:24.459887 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702c564-50d3-471f-8be0-2179bcd18dc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:43:24.463477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 547/1092] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:43:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:43:24.467204 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-b702c564-50d3-471f-8be0-2179bcd18dc1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 13:43:24.468632 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 546/1093] 10.222.0.67 () {56 vars in 1120 bytes} [Mon Apr 11 13:43:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:43:24.471058 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b931dd-35d7-47cc-8cca-5a57bc26a8d5 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:24.474811 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702c564-50d3-471f-8be0-2179bcd18dc1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:24.564695 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b931dd-35d7-47cc-8cca-5a57bc26a8d5 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:24.568098 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702c564-50d3-471f-8be0-2179bcd18dc1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:24.597734 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71500d5b-5b8d-4f6d-a314-ca7719259f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:24.598590 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71500d5b-5b8d-4f6d-a314-ca7719259f5d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:24.598875 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71500d5b-5b8d-4f6d-a314-ca7719259f5d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:24.599148 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71500d5b-5b8d-4f6d-a314-ca7719259f5d None admin] PATH_INFO: `/v3/projects/33a25a6ff5604c4f95de10d22c1fcba9` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:24.600307 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71500d5b-5b8d-4f6d-a314-ca7719259f5d None admin] RBAC: Authorizing `identity:get_project(project_id=33a25a6ff5604c4f95de10d22c1fcba9)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:24.601430 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0a42c-d098-497e-846f-fb9b53f7d36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:24.602026 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71500d5b-5b8d-4f6d-a314-ca7719259f5d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:24.602137 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0a42c-d098-497e-846f-fb9b53f7d36d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:24.602357 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0a42c-d098-497e-846f-fb9b53f7d36d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:24.602627 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0a42c-d098-497e-846f-fb9b53f7d36d None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:24.603359 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0a42c-d098-497e-846f-fb9b53f7d36d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:24.603683 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0a42c-d098-497e-846f-fb9b53f7d36d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:24.603775 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 548/1094] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:43:24 2022] GET /identity/v3/projects/33a25a6ff5604c4f95de10d22c1fcba9 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:24.605056 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0a42c-d098-497e-846f-fb9b53f7d36d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:24.609620 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71500d5b-5b8d-4f6d-a314-ca7719259f5d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:24.612940 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 547/1095] 10.222.0.67 () {56 vars in 1115 bytes} [Mon Apr 11 13:43:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:24.618281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0a42c-d098-497e-846f-fb9b53f7d36d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:24.701914 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71500d5b-5b8d-4f6d-a314-ca7719259f5d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:24.710300 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0a42c-d098-497e-846f-fb9b53f7d36d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:24.735330 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680e985-60fe-4308-a996-69c028327a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:24.736095 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680e985-60fe-4308-a996-69c028327a1d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:24.736379 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680e985-60fe-4308-a996-69c028327a1d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:24.736659 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680e985-60fe-4308-a996-69c028327a1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:24.737479 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680e985-60fe-4308-a996-69c028327a1d None admin] RBAC: Adding query filter params (role.id=e3333fcf22b040e3a1f0bfbfe657cffa, scope.project.id=33a25a6ff5604c4f95de10d22c1fcba9, user.id=97bc749e5dfd4923919265e783cdbed8) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:24.737788 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680e985-60fe-4308-a996-69c028327a1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:24.739229 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680e985-60fe-4308-a996-69c028327a1d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:24.741893 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c1517-8f47-4674-ad6d-da54061a660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:24.742678 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c1517-8f47-4674-ad6d-da54061a660d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:24.742964 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c1517-8f47-4674-ad6d-da54061a660d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:24.743239 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c1517-8f47-4674-ad6d-da54061a660d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:24.745010 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 549/1096] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:43:24 2022] GET /identity/v3/role_assignments?user.id=97bc749e5dfd4923919265e783cdbed8&scope.project.id=33a25a6ff5604c4f95de10d22c1fcba9&role.id=e3333fcf22b040e3a1f0bfbfe657cffa => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:24.754014 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c1517-8f47-4674-ad6d-da54061a660d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:24.755500 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c1517-8f47-4674-ad6d-da54061a660d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:24.773429 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-384c1517-8f47-4674-ad6d-da54061a660d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:43:24.774705 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 548/1097] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:43:24.780945 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680e985-60fe-4308-a996-69c028327a1d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:24.882741 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680e985-60fe-4308-a996-69c028327a1d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:24.917704 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ee784-d9be-4c4c-b803-488a18dd3782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:24.918375 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ee784-d9be-4c4c-b803-488a18dd3782 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:24.918654 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ee784-d9be-4c4c-b803-488a18dd3782 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:24.919596 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ee784-d9be-4c4c-b803-488a18dd3782 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:24.920361 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ee784-d9be-4c4c-b803-488a18dd3782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:24.920667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ee784-d9be-4c4c-b803-488a18dd3782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:24.922057 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ee784-d9be-4c4c-b803-488a18dd3782 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:24.933898 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 550/1098] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:24.940548 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c1517-8f47-4674-ad6d-da54061a660d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:25.036238 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c1517-8f47-4674-ad6d-da54061a660d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:25.067798 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527d76c-de95-4613-b1d5-bdec6b0a630d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:25.068579 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527d76c-de95-4613-b1d5-bdec6b0a630d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:25.068856 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527d76c-de95-4613-b1d5-bdec6b0a630d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:25.069126 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527d76c-de95-4613-b1d5-bdec6b0a630d None admin] PATH_INFO: `/v3/users/nova` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:25.076490 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527d76c-de95-4613-b1d5-bdec6b0a630d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:25.077903 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527d76c-de95-4613-b1d5-bdec6b0a630d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:25.090836 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-e527d76c-de95-4613-b1d5-bdec6b0a630d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 13:43:25.092019 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 549/1099] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Apr 11 13:43:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:25.098856 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ee784-d9be-4c4c-b803-488a18dd3782 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:25.194029 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ee784-d9be-4c4c-b803-488a18dd3782 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:25.226664 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02233c81-f430-4f62-8ca9-217e01ca999f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:25.227328 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02233c81-f430-4f62-8ca9-217e01ca999f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:25.227612 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02233c81-f430-4f62-8ca9-217e01ca999f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:25.227916 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02233c81-f430-4f62-8ca9-217e01ca999f None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:25.228753 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02233c81-f430-4f62-8ca9-217e01ca999f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:25.229070 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02233c81-f430-4f62-8ca9-217e01ca999f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:25.230507 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02233c81-f430-4f62-8ca9-217e01ca999f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:25.247267 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 551/1100] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Apr 11 13:43:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:25.253173 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527d76c-de95-4613-b1d5-bdec6b0a630d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:25.347713 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527d76c-de95-4613-b1d5-bdec6b0a630d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:25.378340 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65849df-2ec1-4070-b947-419b8336a54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:25.378987 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65849df-2ec1-4070-b947-419b8336a54b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:25.379272 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65849df-2ec1-4070-b947-419b8336a54b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:25.379546 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65849df-2ec1-4070-b947-419b8336a54b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:25.442520 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65849df-2ec1-4070-b947-419b8336a54b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:25.444021 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65849df-2ec1-4070-b947-419b8336a54b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:25.538177 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 550/1101] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:43:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:43:25.543853 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02233c81-f430-4f62-8ca9-217e01ca999f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:25.638519 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02233c81-f430-4f62-8ca9-217e01ca999f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:25.669631 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d42bc-1aef-4e5f-aa00-d9e8fd2b8ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:25.670415 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d42bc-1aef-4e5f-aa00-d9e8fd2b8ea1 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:25.670691 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d42bc-1aef-4e5f-aa00-d9e8fd2b8ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:25.670958 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d42bc-1aef-4e5f-aa00-d9e8fd2b8ea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:25.681097 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d42bc-1aef-4e5f-aa00-d9e8fd2b8ea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:25.682528 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d42bc-1aef-4e5f-aa00-d9e8fd2b8ea1 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:25.698791 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-d78d42bc-1aef-4e5f-aa00-d9e8fd2b8ea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:43:25.700168 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 552/1102] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:25.705682 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65849df-2ec1-4070-b947-419b8336a54b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:25.798553 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65849df-2ec1-4070-b947-419b8336a54b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:25.830364 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e17048-fe04-4374-a29e-7f40c4c4dfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:25.831028 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e17048-fe04-4374-a29e-7f40c4c4dfef None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:25.831313 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e17048-fe04-4374-a29e-7f40c4c4dfef None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:25.831586 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e17048-fe04-4374-a29e-7f40c4c4dfef None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:25.832336 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e17048-fe04-4374-a29e-7f40c4c4dfef None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:25.832640 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e17048-fe04-4374-a29e-7f40c4c4dfef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:25.833993 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e17048-fe04-4374-a29e-7f40c4c4dfef None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:25.845348 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 551/1103] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:25.850897 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d42bc-1aef-4e5f-aa00-d9e8fd2b8ea1 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:25.946925 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d42bc-1aef-4e5f-aa00-d9e8fd2b8ea1 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:25.979127 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9568f-b1ab-4c35-824a-6ba906097b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:25.979951 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9568f-b1ab-4c35-824a-6ba906097b57 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:25.980238 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9568f-b1ab-4c35-824a-6ba906097b57 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:25.980515 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9568f-b1ab-4c35-824a-6ba906097b57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:25.987317 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9568f-b1ab-4c35-824a-6ba906097b57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:25.989271 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9568f-b1ab-4c35-824a-6ba906097b57 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:26.003445 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-60a9568f-b1ab-4c35-824a-6ba906097b57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:43:26.005620 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 553/1104] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:43:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:26.010748 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e17048-fe04-4374-a29e-7f40c4c4dfef None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:26.105528 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e17048-fe04-4374-a29e-7f40c4c4dfef None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:26.137206 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ff9a5-4afe-4129-b71f-9051d10df2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:26.137852 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ff9a5-4afe-4129-b71f-9051d10df2f2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:26.138133 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ff9a5-4afe-4129-b71f-9051d10df2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:26.138404 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ff9a5-4afe-4129-b71f-9051d10df2f2 None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:26.139174 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ff9a5-4afe-4129-b71f-9051d10df2f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:26.139478 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ff9a5-4afe-4129-b71f-9051d10df2f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:26.140968 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ff9a5-4afe-4129-b71f-9051d10df2f2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:26.152155 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 552/1105] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:43:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:26.158249 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9568f-b1ab-4c35-824a-6ba906097b57 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:26.254982 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9568f-b1ab-4c35-824a-6ba906097b57 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:26.286011 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f00adc-3bb7-4c7b-a08c-643934f605b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:26.286659 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00adc-3bb7-4c7b-a08c-643934f605b6 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:26.286942 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00adc-3bb7-4c7b-a08c-643934f605b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:26.287217 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f00adc-3bb7-4c7b-a08c-643934f605b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:26.288081 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f00adc-3bb7-4c7b-a08c-643934f605b6 None admin] RBAC: Adding query filter params (role.id=d761d545536542028c82c9ceb096b437, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=fedd2314dc594bcba749bf7b0d1e50fb) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:26.288412 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f00adc-3bb7-4c7b-a08c-643934f605b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:26.289863 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f00adc-3bb7-4c7b-a08c-643934f605b6 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:26.295522 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 554/1106] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:43:26 2022] GET /identity/v3/role_assignments?user.id=fedd2314dc594bcba749bf7b0d1e50fb&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=d761d545536542028c82c9ceb096b437 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:27.084044 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9498db2-fa47-4777-a58a-a207f98811a3 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:27.084554 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9498db2-fa47-4777-a58a-a207f98811a3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:27.084669 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9498db2-fa47-4777-a58a-a207f98811a3 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:27.086004 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 553/1107] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:27.091119 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adb9f7-e5b4-49e2-ac51-e81e3b05157e None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:27.091560 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adb9f7-e5b4-49e2-ac51-e81e3b05157e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:27.091865 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adb9f7-e5b4-49e2-ac51-e81e3b05157e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:27.109125 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-10adb9f7-e5b4-49e2-ac51-e81e3b05157e None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:27.110329 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-10adb9f7-e5b4-49e2-ac51-e81e3b05157e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:27.175011 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 555/1108] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:27.201206 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9498db2-fa47-4777-a58a-a207f98811a3 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:27.296662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9498db2-fa47-4777-a58a-a207f98811a3 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:27.328589 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc21ef7-ca6a-46fc-a323-49d8adf048d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:27.329357 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc21ef7-ca6a-46fc-a323-49d8adf048d1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:27.329638 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc21ef7-ca6a-46fc-a323-49d8adf048d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:27.329912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc21ef7-ca6a-46fc-a323-49d8adf048d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:27.331070 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc21ef7-ca6a-46fc-a323-49d8adf048d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:27.332519 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc21ef7-ca6a-46fc-a323-49d8adf048d1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:27.334164 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 554/1109] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:43:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:27.339795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adb9f7-e5b4-49e2-ac51-e81e3b05157e None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:27.432872 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adb9f7-e5b4-49e2-ac51-e81e3b05157e None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:27.464116 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c1d35-454e-4507-a6b0-bc7ec80cf579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:27.464777 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c1d35-454e-4507-a6b0-bc7ec80cf579 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:27.465056 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c1d35-454e-4507-a6b0-bc7ec80cf579 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:27.465329 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c1d35-454e-4507-a6b0-bc7ec80cf579 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:27.466040 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c1d35-454e-4507-a6b0-bc7ec80cf579 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:27.467458 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c1d35-454e-4507-a6b0-bc7ec80cf579 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:27.488014 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 556/1110] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Apr 11 13:43:27 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:43:29.814563 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc60226-843b-4359-aa9a-a41fc50b7d86 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:29.815055 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc60226-843b-4359-aa9a-a41fc50b7d86 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:29.815055 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc60226-843b-4359-aa9a-a41fc50b7d86 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:29.816535 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 555/1111] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:29.821847 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f124d8-7823-460f-8290-803b3903e517 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:29.822398 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f124d8-7823-460f-8290-803b3903e517 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:29.822398 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f124d8-7823-460f-8290-803b3903e517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:29.839349 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-70f124d8-7823-460f-8290-803b3903e517 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:29.840557 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-70f124d8-7823-460f-8290-803b3903e517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:29.902123 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 557/1112] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:29.927406 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc60226-843b-4359-aa9a-a41fc50b7d86 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:30.023407 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc60226-843b-4359-aa9a-a41fc50b7d86 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:30.057548 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac69e1-1ffd-470d-98ad-f3a41fa6bced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:30.058397 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac69e1-1ffd-470d-98ad-f3a41fa6bced None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:30.058673 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac69e1-1ffd-470d-98ad-f3a41fa6bced None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:30.058943 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac69e1-1ffd-470d-98ad-f3a41fa6bced None admin] PATH_INFO: `/v3/roles/fbb7398610b649859d123d0938aa8e75` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:30.060430 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac69e1-1ffd-470d-98ad-f3a41fa6bced None admin] RBAC: Authorizing `identity:get_role(role_id=fbb7398610b649859d123d0938aa8e75)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:30.061804 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac69e1-1ffd-470d-98ad-f3a41fa6bced None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:30.063358 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 556/1113] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:43:29 2022] GET /identity/v3/roles/fbb7398610b649859d123d0938aa8e75 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:30.069274 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f124d8-7823-460f-8290-803b3903e517 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:30.164593 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f124d8-7823-460f-8290-803b3903e517 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:30.196468 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0e11b-efe9-49a8-98d1-2ec199684c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:30.197333 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0e11b-efe9-49a8-98d1-2ec199684c82 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:30.197617 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0e11b-efe9-49a8-98d1-2ec199684c82 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:30.197893 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0e11b-efe9-49a8-98d1-2ec199684c82 None admin] PATH_INFO: `/v3/users/d6874738038f409c8d37cc982cb0c5f0` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:30.210872 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0e11b-efe9-49a8-98d1-2ec199684c82 None admin] RBAC: Authorizing `identity:get_user(user_id=d6874738038f409c8d37cc982cb0c5f0)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:30.212358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0e11b-efe9-49a8-98d1-2ec199684c82 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:30.213989 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 558/1114] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:43:30 2022] GET /identity/v3/users/d6874738038f409c8d37cc982cb0c5f0 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:30.220011 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac69e1-1ffd-470d-98ad-f3a41fa6bced None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:30.311764 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac69e1-1ffd-470d-98ad-f3a41fa6bced None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:30.343654 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29991c-b3cd-4c48-9645-545c3a7a7ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:30.344262 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29991c-b3cd-4c48-9645-545c3a7a7ad1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:30.344540 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29991c-b3cd-4c48-9645-545c3a7a7ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:30.344816 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29991c-b3cd-4c48-9645-545c3a7a7ad1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:30.410029 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29991c-b3cd-4c48-9645-545c3a7a7ad1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:30.411476 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29991c-b3cd-4c48-9645-545c3a7a7ad1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:30.503698 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 557/1115] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:43:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 13:43:30.509807 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0e11b-efe9-49a8-98d1-2ec199684c82 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:30.602948 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0e11b-efe9-49a8-98d1-2ec199684c82 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:30.635079 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b9698-fc25-4d61-ba47-ac6efc32f294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:30.635950 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b9698-fc25-4d61-ba47-ac6efc32f294 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:30.636230 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b9698-fc25-4d61-ba47-ac6efc32f294 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:30.636499 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b9698-fc25-4d61-ba47-ac6efc32f294 None admin] PATH_INFO: `/v3/projects/33a25a6ff5604c4f95de10d22c1fcba9` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:30.637659 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b9698-fc25-4d61-ba47-ac6efc32f294 None admin] RBAC: Authorizing `identity:get_project(project_id=33a25a6ff5604c4f95de10d22c1fcba9)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:30.639086 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b9698-fc25-4d61-ba47-ac6efc32f294 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:30.640931 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 559/1116] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:43:30 2022] GET /identity/v3/projects/33a25a6ff5604c4f95de10d22c1fcba9 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:30.646938 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29991c-b3cd-4c48-9645-545c3a7a7ad1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:30.740353 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29991c-b3cd-4c48-9645-545c3a7a7ad1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:30.772227 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5f3d0-9d4b-41e9-baaa-be98fe8af9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:30.772870 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5f3d0-9d4b-41e9-baaa-be98fe8af9c2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:30.773153 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5f3d0-9d4b-41e9-baaa-be98fe8af9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:30.773427 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5f3d0-9d4b-41e9-baaa-be98fe8af9c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:30.775273 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5f3d0-9d4b-41e9-baaa-be98fe8af9c2 None admin] RBAC: Adding query filter params (role.id=fbb7398610b649859d123d0938aa8e75, scope.project.id=33a25a6ff5604c4f95de10d22c1fcba9, user.id=d6874738038f409c8d37cc982cb0c5f0) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:30.775586 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5f3d0-9d4b-41e9-baaa-be98fe8af9c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:30.777024 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5f3d0-9d4b-41e9-baaa-be98fe8af9c2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:30.783526 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 558/1117] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:43:30 2022] GET /identity/v3/role_assignments?user.id=d6874738038f409c8d37cc982cb0c5f0&scope.project.id=33a25a6ff5604c4f95de10d22c1fcba9&role.id=fbb7398610b649859d123d0938aa8e75 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:33.051742 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89058407-1d4a-421a-8aa7-6c9511d1314c None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:33.052266 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89058407-1d4a-421a-8aa7-6c9511d1314c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:33.052266 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89058407-1d4a-421a-8aa7-6c9511d1314c None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:33.053680 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 560/1118] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:33.058953 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02ea3a-110f-4a01-baa1-ce6875ffa745 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:33.059366 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02ea3a-110f-4a01-baa1-ce6875ffa745 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:33.059512 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02ea3a-110f-4a01-baa1-ce6875ffa745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:33.076030 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-0c02ea3a-110f-4a01-baa1-ce6875ffa745 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:33.077195 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0c02ea3a-110f-4a01-baa1-ce6875ffa745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:33.139473 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 559/1119] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:33.162550 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89058407-1d4a-421a-8aa7-6c9511d1314c None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:33.258508 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89058407-1d4a-421a-8aa7-6c9511d1314c None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:33.290012 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95d2ef-645a-4b03-a621-3607bbc55e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:33.290845 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95d2ef-645a-4b03-a621-3607bbc55e3b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:33.291120 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95d2ef-645a-4b03-a621-3607bbc55e3b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:33.291387 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95d2ef-645a-4b03-a621-3607bbc55e3b None admin] PATH_INFO: `/v3/roles/fbb7398610b649859d123d0938aa8e75` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:33.292850 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95d2ef-645a-4b03-a621-3607bbc55e3b None admin] RBAC: Authorizing `identity:get_role(role_id=fbb7398610b649859d123d0938aa8e75)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:33.294216 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95d2ef-645a-4b03-a621-3607bbc55e3b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:33.295540 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 561/1120] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:43:33 2022] GET /identity/v3/roles/fbb7398610b649859d123d0938aa8e75 => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:33.302181 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02ea3a-110f-4a01-baa1-ce6875ffa745 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:33.393318 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02ea3a-110f-4a01-baa1-ce6875ffa745 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:33.426098 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e148b25-d67e-4bce-a230-899be161496b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:33.426960 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e148b25-d67e-4bce-a230-899be161496b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:33.427240 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e148b25-d67e-4bce-a230-899be161496b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:33.427512 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e148b25-d67e-4bce-a230-899be161496b None admin] PATH_INFO: `/v3/users/d6874738038f409c8d37cc982cb0c5f0` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:33.428694 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e148b25-d67e-4bce-a230-899be161496b None admin] RBAC: Authorizing `identity:get_user(user_id=d6874738038f409c8d37cc982cb0c5f0)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:33.430099 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e148b25-d67e-4bce-a230-899be161496b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:33.431756 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 560/1121] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:43:33 2022] GET /identity/v3/users/d6874738038f409c8d37cc982cb0c5f0 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:33.437479 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95d2ef-645a-4b03-a621-3607bbc55e3b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:33.529590 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95d2ef-645a-4b03-a621-3607bbc55e3b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:33.562162 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5079d-3332-40ea-ad3d-e2a40970c3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:33.562954 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5079d-3332-40ea-ad3d-e2a40970c3fe None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:33.563227 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5079d-3332-40ea-ad3d-e2a40970c3fe None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:33.563497 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5079d-3332-40ea-ad3d-e2a40970c3fe None admin] PATH_INFO: `/v3/projects/33a25a6ff5604c4f95de10d22c1fcba9` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:33.564678 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5079d-3332-40ea-ad3d-e2a40970c3fe None admin] RBAC: Authorizing `identity:get_project(project_id=33a25a6ff5604c4f95de10d22c1fcba9)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:33.566093 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5079d-3332-40ea-ad3d-e2a40970c3fe None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:33.567759 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 562/1122] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:43:33 2022] GET /identity/v3/projects/33a25a6ff5604c4f95de10d22c1fcba9 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:33.575142 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e148b25-d67e-4bce-a230-899be161496b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:33.667984 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e148b25-d67e-4bce-a230-899be161496b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:33.699234 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadaec9-e437-4364-b594-e7ddb0720b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:33.700125 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadaec9-e437-4364-b594-e7ddb0720b7b None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:33.700405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadaec9-e437-4364-b594-e7ddb0720b7b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:33.700675 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadaec9-e437-4364-b594-e7ddb0720b7b None admin] PATH_INFO: `/v3/projects/33a25a6ff5604c4f95de10d22c1fcba9/users/d6874738038f409c8d37cc982cb0c5f0/roles/fbb7398610b649859d123d0938aa8e75` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:33.703369 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadaec9-e437-4364-b594-e7ddb0720b7b None admin] RBAC: Authorizing `identity:create_grant(project_id=33a25a6ff5604c4f95de10d22c1fcba9, user_id=d6874738038f409c8d37cc982cb0c5f0, role_id=fbb7398610b649859d123d0938aa8e75)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:33.704815 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadaec9-e437-4364-b594-e7ddb0720b7b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:33.716721 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 561/1123] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:43:33 2022] PUT /identity/v3/projects/33a25a6ff5604c4f95de10d22c1fcba9/users/d6874738038f409c8d37cc982cb0c5f0/roles/fbb7398610b649859d123d0938aa8e75 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:43:35.971181 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27658e20-44cd-4c5e-961b-2a1cc99b9ca1 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:35.971748 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27658e20-44cd-4c5e-961b-2a1cc99b9ca1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:35.971748 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27658e20-44cd-4c5e-961b-2a1cc99b9ca1 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:35.973104 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 563/1124] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:35.978272 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93379f05-044e-4796-8bce-0accfec0920a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:35.978678 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93379f05-044e-4796-8bce-0accfec0920a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:35.978835 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93379f05-044e-4796-8bce-0accfec0920a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:35.995337 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-93379f05-044e-4796-8bce-0accfec0920a None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:35.996539 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-93379f05-044e-4796-8bce-0accfec0920a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:36.059940 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 562/1125] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:36.086237 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27658e20-44cd-4c5e-961b-2a1cc99b9ca1 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:36.190389 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27658e20-44cd-4c5e-961b-2a1cc99b9ca1 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:36.222470 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f763261-ac83-4591-9e68-ce69bdb9a541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:36.223259 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f763261-ac83-4591-9e68-ce69bdb9a541 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:36.223543 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f763261-ac83-4591-9e68-ce69bdb9a541 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:36.223845 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f763261-ac83-4591-9e68-ce69bdb9a541 None admin] PATH_INFO: `/v3/roles/fbb7398610b649859d123d0938aa8e75` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:36.225306 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f763261-ac83-4591-9e68-ce69bdb9a541 None admin] RBAC: Authorizing `identity:get_role(role_id=fbb7398610b649859d123d0938aa8e75)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:36.226673 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f763261-ac83-4591-9e68-ce69bdb9a541 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:36.228065 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 564/1126] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:43:36 2022] GET /identity/v3/roles/fbb7398610b649859d123d0938aa8e75 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:36.234397 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93379f05-044e-4796-8bce-0accfec0920a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:36.325835 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93379f05-044e-4796-8bce-0accfec0920a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:36.357309 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cded2d6-1cd0-4a52-ba71-bd7e3965e44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:36.358158 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cded2d6-1cd0-4a52-ba71-bd7e3965e44a None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:36.358449 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cded2d6-1cd0-4a52-ba71-bd7e3965e44a None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:36.359321 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cded2d6-1cd0-4a52-ba71-bd7e3965e44a None admin] PATH_INFO: `/v3/users/d6874738038f409c8d37cc982cb0c5f0` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:36.360510 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cded2d6-1cd0-4a52-ba71-bd7e3965e44a None admin] RBAC: Authorizing `identity:get_user(user_id=d6874738038f409c8d37cc982cb0c5f0)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:36.361913 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cded2d6-1cd0-4a52-ba71-bd7e3965e44a None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:36.363496 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 563/1127] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:43:36 2022] GET /identity/v3/users/d6874738038f409c8d37cc982cb0c5f0 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:36.369080 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f763261-ac83-4591-9e68-ce69bdb9a541 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:36.461215 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f763261-ac83-4591-9e68-ce69bdb9a541 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:36.493154 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98662faf-56f8-48a7-ac80-9f6c1f2f2990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:36.493735 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98662faf-56f8-48a7-ac80-9f6c1f2f2990 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:36.494018 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98662faf-56f8-48a7-ac80-9f6c1f2f2990 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:36.494289 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98662faf-56f8-48a7-ac80-9f6c1f2f2990 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:36.555778 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98662faf-56f8-48a7-ac80-9f6c1f2f2990 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:36.557218 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98662faf-56f8-48a7-ac80-9f6c1f2f2990 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:36.647468 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 565/1128] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:43:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:43:36.653369 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cded2d6-1cd0-4a52-ba71-bd7e3965e44a None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:36.745048 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cded2d6-1cd0-4a52-ba71-bd7e3965e44a None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:36.776484 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee55956-51be-49ec-b47e-589268a2f798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:36.777319 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee55956-51be-49ec-b47e-589268a2f798 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:36.777596 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee55956-51be-49ec-b47e-589268a2f798 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:36.777868 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee55956-51be-49ec-b47e-589268a2f798 None admin] PATH_INFO: `/v3/projects/33a25a6ff5604c4f95de10d22c1fcba9` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:36.779007 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee55956-51be-49ec-b47e-589268a2f798 None admin] RBAC: Authorizing `identity:get_project(project_id=33a25a6ff5604c4f95de10d22c1fcba9)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:36.781052 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee55956-51be-49ec-b47e-589268a2f798 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:36.782701 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 564/1129] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:43:36 2022] GET /identity/v3/projects/33a25a6ff5604c4f95de10d22c1fcba9 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:36.788694 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98662faf-56f8-48a7-ac80-9f6c1f2f2990 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:36.881161 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98662faf-56f8-48a7-ac80-9f6c1f2f2990 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:36.914216 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46893f08-825c-45b6-8f10-ee5c6cdb3250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:36.914858 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46893f08-825c-45b6-8f10-ee5c6cdb3250 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:36.915142 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46893f08-825c-45b6-8f10-ee5c6cdb3250 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:36.915417 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46893f08-825c-45b6-8f10-ee5c6cdb3250 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:36.916272 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46893f08-825c-45b6-8f10-ee5c6cdb3250 None admin] RBAC: Adding query filter params (role.id=fbb7398610b649859d123d0938aa8e75, scope.project.id=33a25a6ff5604c4f95de10d22c1fcba9, user.id=d6874738038f409c8d37cc982cb0c5f0) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:36.916584 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46893f08-825c-45b6-8f10-ee5c6cdb3250 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:36.918057 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46893f08-825c-45b6-8f10-ee5c6cdb3250 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:36.923741 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 566/1130] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:43:36 2022] GET /identity/v3/role_assignments?user.id=d6874738038f409c8d37cc982cb0c5f0&scope.project.id=33a25a6ff5604c4f95de10d22c1fcba9&role.id=fbb7398610b649859d123d0938aa8e75 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:39.244004 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06c298-abd2-4870-8a65-6c2f89b639dc None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:39.244530 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06c298-abd2-4870-8a65-6c2f89b639dc None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:39.244643 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06c298-abd2-4870-8a65-6c2f89b639dc None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:39.245917 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 565/1131] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:39.251874 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49d02e-9e09-4a40-8232-7f8615da7387 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:39.252316 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49d02e-9e09-4a40-8232-7f8615da7387 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:39.252408 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49d02e-9e09-4a40-8232-7f8615da7387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:39.269094 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-1d49d02e-9e09-4a40-8232-7f8615da7387 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:39.270264 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1d49d02e-9e09-4a40-8232-7f8615da7387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:39.332317 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 567/1132] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:39.356091 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06c298-abd2-4870-8a65-6c2f89b639dc None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:39.450877 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06c298-abd2-4870-8a65-6c2f89b639dc None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:39.482242 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831346c-261c-4de6-b143-68bd6cfe0e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:39.483016 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831346c-261c-4de6-b143-68bd6cfe0e54 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:39.483479 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831346c-261c-4de6-b143-68bd6cfe0e54 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:39.483920 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831346c-261c-4de6-b143-68bd6cfe0e54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:39.485101 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831346c-261c-4de6-b143-68bd6cfe0e54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:39.486517 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831346c-261c-4de6-b143-68bd6cfe0e54 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:39.488151 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 566/1133] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:43:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:39.493936 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49d02e-9e09-4a40-8232-7f8615da7387 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:39.586883 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49d02e-9e09-4a40-8232-7f8615da7387 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:39.618871 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f268a-b5d6-4646-bd56-f290a71ddf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:39.619517 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f268a-b5d6-4646-bd56-f290a71ddf94 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:39.619824 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f268a-b5d6-4646-bd56-f290a71ddf94 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:39.620098 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f268a-b5d6-4646-bd56-f290a71ddf94 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:39.620807 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f268a-b5d6-4646-bd56-f290a71ddf94 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:39.622239 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f268a-b5d6-4646-bd56-f290a71ddf94 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:39.646505 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 568/1134] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Apr 11 13:43:39 2022] POST /identity/v3/projects => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:43:41.975121 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d68815-c593-4ce4-882e-f069a476505e None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:41.975670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d68815-c593-4ce4-882e-f069a476505e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:41.975764 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d68815-c593-4ce4-882e-f069a476505e None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:41.977060 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 567/1135] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:41.982281 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f240de-0a47-4090-b9f4-73daccd7f5b6 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:41.982658 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f240de-0a47-4090-b9f4-73daccd7f5b6 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:41.982841 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f240de-0a47-4090-b9f4-73daccd7f5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:41.999388 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-90f240de-0a47-4090-b9f4-73daccd7f5b6 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:42.000615 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-90f240de-0a47-4090-b9f4-73daccd7f5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:42.062474 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 569/1136] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:42.097722 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d68815-c593-4ce4-882e-f069a476505e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:42.201373 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d68815-c593-4ce4-882e-f069a476505e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:42.232877 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce2f80-0ba9-434c-8f7a-64d7f447b12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:42.233783 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce2f80-0ba9-434c-8f7a-64d7f447b12c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:42.234061 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce2f80-0ba9-434c-8f7a-64d7f447b12c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:42.234330 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce2f80-0ba9-434c-8f7a-64d7f447b12c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:42.235477 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce2f80-0ba9-434c-8f7a-64d7f447b12c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:42.236917 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce2f80-0ba9-434c-8f7a-64d7f447b12c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:42.238502 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 568/1137] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:43:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:42.244243 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f240de-0a47-4090-b9f4-73daccd7f5b6 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:42.335857 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f240de-0a47-4090-b9f4-73daccd7f5b6 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:42.366773 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f6a9f-28e6-4ce5-8265-048ed714fca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:42.367419 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f6a9f-28e6-4ce5-8265-048ed714fca0 None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:42.367730 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f6a9f-28e6-4ce5-8265-048ed714fca0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:42.368004 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f6a9f-28e6-4ce5-8265-048ed714fca0 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:42.368700 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f6a9f-28e6-4ce5-8265-048ed714fca0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:42.370125 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f6a9f-28e6-4ce5-8265-048ed714fca0 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:42.390710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 570/1138] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Apr 11 13:43:42 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:43:44.698460 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b167fc-7e57-4ca8-931a-bc14b3e2f88c None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:44.698958 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b167fc-7e57-4ca8-931a-bc14b3e2f88c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:44.698958 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b167fc-7e57-4ca8-931a-bc14b3e2f88c None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:44.700335 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 569/1139] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:44.706187 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a135ed8-b1d3-42a7-9b16-bfccc36caac2 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:44.706581 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a135ed8-b1d3-42a7-9b16-bfccc36caac2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:44.706740 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a135ed8-b1d3-42a7-9b16-bfccc36caac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:44.723276 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0a135ed8-b1d3-42a7-9b16-bfccc36caac2 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:44.724489 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0a135ed8-b1d3-42a7-9b16-bfccc36caac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:44.786992 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 571/1140] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:44.812880 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b167fc-7e57-4ca8-931a-bc14b3e2f88c None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:44.907853 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b167fc-7e57-4ca8-931a-bc14b3e2f88c None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:44.939787 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c1571-5277-4032-81ca-e1d1154eff40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:44.940596 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c1571-5277-4032-81ca-e1d1154eff40 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:44.940880 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c1571-5277-4032-81ca-e1d1154eff40 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:44.941164 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c1571-5277-4032-81ca-e1d1154eff40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:44.950938 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c1571-5277-4032-81ca-e1d1154eff40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:43:44.957795 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-595c1571-5277-4032-81ca-e1d1154eff40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:43:44.958948 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 570/1141] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:44.964989 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a135ed8-b1d3-42a7-9b16-bfccc36caac2 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:45.061456 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a135ed8-b1d3-42a7-9b16-bfccc36caac2 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:45.093710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e33603-849a-470e-a4ba-22c091f55e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:45.094368 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e33603-849a-470e-a4ba-22c091f55e37 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:45.094648 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e33603-849a-470e-a4ba-22c091f55e37 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:45.094922 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e33603-849a-470e-a4ba-22c091f55e37 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:45.095688 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e33603-849a-470e-a4ba-22c091f55e37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:45.095994 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e33603-849a-470e-a4ba-22c091f55e37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:45.097374 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e33603-849a-470e-a4ba-22c091f55e37 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:45.104927 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 572/1142] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:43:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:45.111341 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c1571-5277-4032-81ca-e1d1154eff40 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:45.206131 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c1571-5277-4032-81ca-e1d1154eff40 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:45.238152 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be914b-3537-4923-aae5-c444e2cb66c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:45.239003 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be914b-3537-4923-aae5-c444e2cb66c0 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:45.239286 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be914b-3537-4923-aae5-c444e2cb66c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:45.239565 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be914b-3537-4923-aae5-c444e2cb66c0 None admin] PATH_INFO: `/v3/users/ccdcae77b2da4e7facd8d9e0a3d4d947` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:45.252040 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be914b-3537-4923-aae5-c444e2cb66c0 None admin] RBAC: Authorizing `identity:get_user(user_id=ccdcae77b2da4e7facd8d9e0a3d4d947)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:45.253465 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be914b-3537-4923-aae5-c444e2cb66c0 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:45.255084 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 571/1143] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:43:45 2022] GET /identity/v3/users/ccdcae77b2da4e7facd8d9e0a3d4d947 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:43:45.260746 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e33603-849a-470e-a4ba-22c091f55e37 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:45.354672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e33603-849a-470e-a4ba-22c091f55e37 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:45.386094 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370e466-43b5-4376-8df0-b8c8f38dc241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:45.386734 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370e466-43b5-4376-8df0-b8c8f38dc241 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:45.387018 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370e466-43b5-4376-8df0-b8c8f38dc241 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:45.387295 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370e466-43b5-4376-8df0-b8c8f38dc241 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:45.450999 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370e466-43b5-4376-8df0-b8c8f38dc241 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:45.452502 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370e466-43b5-4376-8df0-b8c8f38dc241 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:45.543135 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 573/1144] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:43:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:43:45.549654 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be914b-3537-4923-aae5-c444e2cb66c0 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:45.641602 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be914b-3537-4923-aae5-c444e2cb66c0 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:45.673927 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c339a1c-e15f-40a1-9f70-a206869ffce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:45.674773 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c339a1c-e15f-40a1-9f70-a206869ffce2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:45.675055 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c339a1c-e15f-40a1-9f70-a206869ffce2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:45.675331 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c339a1c-e15f-40a1-9f70-a206869ffce2 None admin] PATH_INFO: `/v3/projects/002ee50339194710b0e8f73436cb7e06` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:45.676515 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c339a1c-e15f-40a1-9f70-a206869ffce2 None admin] RBAC: Authorizing `identity:get_project(project_id=002ee50339194710b0e8f73436cb7e06)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:45.677924 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c339a1c-e15f-40a1-9f70-a206869ffce2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:45.679573 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 572/1145] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:43:45 2022] GET /identity/v3/projects/002ee50339194710b0e8f73436cb7e06 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:45.685499 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370e466-43b5-4376-8df0-b8c8f38dc241 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:45.779182 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370e466-43b5-4376-8df0-b8c8f38dc241 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:45.811440 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26af875-6092-4d6e-af7c-fba463593c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:45.812067 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26af875-6092-4d6e-af7c-fba463593c6d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:45.812351 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26af875-6092-4d6e-af7c-fba463593c6d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:45.812626 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26af875-6092-4d6e-af7c-fba463593c6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:45.813449 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26af875-6092-4d6e-af7c-fba463593c6d None admin] RBAC: Adding query filter params (role.id=e3333fcf22b040e3a1f0bfbfe657cffa, scope.project.id=002ee50339194710b0e8f73436cb7e06, user.id=ccdcae77b2da4e7facd8d9e0a3d4d947) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:45.813763 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26af875-6092-4d6e-af7c-fba463593c6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:45.815202 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26af875-6092-4d6e-af7c-fba463593c6d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:45.820679 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 574/1146] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:43:45 2022] GET /identity/v3/role_assignments?user.id=ccdcae77b2da4e7facd8d9e0a3d4d947&scope.project.id=002ee50339194710b0e8f73436cb7e06&role.id=e3333fcf22b040e3a1f0bfbfe657cffa => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:48.086674 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2345e-9ce9-4637-9c47-921e95faac9f None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:48.087193 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2345e-9ce9-4637-9c47-921e95faac9f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:48.087284 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2345e-9ce9-4637-9c47-921e95faac9f None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:48.088718 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 573/1147] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:48.094553 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75462eb-be2e-4696-a7d2-c0db293b7d97 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:48.094991 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75462eb-be2e-4696-a7d2-c0db293b7d97 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:48.095116 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75462eb-be2e-4696-a7d2-c0db293b7d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:48.111766 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c75462eb-be2e-4696-a7d2-c0db293b7d97 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:48.112951 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c75462eb-be2e-4696-a7d2-c0db293b7d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:48.174809 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 575/1148] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:48.197932 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2345e-9ce9-4637-9c47-921e95faac9f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:48.293078 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2345e-9ce9-4637-9c47-921e95faac9f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:48.324459 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f95609-f734-4299-b954-93b5e3623de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:48.325240 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f95609-f734-4299-b954-93b5e3623de3 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:48.325519 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f95609-f734-4299-b954-93b5e3623de3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:48.325793 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f95609-f734-4299-b954-93b5e3623de3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:48.335878 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f95609-f734-4299-b954-93b5e3623de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:43:48.342946 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-42f95609-f734-4299-b954-93b5e3623de3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:43:48.344079 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 574/1149] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:43:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:48.351516 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75462eb-be2e-4696-a7d2-c0db293b7d97 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:48.444164 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75462eb-be2e-4696-a7d2-c0db293b7d97 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:48.475389 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b929ee-0591-49bf-8669-cbfe76bea2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:48.476075 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b929ee-0591-49bf-8669-cbfe76bea2c7 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:48.476357 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b929ee-0591-49bf-8669-cbfe76bea2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:48.476631 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b929ee-0591-49bf-8669-cbfe76bea2c7 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:48.477373 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b929ee-0591-49bf-8669-cbfe76bea2c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:48.477676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b929ee-0591-49bf-8669-cbfe76bea2c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:48.479047 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b929ee-0591-49bf-8669-cbfe76bea2c7 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:48.486630 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 576/1150] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:43:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:48.492515 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f95609-f734-4299-b954-93b5e3623de3 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:48.586533 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f95609-f734-4299-b954-93b5e3623de3 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:48.617596 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ac54a-9702-4aa3-a245-8db78da27ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:48.618392 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ac54a-9702-4aa3-a245-8db78da27ef1 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:48.618676 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ac54a-9702-4aa3-a245-8db78da27ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:48.618953 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ac54a-9702-4aa3-a245-8db78da27ef1 None admin] PATH_INFO: `/v3/users/ccdcae77b2da4e7facd8d9e0a3d4d947` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:48.620151 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ac54a-9702-4aa3-a245-8db78da27ef1 None admin] RBAC: Authorizing `identity:get_user(user_id=ccdcae77b2da4e7facd8d9e0a3d4d947)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:48.621566 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ac54a-9702-4aa3-a245-8db78da27ef1 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:48.623839 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 575/1151] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:43:48 2022] GET /identity/v3/users/ccdcae77b2da4e7facd8d9e0a3d4d947 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:48.629469 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b929ee-0591-49bf-8669-cbfe76bea2c7 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:48.722881 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b929ee-0591-49bf-8669-cbfe76bea2c7 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:48.754596 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439b50f-3a53-4748-9b89-535a653abb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:48.755431 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439b50f-3a53-4748-9b89-535a653abb72 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:48.755738 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439b50f-3a53-4748-9b89-535a653abb72 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:48.756010 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439b50f-3a53-4748-9b89-535a653abb72 None admin] PATH_INFO: `/v3/projects/002ee50339194710b0e8f73436cb7e06` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:48.757160 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439b50f-3a53-4748-9b89-535a653abb72 None admin] RBAC: Authorizing `identity:get_project(project_id=002ee50339194710b0e8f73436cb7e06)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:48.758582 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439b50f-3a53-4748-9b89-535a653abb72 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:48.760265 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 577/1152] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:43:48 2022] GET /identity/v3/projects/002ee50339194710b0e8f73436cb7e06 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:48.766189 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ac54a-9702-4aa3-a245-8db78da27ef1 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:48.858939 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ac54a-9702-4aa3-a245-8db78da27ef1 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:48.890308 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f91bb-ceaa-4b6f-b54e-5b33d85dfaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:48.891171 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f91bb-ceaa-4b6f-b54e-5b33d85dfaff None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:48.891452 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f91bb-ceaa-4b6f-b54e-5b33d85dfaff None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:48.891755 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f91bb-ceaa-4b6f-b54e-5b33d85dfaff None admin] PATH_INFO: `/v3/projects/002ee50339194710b0e8f73436cb7e06/users/ccdcae77b2da4e7facd8d9e0a3d4d947/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:48.893685 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f91bb-ceaa-4b6f-b54e-5b33d85dfaff None admin] RBAC: Authorizing `identity:create_grant(project_id=002ee50339194710b0e8f73436cb7e06, user_id=ccdcae77b2da4e7facd8d9e0a3d4d947, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:48.895099 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f91bb-ceaa-4b6f-b54e-5b33d85dfaff None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:48.908539 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 576/1153] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:43:48 2022] PUT /identity/v3/projects/002ee50339194710b0e8f73436cb7e06/users/ccdcae77b2da4e7facd8d9e0a3d4d947/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:43:51.163084 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df3a45-ddb6-431f-8b55-9da1ff09496a None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:51.163829 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df3a45-ddb6-431f-8b55-9da1ff09496a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:51.163829 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df3a45-ddb6-431f-8b55-9da1ff09496a None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:51.165085 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 578/1154] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:51.170146 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a89c4-0e3b-4dfb-bd30-c439db0d24d9 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:51.170584 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a89c4-0e3b-4dfb-bd30-c439db0d24d9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:51.170694 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a89c4-0e3b-4dfb-bd30-c439db0d24d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:51.187588 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-576a89c4-0e3b-4dfb-bd30-c439db0d24d9 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:51.189103 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-576a89c4-0e3b-4dfb-bd30-c439db0d24d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:51.251856 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 577/1155] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:51.276909 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df3a45-ddb6-431f-8b55-9da1ff09496a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:51.370171 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df3a45-ddb6-431f-8b55-9da1ff09496a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:51.401913 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e0dbd-e27a-4d18-aa63-e9043db55bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:51.402692 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e0dbd-e27a-4d18-aa63-e9043db55bdd None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:51.402970 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e0dbd-e27a-4d18-aa63-e9043db55bdd None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:51.403240 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e0dbd-e27a-4d18-aa63-e9043db55bdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:51.413410 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e0dbd-e27a-4d18-aa63-e9043db55bdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:43:51.420348 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-b99e0dbd-e27a-4d18-aa63-e9043db55bdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:43:51.421508 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 579/1156] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:43:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:51.427574 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a89c4-0e3b-4dfb-bd30-c439db0d24d9 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:51.519954 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a89c4-0e3b-4dfb-bd30-c439db0d24d9 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:51.551393 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e809a6-90e1-493a-8d2d-78a80cba27f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:51.552202 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e809a6-90e1-493a-8d2d-78a80cba27f7 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:51.552488 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e809a6-90e1-493a-8d2d-78a80cba27f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:51.552766 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e809a6-90e1-493a-8d2d-78a80cba27f7 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:51.553524 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e809a6-90e1-493a-8d2d-78a80cba27f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:51.553821 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e809a6-90e1-493a-8d2d-78a80cba27f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:51.555182 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e809a6-90e1-493a-8d2d-78a80cba27f7 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:51.563964 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 578/1157] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:43:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:51.569947 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e0dbd-e27a-4d18-aa63-e9043db55bdd None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:51.661509 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e0dbd-e27a-4d18-aa63-e9043db55bdd None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:51.693676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e594c78-b575-4023-9bad-59c1c3d49726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:51.694470 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e594c78-b575-4023-9bad-59c1c3d49726 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:51.694748 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e594c78-b575-4023-9bad-59c1c3d49726 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:51.695019 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e594c78-b575-4023-9bad-59c1c3d49726 None admin] PATH_INFO: `/v3/users/ccdcae77b2da4e7facd8d9e0a3d4d947` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:51.696198 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e594c78-b575-4023-9bad-59c1c3d49726 None admin] RBAC: Authorizing `identity:get_user(user_id=ccdcae77b2da4e7facd8d9e0a3d4d947)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:51.697618 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e594c78-b575-4023-9bad-59c1c3d49726 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:51.699182 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 580/1158] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:43:51 2022] GET /identity/v3/users/ccdcae77b2da4e7facd8d9e0a3d4d947 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:51.704983 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e809a6-90e1-493a-8d2d-78a80cba27f7 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:51.797778 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e809a6-90e1-493a-8d2d-78a80cba27f7 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:51.829352 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88aee9-64d7-4ad1-8b97-6a8b02469085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:51.829981 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88aee9-64d7-4ad1-8b97-6a8b02469085 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:51.830263 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88aee9-64d7-4ad1-8b97-6a8b02469085 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:51.830539 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88aee9-64d7-4ad1-8b97-6a8b02469085 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:51.892727 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88aee9-64d7-4ad1-8b97-6a8b02469085 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:51.894159 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88aee9-64d7-4ad1-8b97-6a8b02469085 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:51.985251 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 579/1159] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:43:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:43:51.990961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e594c78-b575-4023-9bad-59c1c3d49726 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:52.083345 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e594c78-b575-4023-9bad-59c1c3d49726 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:52.115330 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e86d86-6037-4d59-b775-40ed381d1c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:52.116206 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e86d86-6037-4d59-b775-40ed381d1c14 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:52.116490 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e86d86-6037-4d59-b775-40ed381d1c14 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:52.116762 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e86d86-6037-4d59-b775-40ed381d1c14 None admin] PATH_INFO: `/v3/projects/002ee50339194710b0e8f73436cb7e06` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:52.117924 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e86d86-6037-4d59-b775-40ed381d1c14 None admin] RBAC: Authorizing `identity:get_project(project_id=002ee50339194710b0e8f73436cb7e06)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:52.119357 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e86d86-6037-4d59-b775-40ed381d1c14 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:52.121646 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 581/1160] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:43:51 2022] GET /identity/v3/projects/002ee50339194710b0e8f73436cb7e06 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:52.128344 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88aee9-64d7-4ad1-8b97-6a8b02469085 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:52.220573 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88aee9-64d7-4ad1-8b97-6a8b02469085 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:52.252674 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413ef35-55fd-49bd-9a25-7033d6b3d6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:52.253263 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413ef35-55fd-49bd-9a25-7033d6b3d6de None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:52.253546 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413ef35-55fd-49bd-9a25-7033d6b3d6de None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:52.253823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413ef35-55fd-49bd-9a25-7033d6b3d6de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:52.254643 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413ef35-55fd-49bd-9a25-7033d6b3d6de None admin] RBAC: Adding query filter params (role.id=e3333fcf22b040e3a1f0bfbfe657cffa, scope.project.id=002ee50339194710b0e8f73436cb7e06, user.id=ccdcae77b2da4e7facd8d9e0a3d4d947) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:52.254953 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413ef35-55fd-49bd-9a25-7033d6b3d6de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:52.256397 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413ef35-55fd-49bd-9a25-7033d6b3d6de None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:52.261928 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 580/1161] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:43:52 2022] GET /identity/v3/role_assignments?user.id=ccdcae77b2da4e7facd8d9e0a3d4d947&scope.project.id=002ee50339194710b0e8f73436cb7e06&role.id=e3333fcf22b040e3a1f0bfbfe657cffa => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:54.570557 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc289a6-8ab1-4dfa-b838-27325b6b45c6 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:54.571108 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc289a6-8ab1-4dfa-b838-27325b6b45c6 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:54.571108 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc289a6-8ab1-4dfa-b838-27325b6b45c6 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:54.572510 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 582/1162] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:54.578048 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e77413-acd5-42ee-bc1e-e6bde188e5b2 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:54.578439 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e77413-acd5-42ee-bc1e-e6bde188e5b2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:54.578608 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e77413-acd5-42ee-bc1e-e6bde188e5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:54.595130 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-b8e77413-acd5-42ee-bc1e-e6bde188e5b2 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:54.596310 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b8e77413-acd5-42ee-bc1e-e6bde188e5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:54.658043 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 581/1163] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:54.679392 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc289a6-8ab1-4dfa-b838-27325b6b45c6 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:54.774948 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc289a6-8ab1-4dfa-b838-27325b6b45c6 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:54.806946 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3269e8f-150e-44c8-bc6d-5d214417378a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:54.807577 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3269e8f-150e-44c8-bc6d-5d214417378a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:54.807889 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3269e8f-150e-44c8-bc6d-5d214417378a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:54.808168 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3269e8f-150e-44c8-bc6d-5d214417378a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:54.870529 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3269e8f-150e-44c8-bc6d-5d214417378a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:54.872010 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3269e8f-150e-44c8-bc6d-5d214417378a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:55.086440 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 583/1164] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:43:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:43:55.093751 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e77413-acd5-42ee-bc1e-e6bde188e5b2 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:55.184444 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e77413-acd5-42ee-bc1e-e6bde188e5b2 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:55.217220 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff052bb8-9394-4cc9-b333-d4f2305076e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:55.218005 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff052bb8-9394-4cc9-b333-d4f2305076e5 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:55.218288 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff052bb8-9394-4cc9-b333-d4f2305076e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:55.218561 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff052bb8-9394-4cc9-b333-d4f2305076e5 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:55.224891 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff052bb8-9394-4cc9-b333-d4f2305076e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:55.226318 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff052bb8-9394-4cc9-b333-d4f2305076e5 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:55.239187 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-ff052bb8-9394-4cc9-b333-d4f2305076e5 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 11 13:43:55.240343 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 582/1165] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Apr 11 13:43:55 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:43:55.246139 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3269e8f-150e-44c8-bc6d-5d214417378a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:55.339137 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3269e8f-150e-44c8-bc6d-5d214417378a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:55.370375 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea3bec-ef59-4c12-a2fb-c429b064e137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:55.371019 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea3bec-ef59-4c12-a2fb-c429b064e137 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:55.371300 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea3bec-ef59-4c12-a2fb-c429b064e137 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:55.371574 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea3bec-ef59-4c12-a2fb-c429b064e137 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:55.372475 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea3bec-ef59-4c12-a2fb-c429b064e137 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:43:55.372841 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea3bec-ef59-4c12-a2fb-c429b064e137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:55.374206 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea3bec-ef59-4c12-a2fb-c429b064e137 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:55.381141 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 584/1166] 10.222.0.67 () {56 vars in 1115 bytes} [Mon Apr 11 13:43:55 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:43:57.664913 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16b7ce-5070-4397-b331-377a77717c85 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:57.665422 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16b7ce-5070-4397-b331-377a77717c85 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:57.665422 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16b7ce-5070-4397-b331-377a77717c85 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:57.666761 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 583/1167] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:43:57.672253 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00b1b3-5006-4413-94bc-54411ec5d849 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:57.672685 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00b1b3-5006-4413-94bc-54411ec5d849 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:57.672789 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00b1b3-5006-4413-94bc-54411ec5d849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:57.688777 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-fc00b1b3-5006-4413-94bc-54411ec5d849 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:43:57.689932 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fc00b1b3-5006-4413-94bc-54411ec5d849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:43:57.751497 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 585/1168] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:43:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:43:57.776064 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16b7ce-5070-4397-b331-377a77717c85 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:43:57.871429 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16b7ce-5070-4397-b331-377a77717c85 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:43:57.902863 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98068e-9657-47c4-926f-c7e536c9cebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:43:57.903790 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98068e-9657-47c4-926f-c7e536c9cebb None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:43:57.904054 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98068e-9657-47c4-926f-c7e536c9cebb None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:43:57.904328 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98068e-9657-47c4-926f-c7e536c9cebb None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:43:57.905055 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98068e-9657-47c4-926f-c7e536c9cebb None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:43:57.906414 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98068e-9657-47c4-926f-c7e536c9cebb None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:43:57.921236 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 584/1169] 10.222.0.67 () {60 vars in 1138 bytes} [Mon Apr 11 13:43:57 2022] POST /identity/v3/domains => generated 267 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:44:00.198716 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831ed90-9bfa-4a95-ab0f-bd163d1864d2 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:00.199276 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831ed90-9bfa-4a95-ab0f-bd163d1864d2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:00.199276 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831ed90-9bfa-4a95-ab0f-bd163d1864d2 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:00.200805 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 586/1170] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:44:00.205989 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77e5d2-53d9-4b5a-8c2f-11a8602fea6f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:00.206421 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77e5d2-53d9-4b5a-8c2f-11a8602fea6f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:00.206554 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77e5d2-53d9-4b5a-8c2f-11a8602fea6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:00.224009 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-ff77e5d2-53d9-4b5a-8c2f-11a8602fea6f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:44:00.226038 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ff77e5d2-53d9-4b5a-8c2f-11a8602fea6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:44:00.294743 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 585/1171] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:44:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:44:00.319324 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831ed90-9bfa-4a95-ab0f-bd163d1864d2 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:44:00.413402 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831ed90-9bfa-4a95-ab0f-bd163d1864d2 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:44:00.445605 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca3135-f37e-4073-9436-b08047b62a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:44:00.446447 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca3135-f37e-4073-9436-b08047b62a66 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:00.446727 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca3135-f37e-4073-9436-b08047b62a66 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:00.447000 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca3135-f37e-4073-9436-b08047b62a66 None admin] PATH_INFO: `/v3/domains/c933829dff65481c96001b9246b8f052` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:00.456861 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca3135-f37e-4073-9436-b08047b62a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c933829dff65481c96001b9246b8f052)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:44:00.458248 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca3135-f37e-4073-9436-b08047b62a66 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:44:00.459898 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 587/1172] 10.222.0.67 () {56 vars in 1183 bytes} [Mon Apr 11 13:44:00 2022] GET /identity/v3/domains/c933829dff65481c96001b9246b8f052 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:44:00.466363 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77e5d2-53d9-4b5a-8c2f-11a8602fea6f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:44:00.560430 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77e5d2-53d9-4b5a-8c2f-11a8602fea6f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:44:00.593173 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700f126-f0ee-49c9-b07e-fb5132ba33b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:44:00.593830 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700f126-f0ee-49c9-b07e-fb5132ba33b3 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:00.594116 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700f126-f0ee-49c9-b07e-fb5132ba33b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:00.594394 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700f126-f0ee-49c9-b07e-fb5132ba33b3 None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:00.595110 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700f126-f0ee-49c9-b07e-fb5132ba33b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:44:00.596575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2700f126-f0ee-49c9-b07e-fb5132ba33b3 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:44:00.619719 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 586/1173] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Apr 11 13:44:00 2022] POST /identity/v3/projects => generated 361 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:44:02.932806 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156078f1-ffd2-4975-b0d2-ab8ed4b123f3 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:02.933338 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156078f1-ffd2-4975-b0d2-ab8ed4b123f3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:02.933338 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156078f1-ffd2-4975-b0d2-ab8ed4b123f3 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:02.934837 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 588/1174] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:44:02.940078 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e92ba-e847-4965-863e-c2599df7a8bd None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:02.940477 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e92ba-e847-4965-863e-c2599df7a8bd None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:02.940641 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e92ba-e847-4965-863e-c2599df7a8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:02.957544 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-3a5e92ba-e847-4965-863e-c2599df7a8bd None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:44:02.958711 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3a5e92ba-e847-4965-863e-c2599df7a8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:44:03.020445 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 587/1175] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:44:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:44:03.047134 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156078f1-ffd2-4975-b0d2-ab8ed4b123f3 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:44:03.141942 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156078f1-ffd2-4975-b0d2-ab8ed4b123f3 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:44:03.173316 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf9bb5-4f67-498d-9920-90c1d0dbbbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:44:03.174154 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf9bb5-4f67-498d-9920-90c1d0dbbbd1 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:03.174434 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf9bb5-4f67-498d-9920-90c1d0dbbbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:03.174705 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf9bb5-4f67-498d-9920-90c1d0dbbbd1 None admin] PATH_INFO: `/v3/domains/c933829dff65481c96001b9246b8f052` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:03.175896 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf9bb5-4f67-498d-9920-90c1d0dbbbd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c933829dff65481c96001b9246b8f052)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:44:03.177318 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf9bb5-4f67-498d-9920-90c1d0dbbbd1 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:44:03.178883 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 589/1176] 10.222.0.67 () {56 vars in 1183 bytes} [Mon Apr 11 13:44:03 2022] GET /identity/v3/domains/c933829dff65481c96001b9246b8f052 => generated 267 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:44:03.185115 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e92ba-e847-4965-863e-c2599df7a8bd None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:44:03.276829 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e92ba-e847-4965-863e-c2599df7a8bd None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:44:03.308125 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04c215-a4a8-4741-9368-01f7a32b84d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:44:03.308780 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04c215-a4a8-4741-9368-01f7a32b84d2 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:03.309678 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04c215-a4a8-4741-9368-01f7a32b84d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:03.310131 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04c215-a4a8-4741-9368-01f7a32b84d2 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:03.310872 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04c215-a4a8-4741-9368-01f7a32b84d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:44:03.312315 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04c215-a4a8-4741-9368-01f7a32b84d2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:44:03.331133 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 588/1177] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Apr 11 13:44:03 2022] POST /identity/v3/users => generated 311 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:44:05.660621 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5352b64-ae5e-4a4b-b620-02517dc5ecc5 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:05.661128 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5352b64-ae5e-4a4b-b620-02517dc5ecc5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:05.661128 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5352b64-ae5e-4a4b-b620-02517dc5ecc5 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:05.662439 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 590/1178] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:44:05.667482 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe8a03-de69-40f9-bb0f-96e73cda3e51 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:05.667932 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe8a03-de69-40f9-bb0f-96e73cda3e51 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:05.668146 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe8a03-de69-40f9-bb0f-96e73cda3e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:05.685306 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-3ffe8a03-de69-40f9-bb0f-96e73cda3e51 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:44:05.686480 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3ffe8a03-de69-40f9-bb0f-96e73cda3e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:44:05.748394 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 589/1179] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:44:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:44:05.772668 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5352b64-ae5e-4a4b-b620-02517dc5ecc5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:44:05.867839 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5352b64-ae5e-4a4b-b620-02517dc5ecc5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:44:05.898718 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc303a7-1161-4895-9290-d40cfd3db525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:44:05.899498 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc303a7-1161-4895-9290-d40cfd3db525 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:05.899805 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc303a7-1161-4895-9290-d40cfd3db525 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:05.900080 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc303a7-1161-4895-9290-d40cfd3db525 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:05.910245 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc303a7-1161-4895-9290-d40cfd3db525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:44:05.917234 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-0bc303a7-1161-4895-9290-d40cfd3db525 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:44:05.918345 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 591/1180] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:44:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:44:05.924256 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe8a03-de69-40f9-bb0f-96e73cda3e51 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:44:06.015253 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe8a03-de69-40f9-bb0f-96e73cda3e51 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:44:06.047979 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac9b6f-d74f-4852-a995-d9f40d1e5ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:44:06.048683 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac9b6f-d74f-4852-a995-d9f40d1e5ae0 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:06.048994 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac9b6f-d74f-4852-a995-d9f40d1e5ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:06.049315 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac9b6f-d74f-4852-a995-d9f40d1e5ae0 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:06.050146 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac9b6f-d74f-4852-a995-d9f40d1e5ae0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:44:06.050493 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac9b6f-d74f-4852-a995-d9f40d1e5ae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:44:06.052151 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac9b6f-d74f-4852-a995-d9f40d1e5ae0 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:44:06.060168 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 590/1181] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:44:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:44:06.065899 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc303a7-1161-4895-9290-d40cfd3db525 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:44:06.159600 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc303a7-1161-4895-9290-d40cfd3db525 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:44:06.190507 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150a76d-6469-4787-9e72-925b715f165b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:44:06.191299 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150a76d-6469-4787-9e72-925b715f165b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:06.191872 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150a76d-6469-4787-9e72-925b715f165b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:06.192143 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150a76d-6469-4787-9e72-925b715f165b None admin] PATH_INFO: `/v3/users/e2a1227827db4fc78323af181e8a9bb2` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:06.204402 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150a76d-6469-4787-9e72-925b715f165b None admin] RBAC: Authorizing `identity:get_user(user_id=e2a1227827db4fc78323af181e8a9bb2)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:44:06.205960 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150a76d-6469-4787-9e72-925b715f165b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:44:06.207712 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 592/1182] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:44:06 2022] GET /identity/v3/users/e2a1227827db4fc78323af181e8a9bb2 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:44:06.213415 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac9b6f-d74f-4852-a995-d9f40d1e5ae0 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:44:06.306908 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac9b6f-d74f-4852-a995-d9f40d1e5ae0 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:44:06.337912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec15b5-5589-4123-bc61-9f423882e9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:44:06.338543 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec15b5-5589-4123-bc61-9f423882e9ad None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:06.338920 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec15b5-5589-4123-bc61-9f423882e9ad None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:06.339200 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec15b5-5589-4123-bc61-9f423882e9ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:06.400742 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec15b5-5589-4123-bc61-9f423882e9ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:44:06.402180 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec15b5-5589-4123-bc61-9f423882e9ad None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:44:06.493356 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 591/1183] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:44:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:44:06.499148 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150a76d-6469-4787-9e72-925b715f165b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:44:06.591700 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150a76d-6469-4787-9e72-925b715f165b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:44:06.622410 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174dfc8-f25a-44cd-b9cf-d058dd1e4f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:44:06.623251 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174dfc8-f25a-44cd-b9cf-d058dd1e4f72 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:06.623532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174dfc8-f25a-44cd-b9cf-d058dd1e4f72 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:06.623837 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174dfc8-f25a-44cd-b9cf-d058dd1e4f72 None admin] PATH_INFO: `/v3/projects/581bf8af7e5a412dbf81abf53ca2c6ec` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:06.625004 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174dfc8-f25a-44cd-b9cf-d058dd1e4f72 None admin] RBAC: Authorizing `identity:get_project(project_id=581bf8af7e5a412dbf81abf53ca2c6ec)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:44:06.626432 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174dfc8-f25a-44cd-b9cf-d058dd1e4f72 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:44:06.628110 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 593/1184] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:44:06 2022] GET /identity/v3/projects/581bf8af7e5a412dbf81abf53ca2c6ec => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:44:06.633985 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec15b5-5589-4123-bc61-9f423882e9ad None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:44:06.727562 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec15b5-5589-4123-bc61-9f423882e9ad None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:44:06.758821 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf85dc9-2a09-4d61-a3ff-5fd045df1ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:44:06.759409 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf85dc9-2a09-4d61-a3ff-5fd045df1ceb None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:06.759729 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf85dc9-2a09-4d61-a3ff-5fd045df1ceb None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:06.760009 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf85dc9-2a09-4d61-a3ff-5fd045df1ceb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:06.760836 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf85dc9-2a09-4d61-a3ff-5fd045df1ceb None admin] RBAC: Adding query filter params (role.id=e3333fcf22b040e3a1f0bfbfe657cffa, scope.project.id=581bf8af7e5a412dbf81abf53ca2c6ec, user.id=e2a1227827db4fc78323af181e8a9bb2) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:44:06.761153 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf85dc9-2a09-4d61-a3ff-5fd045df1ceb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:44:06.763513 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf85dc9-2a09-4d61-a3ff-5fd045df1ceb None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:44:06.768744 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 592/1185] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:44:06 2022] GET /identity/v3/role_assignments?user.id=e2a1227827db4fc78323af181e8a9bb2&scope.project.id=581bf8af7e5a412dbf81abf53ca2c6ec&role.id=e3333fcf22b040e3a1f0bfbfe657cffa => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:44:09.018102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183d974-1b12-4f24-9fa9-6b6473a6cd74 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:09.018626 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183d974-1b12-4f24-9fa9-6b6473a6cd74 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:09.018626 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183d974-1b12-4f24-9fa9-6b6473a6cd74 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:09.020016 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 594/1186] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:44:09.025339 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e0f66-8b5d-466d-867f-4f3640c3dad4 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:09.025761 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e0f66-8b5d-466d-867f-4f3640c3dad4 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:09.025890 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e0f66-8b5d-466d-867f-4f3640c3dad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:09.042580 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c35e0f66-8b5d-466d-867f-4f3640c3dad4 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:44:09.044167 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c35e0f66-8b5d-466d-867f-4f3640c3dad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:44:09.106890 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 593/1187] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:44:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:44:09.129470 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183d974-1b12-4f24-9fa9-6b6473a6cd74 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:44:09.224555 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183d974-1b12-4f24-9fa9-6b6473a6cd74 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:44:09.256172 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e73001-95af-43c7-981d-d90bce2a2a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:44:09.256943 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e73001-95af-43c7-981d-d90bce2a2a4a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:09.257225 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e73001-95af-43c7-981d-d90bce2a2a4a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:09.257498 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e73001-95af-43c7-981d-d90bce2a2a4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:09.267594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e73001-95af-43c7-981d-d90bce2a2a4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:44:09.274679 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-26e73001-95af-43c7-981d-d90bce2a2a4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:44:09.275809 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 595/1188] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:44:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:44:09.283176 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e0f66-8b5d-466d-867f-4f3640c3dad4 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:44:09.373784 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e0f66-8b5d-466d-867f-4f3640c3dad4 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:44:09.405478 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a063c0f-8940-4b39-9200-e3d9c88fba70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:44:09.406141 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a063c0f-8940-4b39-9200-e3d9c88fba70 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:09.406419 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a063c0f-8940-4b39-9200-e3d9c88fba70 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:09.406690 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a063c0f-8940-4b39-9200-e3d9c88fba70 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:09.407423 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a063c0f-8940-4b39-9200-e3d9c88fba70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:44:09.407752 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a063c0f-8940-4b39-9200-e3d9c88fba70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:44:09.409099 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a063c0f-8940-4b39-9200-e3d9c88fba70 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:44:09.416649 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 594/1189] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:44:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:44:09.422608 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e73001-95af-43c7-981d-d90bce2a2a4a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:44:09.514575 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e73001-95af-43c7-981d-d90bce2a2a4a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:44:09.545533 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc6667-46f5-4e29-919f-4995bc814d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:44:09.546327 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc6667-46f5-4e29-919f-4995bc814d35 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:09.546605 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc6667-46f5-4e29-919f-4995bc814d35 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:09.546876 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc6667-46f5-4e29-919f-4995bc814d35 None admin] PATH_INFO: `/v3/users/e2a1227827db4fc78323af181e8a9bb2` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:09.548053 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc6667-46f5-4e29-919f-4995bc814d35 None admin] RBAC: Authorizing `identity:get_user(user_id=e2a1227827db4fc78323af181e8a9bb2)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:44:09.549464 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc6667-46f5-4e29-919f-4995bc814d35 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:44:09.551031 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 596/1190] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:44:09 2022] GET /identity/v3/users/e2a1227827db4fc78323af181e8a9bb2 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:44:09.556620 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a063c0f-8940-4b39-9200-e3d9c88fba70 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:44:09.650680 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a063c0f-8940-4b39-9200-e3d9c88fba70 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:44:09.681648 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0246544-10ae-4cae-bf85-0532be6df991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:44:09.682498 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0246544-10ae-4cae-bf85-0532be6df991 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:09.682787 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0246544-10ae-4cae-bf85-0532be6df991 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:09.683065 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0246544-10ae-4cae-bf85-0532be6df991 None admin] PATH_INFO: `/v3/projects/581bf8af7e5a412dbf81abf53ca2c6ec` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:09.684887 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0246544-10ae-4cae-bf85-0532be6df991 None admin] RBAC: Authorizing `identity:get_project(project_id=581bf8af7e5a412dbf81abf53ca2c6ec)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:44:09.686306 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0246544-10ae-4cae-bf85-0532be6df991 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:44:09.688007 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 595/1191] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:44:09 2022] GET /identity/v3/projects/581bf8af7e5a412dbf81abf53ca2c6ec => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:44:09.693999 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc6667-46f5-4e29-919f-4995bc814d35 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:44:09.785826 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc6667-46f5-4e29-919f-4995bc814d35 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:44:09.815894 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508206be-6b72-456d-a709-d8a358bff5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:44:09.816971 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508206be-6b72-456d-a709-d8a358bff5ec None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:09.817248 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508206be-6b72-456d-a709-d8a358bff5ec None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:09.817517 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508206be-6b72-456d-a709-d8a358bff5ec None admin] PATH_INFO: `/v3/projects/581bf8af7e5a412dbf81abf53ca2c6ec/users/e2a1227827db4fc78323af181e8a9bb2/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:09.819413 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508206be-6b72-456d-a709-d8a358bff5ec None admin] RBAC: Authorizing `identity:create_grant(project_id=581bf8af7e5a412dbf81abf53ca2c6ec, user_id=e2a1227827db4fc78323af181e8a9bb2, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:44:09.820853 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508206be-6b72-456d-a709-d8a358bff5ec None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:44:09.834771 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 597/1192] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:44:09 2022] PUT /identity/v3/projects/581bf8af7e5a412dbf81abf53ca2c6ec/users/e2a1227827db4fc78323af181e8a9bb2/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:44:12.121653 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025c0b7-83aa-40db-97c8-6479d658fa83 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:12.122193 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025c0b7-83aa-40db-97c8-6479d658fa83 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:12.122193 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025c0b7-83aa-40db-97c8-6479d658fa83 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:12.123577 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 596/1193] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:44:12.128855 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44c6f6-e60f-4d17-985c-e4a4e3aeb62f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:12.129220 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44c6f6-e60f-4d17-985c-e4a4e3aeb62f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:12.129430 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44c6f6-e60f-4d17-985c-e4a4e3aeb62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:12.145911 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ab44c6f6-e60f-4d17-985c-e4a4e3aeb62f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:44:12.147088 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ab44c6f6-e60f-4d17-985c-e4a4e3aeb62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:44:12.210330 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 598/1194] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:44:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:44:12.234875 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025c0b7-83aa-40db-97c8-6479d658fa83 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:44:12.333745 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025c0b7-83aa-40db-97c8-6479d658fa83 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:44:12.364720 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503a449-6b22-4fa2-b71e-7cca822e1f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:44:12.365498 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503a449-6b22-4fa2-b71e-7cca822e1f17 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:12.365784 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503a449-6b22-4fa2-b71e-7cca822e1f17 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:12.366061 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503a449-6b22-4fa2-b71e-7cca822e1f17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:12.377093 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503a449-6b22-4fa2-b71e-7cca822e1f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:44:12.384035 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-4503a449-6b22-4fa2-b71e-7cca822e1f17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:44:12.385228 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 597/1195] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:44:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:44:12.391864 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44c6f6-e60f-4d17-985c-e4a4e3aeb62f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:44:12.483076 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44c6f6-e60f-4d17-985c-e4a4e3aeb62f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:44:12.514867 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41481e-e39f-4e1d-ab50-bb33542bb117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:44:12.515514 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41481e-e39f-4e1d-ab50-bb33542bb117 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:12.515826 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41481e-e39f-4e1d-ab50-bb33542bb117 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:12.516102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41481e-e39f-4e1d-ab50-bb33542bb117 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:12.516847 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41481e-e39f-4e1d-ab50-bb33542bb117 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:44:12.517154 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41481e-e39f-4e1d-ab50-bb33542bb117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:44:12.518520 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41481e-e39f-4e1d-ab50-bb33542bb117 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:44:12.526170 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 599/1196] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:44:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:44:12.532198 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503a449-6b22-4fa2-b71e-7cca822e1f17 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:44:12.627068 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503a449-6b22-4fa2-b71e-7cca822e1f17 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:44:12.658179 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe9051-3bba-4ee9-a75c-586dad062f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:44:12.658980 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe9051-3bba-4ee9-a75c-586dad062f15 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:12.659259 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe9051-3bba-4ee9-a75c-586dad062f15 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:12.659530 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe9051-3bba-4ee9-a75c-586dad062f15 None admin] PATH_INFO: `/v3/users/e2a1227827db4fc78323af181e8a9bb2` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:12.660718 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe9051-3bba-4ee9-a75c-586dad062f15 None admin] RBAC: Authorizing `identity:get_user(user_id=e2a1227827db4fc78323af181e8a9bb2)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:44:12.662128 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe9051-3bba-4ee9-a75c-586dad062f15 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:44:12.663934 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 598/1197] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Apr 11 13:44:12 2022] GET /identity/v3/users/e2a1227827db4fc78323af181e8a9bb2 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:44:12.669806 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41481e-e39f-4e1d-ab50-bb33542bb117 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:44:12.762638 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41481e-e39f-4e1d-ab50-bb33542bb117 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:44:12.793751 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f626e1d-fd6e-47fa-a8d3-e2730a2b5066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:44:12.794380 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f626e1d-fd6e-47fa-a8d3-e2730a2b5066 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:12.794660 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f626e1d-fd6e-47fa-a8d3-e2730a2b5066 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:12.794932 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f626e1d-fd6e-47fa-a8d3-e2730a2b5066 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:12.857594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f626e1d-fd6e-47fa-a8d3-e2730a2b5066 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:44:12.859023 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f626e1d-fd6e-47fa-a8d3-e2730a2b5066 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:44:12.949607 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 600/1198] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:44:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:44:12.955282 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe9051-3bba-4ee9-a75c-586dad062f15 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:44:13.048045 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe9051-3bba-4ee9-a75c-586dad062f15 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:44:13.091786 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28aff63-3c51-4997-a7cc-06fbd9c843dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:44:13.092622 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aff63-3c51-4997-a7cc-06fbd9c843dc None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:13.092904 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aff63-3c51-4997-a7cc-06fbd9c843dc None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:13.093182 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aff63-3c51-4997-a7cc-06fbd9c843dc None admin] PATH_INFO: `/v3/projects/581bf8af7e5a412dbf81abf53ca2c6ec` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:13.094378 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28aff63-3c51-4997-a7cc-06fbd9c843dc None admin] RBAC: Authorizing `identity:get_project(project_id=581bf8af7e5a412dbf81abf53ca2c6ec)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:44:13.095825 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28aff63-3c51-4997-a7cc-06fbd9c843dc None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:44:13.097510 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 599/1199] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Apr 11 13:44:12 2022] GET /identity/v3/projects/581bf8af7e5a412dbf81abf53ca2c6ec => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:44:13.103451 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f626e1d-fd6e-47fa-a8d3-e2730a2b5066 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:44:13.193526 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f626e1d-fd6e-47fa-a8d3-e2730a2b5066 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:44:13.225359 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf358b5-3621-409e-8f37-59a42198ec21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:44:13.225944 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf358b5-3621-409e-8f37-59a42198ec21 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:44:13.226230 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf358b5-3621-409e-8f37-59a42198ec21 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:44:13.226506 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf358b5-3621-409e-8f37-59a42198ec21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:44:13.227333 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf358b5-3621-409e-8f37-59a42198ec21 None admin] RBAC: Adding query filter params (role.id=e3333fcf22b040e3a1f0bfbfe657cffa, scope.project.id=581bf8af7e5a412dbf81abf53ca2c6ec, user.id=e2a1227827db4fc78323af181e8a9bb2) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:44:13.227666 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf358b5-3621-409e-8f37-59a42198ec21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:44:13.229092 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf358b5-3621-409e-8f37-59a42198ec21 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:44:13.234835 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 601/1200] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:44:13 2022] GET /identity/v3/role_assignments?user.id=e2a1227827db4fc78323af181e8a9bb2&scope.project.id=581bf8af7e5a412dbf81abf53ca2c6ec&role.id=e3333fcf22b040e3a1f0bfbfe657cffa => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:15.141174 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa5d53-b210-4931-bdcf-2d51c52e5927 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:15.141944 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa5d53-b210-4931-bdcf-2d51c52e5927 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:15.141944 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa5d53-b210-4931-bdcf-2d51c52e5927 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:15.143377 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 600/1201] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:45:15.149334 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a741af-f6ba-4514-91c0-f85b48dbaf66 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:15.149836 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a741af-f6ba-4514-91c0-f85b48dbaf66 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:15.149940 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a741af-f6ba-4514-91c0-f85b48dbaf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:15.168650 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-43a741af-f6ba-4514-91c0-f85b48dbaf66 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:45:15.172008 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-43a741af-f6ba-4514-91c0-f85b48dbaf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:45:15.262341 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 602/1202] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:45:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:45:15.292251 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa5d53-b210-4931-bdcf-2d51c52e5927 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:15.414692 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa5d53-b210-4931-bdcf-2d51c52e5927 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:15.463848 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8400ae9-1435-432c-8e57-1e9e0679e968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:15.464701 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8400ae9-1435-432c-8e57-1e9e0679e968 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:15.465006 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8400ae9-1435-432c-8e57-1e9e0679e968 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:15.465351 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8400ae9-1435-432c-8e57-1e9e0679e968 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:15.478999 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8400ae9-1435-432c-8e57-1e9e0679e968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:15.481025 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8400ae9-1435-432c-8e57-1e9e0679e968 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:15.501222 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-e8400ae9-1435-432c-8e57-1e9e0679e968 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:45:15.508277 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 601/1203] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:15.509734 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a741af-f6ba-4514-91c0-f85b48dbaf66 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:15.626830 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a741af-f6ba-4514-91c0-f85b48dbaf66 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:15.666087 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e60b9c-84fe-4b15-bacf-0faaabc65bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:15.666681 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e60b9c-84fe-4b15-bacf-0faaabc65bd0 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:15.666957 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e60b9c-84fe-4b15-bacf-0faaabc65bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:15.667246 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e60b9c-84fe-4b15-bacf-0faaabc65bd0 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:15.667977 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e60b9c-84fe-4b15-bacf-0faaabc65bd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:15.668277 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e60b9c-84fe-4b15-bacf-0faaabc65bd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:15.669654 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e60b9c-84fe-4b15-bacf-0faaabc65bd0 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:15.682199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 603/1204] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:15.688472 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8400ae9-1435-432c-8e57-1e9e0679e968 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:15.813674 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8400ae9-1435-432c-8e57-1e9e0679e968 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:15.853928 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08d31b-afcb-4b4c-be36-a37cefee19d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:15.854629 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08d31b-afcb-4b4c-be36-a37cefee19d4 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:15.854961 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08d31b-afcb-4b4c-be36-a37cefee19d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:15.855232 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08d31b-afcb-4b4c-be36-a37cefee19d4 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:15.855991 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08d31b-afcb-4b4c-be36-a37cefee19d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:15.857483 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08d31b-afcb-4b4c-be36-a37cefee19d4 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:15.884627 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 602/1205] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Apr 11 13:45:15 2022] POST /identity/v3/users => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:45:18.670984 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b02321-1852-4a24-a893-5f564a7616a8 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:18.671554 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b02321-1852-4a24-a893-5f564a7616a8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:18.671698 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b02321-1852-4a24-a893-5f564a7616a8 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:18.673375 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 604/1206] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:45:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:45:18.679752 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79763c-0c9b-4103-9964-1590210a9b7a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:18.680261 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79763c-0c9b-4103-9964-1590210a9b7a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:18.680946 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79763c-0c9b-4103-9964-1590210a9b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:18.700134 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-ac79763c-0c9b-4103-9964-1590210a9b7a None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:45:18.701414 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ac79763c-0c9b-4103-9964-1590210a9b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:45:18.776010 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 603/1207] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:45:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:45:18.803513 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b02321-1852-4a24-a893-5f564a7616a8 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:18.922112 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b02321-1852-4a24-a893-5f564a7616a8 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:18.960931 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20abea-d36f-4fa1-b874-df7c170df8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:18.961776 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20abea-d36f-4fa1-b874-df7c170df8d3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:18.962087 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20abea-d36f-4fa1-b874-df7c170df8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:18.962423 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20abea-d36f-4fa1-b874-df7c170df8d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:18.976252 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20abea-d36f-4fa1-b874-df7c170df8d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:45:18.983484 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-bb20abea-d36f-4fa1-b874-df7c170df8d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:45:18.984711 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 605/1208] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:45:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:45:18.991360 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79763c-0c9b-4103-9964-1590210a9b7a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:19.124136 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79763c-0c9b-4103-9964-1590210a9b7a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:19.168561 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f554c-0d4d-4d32-9f24-15c83ae634ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:19.169870 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f554c-0d4d-4d32-9f24-15c83ae634ee None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:19.170378 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f554c-0d4d-4d32-9f24-15c83ae634ee None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:19.170662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f554c-0d4d-4d32-9f24-15c83ae634ee None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:19.171426 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f554c-0d4d-4d32-9f24-15c83ae634ee None admin] RBAC: Adding query filter params (name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:19.171796 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f554c-0d4d-4d32-9f24-15c83ae634ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:19.174968 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f554c-0d4d-4d32-9f24-15c83ae634ee None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:19.183751 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 604/1209] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Apr 11 13:45:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:19.189899 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20abea-d36f-4fa1-b874-df7c170df8d3 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:19.300646 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20abea-d36f-4fa1-b874-df7c170df8d3 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:19.343640 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b48dd-ec4f-4166-b397-e5772557d608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:19.344450 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b48dd-ec4f-4166-b397-e5772557d608 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:19.344736 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b48dd-ec4f-4166-b397-e5772557d608 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:19.345086 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b48dd-ec4f-4166-b397-e5772557d608 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:19.355114 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b48dd-ec4f-4166-b397-e5772557d608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:19.356595 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b48dd-ec4f-4166-b397-e5772557d608 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:19.375801 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-270b48dd-ec4f-4166-b397-e5772557d608 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:45:19.377199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 606/1210] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:19.384003 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f554c-0d4d-4d32-9f24-15c83ae634ee None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:19.500223 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f554c-0d4d-4d32-9f24-15c83ae634ee None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:19.535838 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e8b72-99ff-4e65-8bd8-f3523ee3d584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:19.536560 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e8b72-99ff-4e65-8bd8-f3523ee3d584 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:19.539729 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e8b72-99ff-4e65-8bd8-f3523ee3d584 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:19.539729 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e8b72-99ff-4e65-8bd8-f3523ee3d584 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:19.539729 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e8b72-99ff-4e65-8bd8-f3523ee3d584 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:19.539729 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e8b72-99ff-4e65-8bd8-f3523ee3d584 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:19.539729 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e8b72-99ff-4e65-8bd8-f3523ee3d584 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:19.552801 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 605/1211] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:19.558261 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b48dd-ec4f-4166-b397-e5772557d608 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:19.657892 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b48dd-ec4f-4166-b397-e5772557d608 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:19.695099 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26859e87-7bec-4efe-b237-fa4cc21a97d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:19.696084 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26859e87-7bec-4efe-b237-fa4cc21a97d3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:19.696488 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26859e87-7bec-4efe-b237-fa4cc21a97d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:19.696847 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26859e87-7bec-4efe-b237-fa4cc21a97d3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:19.705807 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26859e87-7bec-4efe-b237-fa4cc21a97d3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:19.707622 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26859e87-7bec-4efe-b237-fa4cc21a97d3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:19.723736 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-26859e87-7bec-4efe-b237-fa4cc21a97d3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 13:45:19.729782 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 607/1212] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:45:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:19.731301 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e8b72-99ff-4e65-8bd8-f3523ee3d584 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:19.851803 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e8b72-99ff-4e65-8bd8-f3523ee3d584 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:19.890638 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e265e-5c93-4327-b832-ea1398b306b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:19.891435 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e265e-5c93-4327-b832-ea1398b306b6 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:19.891869 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e265e-5c93-4327-b832-ea1398b306b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:19.892359 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e265e-5c93-4327-b832-ea1398b306b6 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:19.893296 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e265e-5c93-4327-b832-ea1398b306b6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:19.893610 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e265e-5c93-4327-b832-ea1398b306b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:19.895766 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e265e-5c93-4327-b832-ea1398b306b6 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:19.918674 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 606/1213] 10.222.0.67 () {56 vars in 1143 bytes} [Mon Apr 11 13:45:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:19.919615 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26859e87-7bec-4efe-b237-fa4cc21a97d3 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:20.036883 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26859e87-7bec-4efe-b237-fa4cc21a97d3 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:20.072449 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9ae34-f004-407c-8263-d8b44e54ee99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:20.073107 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9ae34-f004-407c-8263-d8b44e54ee99 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:20.073606 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9ae34-f004-407c-8263-d8b44e54ee99 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:20.073825 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9ae34-f004-407c-8263-d8b44e54ee99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:20.145623 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9ae34-f004-407c-8263-d8b44e54ee99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:20.147379 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9ae34-f004-407c-8263-d8b44e54ee99 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:20.251397 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 608/1214] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:45:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:45:20.257557 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e265e-5c93-4327-b832-ea1398b306b6 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:20.362254 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e265e-5c93-4327-b832-ea1398b306b6 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:20.402997 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab72f4-1302-4ea4-9523-61b70e71603b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:20.403856 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab72f4-1302-4ea4-9523-61b70e71603b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:20.404148 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab72f4-1302-4ea4-9523-61b70e71603b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:20.404424 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab72f4-1302-4ea4-9523-61b70e71603b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:20.416066 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab72f4-1302-4ea4-9523-61b70e71603b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:20.417534 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab72f4-1302-4ea4-9523-61b70e71603b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:20.437866 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-9eab72f4-1302-4ea4-9523-61b70e71603b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:45:20.439429 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 607/1215] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:45:20.445812 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9ae34-f004-407c-8263-d8b44e54ee99 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:20.573578 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9ae34-f004-407c-8263-d8b44e54ee99 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:20.614010 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aee9ac-ce46-4bce-8b0c-914c6bb6515b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:20.614935 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aee9ac-ce46-4bce-8b0c-914c6bb6515b None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:20.615214 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aee9ac-ce46-4bce-8b0c-914c6bb6515b None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:20.615546 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aee9ac-ce46-4bce-8b0c-914c6bb6515b None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:20.616289 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aee9ac-ce46-4bce-8b0c-914c6bb6515b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:20.616599 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aee9ac-ce46-4bce-8b0c-914c6bb6515b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:20.617968 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aee9ac-ce46-4bce-8b0c-914c6bb6515b None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:20.632267 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 609/1216] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:45:20.637929 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab72f4-1302-4ea4-9523-61b70e71603b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:20.760156 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab72f4-1302-4ea4-9523-61b70e71603b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:20.804584 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2d5d6-c67a-48de-aebe-4f6cafa4e249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:20.805529 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2d5d6-c67a-48de-aebe-4f6cafa4e249 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:20.805845 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2d5d6-c67a-48de-aebe-4f6cafa4e249 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:20.806105 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2d5d6-c67a-48de-aebe-4f6cafa4e249 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:20.813170 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2d5d6-c67a-48de-aebe-4f6cafa4e249 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:20.814614 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2d5d6-c67a-48de-aebe-4f6cafa4e249 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:20.828809 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-42b2d5d6-c67a-48de-aebe-4f6cafa4e249 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:45:20.830382 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 608/1217] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:45:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:45:20.837344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aee9ac-ce46-4bce-8b0c-914c6bb6515b None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:20.959703 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aee9ac-ce46-4bce-8b0c-914c6bb6515b None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:21.000915 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0976aef-e8d7-43f0-ad22-40cd13b5cdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:21.001714 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0976aef-e8d7-43f0-ad22-40cd13b5cdf6 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:21.001996 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0976aef-e8d7-43f0-ad22-40cd13b5cdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:21.002326 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0976aef-e8d7-43f0-ad22-40cd13b5cdf6 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:21.003115 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0976aef-e8d7-43f0-ad22-40cd13b5cdf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:21.003426 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0976aef-e8d7-43f0-ad22-40cd13b5cdf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:21.004918 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0976aef-e8d7-43f0-ad22-40cd13b5cdf6 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:21.019335 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 610/1218] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:45:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:21.026636 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2d5d6-c67a-48de-aebe-4f6cafa4e249 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:21.158368 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2d5d6-c67a-48de-aebe-4f6cafa4e249 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:21.196650 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfaa51-b9a3-404d-9a55-a06498555515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:21.197569 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfaa51-b9a3-404d-9a55-a06498555515 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:21.198029 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfaa51-b9a3-404d-9a55-a06498555515 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:21.198457 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfaa51-b9a3-404d-9a55-a06498555515 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:21.199461 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfaa51-b9a3-404d-9a55-a06498555515 None admin] RBAC: Adding query filter params (role.id=c190a911c52940bb9b0fc255a4f7cad3, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=1885d4d35b6743299a73b3c12b1793b1) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:21.199945 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfaa51-b9a3-404d-9a55-a06498555515 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:21.201597 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bfaa51-b9a3-404d-9a55-a06498555515 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:21.208411 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 609/1219] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:45:21 2022] GET /identity/v3/role_assignments?user.id=1885d4d35b6743299a73b3c12b1793b1&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=c190a911c52940bb9b0fc255a4f7cad3 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:23.648732 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048130eb-2633-4873-98bc-ba2bef2cd615 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:23.649295 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048130eb-2633-4873-98bc-ba2bef2cd615 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:23.649295 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048130eb-2633-4873-98bc-ba2bef2cd615 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:23.650608 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 611/1220] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:45:23.656256 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c0439-cde8-4c3c-b0c5-afbdd915472f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:23.656694 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c0439-cde8-4c3c-b0c5-afbdd915472f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:23.656823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c0439-cde8-4c3c-b0c5-afbdd915472f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:23.674753 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a82c0439-cde8-4c3c-b0c5-afbdd915472f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:45:23.676867 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a82c0439-cde8-4c3c-b0c5-afbdd915472f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:45:23.745065 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 610/1221] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:45:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 13:45:23.770280 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048130eb-2633-4873-98bc-ba2bef2cd615 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:23.881039 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048130eb-2633-4873-98bc-ba2bef2cd615 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:23.919974 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980ef16-b384-40f8-bde2-79181fd7197d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:23.921011 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980ef16-b384-40f8-bde2-79181fd7197d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:23.921448 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980ef16-b384-40f8-bde2-79181fd7197d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:23.921878 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980ef16-b384-40f8-bde2-79181fd7197d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:23.933179 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980ef16-b384-40f8-bde2-79181fd7197d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:45:23.940667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-e980ef16-b384-40f8-bde2-79181fd7197d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:45:23.941988 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 612/1222] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:45:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:45:23.949482 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c0439-cde8-4c3c-b0c5-afbdd915472f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:24.059537 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c0439-cde8-4c3c-b0c5-afbdd915472f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:24.103902 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf693d76-e1fe-4580-896f-18fb99e5e032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:24.104862 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf693d76-e1fe-4580-896f-18fb99e5e032 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:24.105402 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf693d76-e1fe-4580-896f-18fb99e5e032 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:24.105741 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf693d76-e1fe-4580-896f-18fb99e5e032 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:24.107280 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf693d76-e1fe-4580-896f-18fb99e5e032 None admin] RBAC: Adding query filter params (name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:24.107594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf693d76-e1fe-4580-896f-18fb99e5e032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:24.109705 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf693d76-e1fe-4580-896f-18fb99e5e032 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:24.120906 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 611/1223] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Apr 11 13:45:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:24.126833 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980ef16-b384-40f8-bde2-79181fd7197d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:24.232559 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980ef16-b384-40f8-bde2-79181fd7197d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:24.266896 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b841d-1043-436c-8c31-5c5019b05115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:24.267711 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b841d-1043-436c-8c31-5c5019b05115 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:24.268024 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b841d-1043-436c-8c31-5c5019b05115 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:24.268303 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b841d-1043-436c-8c31-5c5019b05115 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:24.278860 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b841d-1043-436c-8c31-5c5019b05115 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:24.280365 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b841d-1043-436c-8c31-5c5019b05115 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:24.296908 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-c77b841d-1043-436c-8c31-5c5019b05115 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:45:24.298259 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 613/1224] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:24.304796 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf693d76-e1fe-4580-896f-18fb99e5e032 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:24.415133 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf693d76-e1fe-4580-896f-18fb99e5e032 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:24.452574 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ddfd3-aa0c-457f-95c3-debe26fddd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:24.453244 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ddfd3-aa0c-457f-95c3-debe26fddd59 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:24.453545 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ddfd3-aa0c-457f-95c3-debe26fddd59 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:24.453809 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ddfd3-aa0c-457f-95c3-debe26fddd59 None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:24.454558 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ddfd3-aa0c-457f-95c3-debe26fddd59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:24.454839 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ddfd3-aa0c-457f-95c3-debe26fddd59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:24.456253 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ddfd3-aa0c-457f-95c3-debe26fddd59 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:24.473952 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 612/1225] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:45:24.475018 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b841d-1043-436c-8c31-5c5019b05115 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:24.581311 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b841d-1043-436c-8c31-5c5019b05115 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:24.619009 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e942fe7-d7a9-4858-a10c-615191d1fae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:24.620134 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e942fe7-d7a9-4858-a10c-615191d1fae6 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:24.620462 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e942fe7-d7a9-4858-a10c-615191d1fae6 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:24.620950 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e942fe7-d7a9-4858-a10c-615191d1fae6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:24.630184 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e942fe7-d7a9-4858-a10c-615191d1fae6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:24.631648 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e942fe7-d7a9-4858-a10c-615191d1fae6 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:24.649408 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-5e942fe7-d7a9-4858-a10c-615191d1fae6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 13:45:24.651183 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 614/1226] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:45:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:24.657417 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ddfd3-aa0c-457f-95c3-debe26fddd59 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:24.766204 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ddfd3-aa0c-457f-95c3-debe26fddd59 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:24.801418 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea353-8a6d-44e4-8829-b3d06cfd0288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:24.802092 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea353-8a6d-44e4-8829-b3d06cfd0288 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:24.802379 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea353-8a6d-44e4-8829-b3d06cfd0288 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:24.802660 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea353-8a6d-44e4-8829-b3d06cfd0288 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:24.803493 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eea353-8a6d-44e4-8829-b3d06cfd0288 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:24.803834 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eea353-8a6d-44e4-8829-b3d06cfd0288 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:24.805264 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eea353-8a6d-44e4-8829-b3d06cfd0288 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:24.823693 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 613/1227] 10.222.0.67 () {56 vars in 1143 bytes} [Mon Apr 11 13:45:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:24.829643 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e942fe7-d7a9-4858-a10c-615191d1fae6 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:24.932897 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e942fe7-d7a9-4858-a10c-615191d1fae6 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:24.967098 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ccdbd-3b98-4f2e-9556-c8f89b0191be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:24.967925 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ccdbd-3b98-4f2e-9556-c8f89b0191be None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:24.968224 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ccdbd-3b98-4f2e-9556-c8f89b0191be None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:24.968486 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ccdbd-3b98-4f2e-9556-c8f89b0191be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:24.979650 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ccdbd-3b98-4f2e-9556-c8f89b0191be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:24.981198 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ccdbd-3b98-4f2e-9556-c8f89b0191be None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:24.997816 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-215ccdbd-3b98-4f2e-9556-c8f89b0191be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:45:24.998984 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 615/1228] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:25.005917 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea353-8a6d-44e4-8829-b3d06cfd0288 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:25.118784 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea353-8a6d-44e4-8829-b3d06cfd0288 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:25.155442 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1d9cd-a0a2-4ce0-976a-ee5bfa84aaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:25.156307 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1d9cd-a0a2-4ce0-976a-ee5bfa84aaad None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:25.156687 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1d9cd-a0a2-4ce0-976a-ee5bfa84aaad None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:25.157061 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1d9cd-a0a2-4ce0-976a-ee5bfa84aaad None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:25.157878 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1d9cd-a0a2-4ce0-976a-ee5bfa84aaad None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:25.158283 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1d9cd-a0a2-4ce0-976a-ee5bfa84aaad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:25.160312 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1d9cd-a0a2-4ce0-976a-ee5bfa84aaad None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:25.171467 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 614/1229] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:45:25.177751 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ccdbd-3b98-4f2e-9556-c8f89b0191be None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:25.287459 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ccdbd-3b98-4f2e-9556-c8f89b0191be None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:25.326102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b63b0-2222-4831-af9c-f059a64b1ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:25.326919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b63b0-2222-4831-af9c-f059a64b1ba6 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:25.327319 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b63b0-2222-4831-af9c-f059a64b1ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:25.327823 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202b63b0-2222-4831-af9c-f059a64b1ba6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:25.335858 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b63b0-2222-4831-af9c-f059a64b1ba6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:25.337308 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202b63b0-2222-4831-af9c-f059a64b1ba6 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:25.352171 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-202b63b0-2222-4831-af9c-f059a64b1ba6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:45:25.353374 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 616/1230] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:45:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:25.359170 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1d9cd-a0a2-4ce0-976a-ee5bfa84aaad None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:25.464509 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1d9cd-a0a2-4ce0-976a-ee5bfa84aaad None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:25.500223 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badec4a7-4b56-47b6-9480-68026ddb4175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:25.500983 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badec4a7-4b56-47b6-9480-68026ddb4175 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:25.501260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badec4a7-4b56-47b6-9480-68026ddb4175 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:25.501534 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badec4a7-4b56-47b6-9480-68026ddb4175 None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:25.502329 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badec4a7-4b56-47b6-9480-68026ddb4175 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:25.502618 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badec4a7-4b56-47b6-9480-68026ddb4175 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:25.504678 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badec4a7-4b56-47b6-9480-68026ddb4175 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:25.516577 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 615/1231] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:45:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:25.522694 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b63b0-2222-4831-af9c-f059a64b1ba6 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:25.624381 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202b63b0-2222-4831-af9c-f059a64b1ba6 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:25.660273 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a14043-f323-4bf7-ac5f-5baa6326bc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:25.661355 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a14043-f323-4bf7-ac5f-5baa6326bc5d None admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:25.661721 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a14043-f323-4bf7-ac5f-5baa6326bc5d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:25.662036 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a14043-f323-4bf7-ac5f-5baa6326bc5d None admin] PATH_INFO: `/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/1885d4d35b6743299a73b3c12b1793b1/roles/c190a911c52940bb9b0fc255a4f7cad3` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:25.679575 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a14043-f323-4bf7-ac5f-5baa6326bc5d None admin] RBAC: Authorizing `identity:create_grant(project_id=d46063ee60fd4f6dba86d1c5946e9381, user_id=1885d4d35b6743299a73b3c12b1793b1, role_id=c190a911c52940bb9b0fc255a4f7cad3)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:25.681511 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a14043-f323-4bf7-ac5f-5baa6326bc5d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:25.694668 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 617/1232] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:45:25 2022] PUT /identity/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/1885d4d35b6743299a73b3c12b1793b1/roles/c190a911c52940bb9b0fc255a4f7cad3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:45:28.357102 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ab468-6af6-4e43-86fc-1ca3ccca30b9 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:28.357681 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ab468-6af6-4e43-86fc-1ca3ccca30b9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:28.357681 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ab468-6af6-4e43-86fc-1ca3ccca30b9 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:28.359016 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 616/1233] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:45:28.364700 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b5a55-7421-4339-866b-fde96d62e1f4 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:28.365100 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b5a55-7421-4339-866b-fde96d62e1f4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:28.365436 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b5a55-7421-4339-866b-fde96d62e1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:28.383334 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-935b5a55-7421-4339-866b-fde96d62e1f4 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:45:28.384661 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-935b5a55-7421-4339-866b-fde96d62e1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:45:28.455763 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 618/1234] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:45:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:45:28.481699 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ab468-6af6-4e43-86fc-1ca3ccca30b9 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:28.587185 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ab468-6af6-4e43-86fc-1ca3ccca30b9 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:28.621757 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c06091-60cb-48c9-b294-aa9aae47e8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:28.622478 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c06091-60cb-48c9-b294-aa9aae47e8a9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:28.622759 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c06091-60cb-48c9-b294-aa9aae47e8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:28.623032 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c06091-60cb-48c9-b294-aa9aae47e8a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:28.634066 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c06091-60cb-48c9-b294-aa9aae47e8a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:45:28.641431 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-73c06091-60cb-48c9-b294-aa9aae47e8a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 13:45:28.642664 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 617/1235] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Apr 11 13:45:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:28.649450 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b5a55-7421-4339-866b-fde96d62e1f4 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:28.757145 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b5a55-7421-4339-866b-fde96d62e1f4 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:28.788779 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74798cd7-5022-4945-abd1-75ad49170ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:28.789439 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74798cd7-5022-4945-abd1-75ad49170ef9 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:28.789721 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74798cd7-5022-4945-abd1-75ad49170ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:28.789992 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74798cd7-5022-4945-abd1-75ad49170ef9 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:28.790730 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74798cd7-5022-4945-abd1-75ad49170ef9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:28.791029 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74798cd7-5022-4945-abd1-75ad49170ef9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:28.792413 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74798cd7-5022-4945-abd1-75ad49170ef9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:28.801408 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 619/1236] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Apr 11 13:45:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:45:28.807102 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c06091-60cb-48c9-b294-aa9aae47e8a9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:28.911102 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c06091-60cb-48c9-b294-aa9aae47e8a9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:28.948099 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146177af-9885-4dc7-ad27-eaa9b1ec939f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:28.949027 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146177af-9885-4dc7-ad27-eaa9b1ec939f None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:28.949508 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146177af-9885-4dc7-ad27-eaa9b1ec939f None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:28.949830 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146177af-9885-4dc7-ad27-eaa9b1ec939f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:28.963512 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146177af-9885-4dc7-ad27-eaa9b1ec939f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:28.965619 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146177af-9885-4dc7-ad27-eaa9b1ec939f None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:28.987071 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-146177af-9885-4dc7-ad27-eaa9b1ec939f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:45:28.989267 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 618/1237] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:45:28.995372 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74798cd7-5022-4945-abd1-75ad49170ef9 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:29.117661 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74798cd7-5022-4945-abd1-75ad49170ef9 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:29.156820 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3188cd5-f3a3-4b7b-a0ea-051b23028c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:29.157537 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3188cd5-f3a3-4b7b-a0ea-051b23028c40 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:29.157815 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3188cd5-f3a3-4b7b-a0ea-051b23028c40 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:29.158084 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3188cd5-f3a3-4b7b-a0ea-051b23028c40 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:29.158804 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3188cd5-f3a3-4b7b-a0ea-051b23028c40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:29.159146 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3188cd5-f3a3-4b7b-a0ea-051b23028c40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:29.160566 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3188cd5-f3a3-4b7b-a0ea-051b23028c40 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:29.173289 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 620/1238] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:29.178942 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146177af-9885-4dc7-ad27-eaa9b1ec939f None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:29.289479 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146177af-9885-4dc7-ad27-eaa9b1ec939f None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:29.328670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d0c1e-175d-4fb8-8829-a25a32e27f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:29.329603 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d0c1e-175d-4fb8-8829-a25a32e27f3d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:29.329887 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d0c1e-175d-4fb8-8829-a25a32e27f3d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:29.330165 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d0c1e-175d-4fb8-8829-a25a32e27f3d None admin] PATH_INFO: `/v3/users/placement` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:29.338893 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d0c1e-175d-4fb8-8829-a25a32e27f3d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:29.340369 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d0c1e-175d-4fb8-8829-a25a32e27f3d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:29.354595 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-572d0c1e-175d-4fb8-8829-a25a32e27f3d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 13:45:29.355955 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 619/1239] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:45:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 13:45:29.361987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3188cd5-f3a3-4b7b-a0ea-051b23028c40 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:29.470749 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3188cd5-f3a3-4b7b-a0ea-051b23028c40 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:29.506656 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a77df-ca3d-4a3d-9cab-c3bd3b29c910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:29.507335 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a77df-ca3d-4a3d-9cab-c3bd3b29c910 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:29.507612 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a77df-ca3d-4a3d-9cab-c3bd3b29c910 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:29.507913 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a77df-ca3d-4a3d-9cab-c3bd3b29c910 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:29.508786 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a77df-ca3d-4a3d-9cab-c3bd3b29c910 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:29.509116 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a77df-ca3d-4a3d-9cab-c3bd3b29c910 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:29.510664 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a77df-ca3d-4a3d-9cab-c3bd3b29c910 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:29.528110 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 621/1240] 10.222.0.67 () {56 vars in 1143 bytes} [Mon Apr 11 13:45:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:29.533697 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d0c1e-175d-4fb8-8829-a25a32e27f3d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:29.641293 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d0c1e-175d-4fb8-8829-a25a32e27f3d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:29.676914 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30804e1-32ee-4f2c-95d8-cbe33b98b855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:29.677544 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30804e1-32ee-4f2c-95d8-cbe33b98b855 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:29.677835 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30804e1-32ee-4f2c-95d8-cbe33b98b855 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:29.678109 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30804e1-32ee-4f2c-95d8-cbe33b98b855 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:29.754267 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30804e1-32ee-4f2c-95d8-cbe33b98b855 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:29.755922 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30804e1-32ee-4f2c-95d8-cbe33b98b855 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:29.862510 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 620/1241] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:45:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:45:29.868553 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a77df-ca3d-4a3d-9cab-c3bd3b29c910 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:29.972646 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a77df-ca3d-4a3d-9cab-c3bd3b29c910 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:30.008197 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3db22-a87c-4488-b6b9-ec2ea9e3300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:30.009060 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3db22-a87c-4488-b6b9-ec2ea9e3300c None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:30.009374 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3db22-a87c-4488-b6b9-ec2ea9e3300c None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:30.009645 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3db22-a87c-4488-b6b9-ec2ea9e3300c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:30.020206 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3db22-a87c-4488-b6b9-ec2ea9e3300c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:30.021658 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3db22-a87c-4488-b6b9-ec2ea9e3300c None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:30.040052 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-edc3db22-a87c-4488-b6b9-ec2ea9e3300c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:45:30.041348 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 622/1242] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:30.047329 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30804e1-32ee-4f2c-95d8-cbe33b98b855 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:30.155495 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30804e1-32ee-4f2c-95d8-cbe33b98b855 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:30.194357 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c9051-4be0-411b-80d3-f7f391110f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:30.195027 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c9051-4be0-411b-80d3-f7f391110f5e None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:30.195316 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c9051-4be0-411b-80d3-f7f391110f5e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:30.195589 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c9051-4be0-411b-80d3-f7f391110f5e None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:30.196344 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c9051-4be0-411b-80d3-f7f391110f5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:30.196653 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c9051-4be0-411b-80d3-f7f391110f5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:30.198019 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c9051-4be0-411b-80d3-f7f391110f5e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:30.209955 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 621/1243] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:30.215792 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3db22-a87c-4488-b6b9-ec2ea9e3300c None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:30.336861 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3db22-a87c-4488-b6b9-ec2ea9e3300c None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:30.381849 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef5ada-6723-45f0-b803-d0c95c7f88a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:30.382649 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef5ada-6723-45f0-b803-d0c95c7f88a3 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:30.382970 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef5ada-6723-45f0-b803-d0c95c7f88a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:30.383241 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef5ada-6723-45f0-b803-d0c95c7f88a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:30.390353 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef5ada-6723-45f0-b803-d0c95c7f88a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:30.391825 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ef5ada-6723-45f0-b803-d0c95c7f88a3 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:30.405511 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-98ef5ada-6723-45f0-b803-d0c95c7f88a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:45:30.406726 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 623/1244] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:45:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:30.413159 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c9051-4be0-411b-80d3-f7f391110f5e None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:30.524125 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c9051-4be0-411b-80d3-f7f391110f5e None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:30.561866 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42092155-f555-49cf-81b8-3358e9c2a79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:30.562779 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42092155-f555-49cf-81b8-3358e9c2a79d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:30.563167 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42092155-f555-49cf-81b8-3358e9c2a79d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:30.563553 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42092155-f555-49cf-81b8-3358e9c2a79d None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:30.564541 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42092155-f555-49cf-81b8-3358e9c2a79d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:30.564921 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42092155-f555-49cf-81b8-3358e9c2a79d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:30.567154 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42092155-f555-49cf-81b8-3358e9c2a79d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:30.581418 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 622/1245] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:45:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:30.588134 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef5ada-6723-45f0-b803-d0c95c7f88a3 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:30.693512 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef5ada-6723-45f0-b803-d0c95c7f88a3 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:30.727912 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c99518-7799-4393-9d90-e4768b472c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:30.728617 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c99518-7799-4393-9d90-e4768b472c30 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:30.728989 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c99518-7799-4393-9d90-e4768b472c30 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:30.729360 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c99518-7799-4393-9d90-e4768b472c30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:30.730407 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c99518-7799-4393-9d90-e4768b472c30 None admin] RBAC: Adding query filter params (role.id=c190a911c52940bb9b0fc255a4f7cad3, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=1885d4d35b6743299a73b3c12b1793b1) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:30.730830 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c99518-7799-4393-9d90-e4768b472c30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:30.732422 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c99518-7799-4393-9d90-e4768b472c30 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:30.739118 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 624/1246] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:45:30 2022] GET /identity/v3/role_assignments?user.id=1885d4d35b6743299a73b3c12b1793b1&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=c190a911c52940bb9b0fc255a4f7cad3 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:33.246077 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb92e8-8cc3-499a-b69c-8b5101b221c7 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:33.246653 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb92e8-8cc3-499a-b69c-8b5101b221c7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:33.246759 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb92e8-8cc3-499a-b69c-8b5101b221c7 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:33.248343 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 623/1247] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:45:33.254902 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8eb0e5-2dad-4db4-b6c8-45b52ea81c7d None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:33.255379 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8eb0e5-2dad-4db4-b6c8-45b52ea81c7d None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:33.255472 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8eb0e5-2dad-4db4-b6c8-45b52ea81c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:33.273244 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-dd8eb0e5-2dad-4db4-b6c8-45b52ea81c7d None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:45:33.274433 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-dd8eb0e5-2dad-4db4-b6c8-45b52ea81c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:45:33.345657 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 625/1248] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:45:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:45:33.372894 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb92e8-8cc3-499a-b69c-8b5101b221c7 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:33.480538 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb92e8-8cc3-499a-b69c-8b5101b221c7 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:33.516276 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf6043-b69d-4df1-8948-712337fabff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:33.516992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf6043-b69d-4df1-8948-712337fabff5 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:33.517272 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf6043-b69d-4df1-8948-712337fabff5 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:33.517547 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf6043-b69d-4df1-8948-712337fabff5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:33.528350 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf6043-b69d-4df1-8948-712337fabff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:45:33.536034 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-e4cf6043-b69d-4df1-8948-712337fabff5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:45:33.537336 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 624/1249] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:45:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:33.543596 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8eb0e5-2dad-4db4-b6c8-45b52ea81c7d None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:33.650067 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8eb0e5-2dad-4db4-b6c8-45b52ea81c7d None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:33.684614 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35673c58-76e0-479b-8c3a-ec3bd46f5d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:33.685294 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35673c58-76e0-479b-8c3a-ec3bd46f5d04 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:33.685577 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35673c58-76e0-479b-8c3a-ec3bd46f5d04 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:33.685851 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35673c58-76e0-479b-8c3a-ec3bd46f5d04 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:33.686611 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35673c58-76e0-479b-8c3a-ec3bd46f5d04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:33.686917 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35673c58-76e0-479b-8c3a-ec3bd46f5d04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:33.688343 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35673c58-76e0-479b-8c3a-ec3bd46f5d04 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:33.697331 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 626/1250] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:45:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:33.703119 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf6043-b69d-4df1-8948-712337fabff5 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:33.803827 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf6043-b69d-4df1-8948-712337fabff5 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:33.836814 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994b248-c3c9-4b42-8104-c7f49b7d712d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:33.837609 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994b248-c3c9-4b42-8104-c7f49b7d712d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:33.837895 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994b248-c3c9-4b42-8104-c7f49b7d712d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:33.838178 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994b248-c3c9-4b42-8104-c7f49b7d712d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:33.849352 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994b248-c3c9-4b42-8104-c7f49b7d712d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:33.850791 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994b248-c3c9-4b42-8104-c7f49b7d712d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:33.867162 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-8994b248-c3c9-4b42-8104-c7f49b7d712d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:45:33.868414 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 625/1251] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:33.874344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35673c58-76e0-479b-8c3a-ec3bd46f5d04 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:33.977744 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35673c58-76e0-479b-8c3a-ec3bd46f5d04 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:34.011108 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce54aa-2d96-4da8-ac1b-32984cbbe2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:34.011813 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce54aa-2d96-4da8-ac1b-32984cbbe2a4 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:34.012097 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce54aa-2d96-4da8-ac1b-32984cbbe2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:34.012376 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce54aa-2d96-4da8-ac1b-32984cbbe2a4 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:34.013102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce54aa-2d96-4da8-ac1b-32984cbbe2a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:34.013408 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce54aa-2d96-4da8-ac1b-32984cbbe2a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:34.014786 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce54aa-2d96-4da8-ac1b-32984cbbe2a4 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:34.027057 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 627/1252] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:45:34.032579 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994b248-c3c9-4b42-8104-c7f49b7d712d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:34.135578 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994b248-c3c9-4b42-8104-c7f49b7d712d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:34.166083 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98618110-83ba-4bf3-ad66-d8e52d6bda74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:34.166883 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98618110-83ba-4bf3-ad66-d8e52d6bda74 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:34.167166 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98618110-83ba-4bf3-ad66-d8e52d6bda74 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:34.167444 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98618110-83ba-4bf3-ad66-d8e52d6bda74 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:34.175399 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98618110-83ba-4bf3-ad66-d8e52d6bda74 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:34.176868 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98618110-83ba-4bf3-ad66-d8e52d6bda74 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:34.190728 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-98618110-83ba-4bf3-ad66-d8e52d6bda74 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 13:45:34.191901 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 626/1253] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:45:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:34.197878 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce54aa-2d96-4da8-ac1b-32984cbbe2a4 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:34.292770 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce54aa-2d96-4da8-ac1b-32984cbbe2a4 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:34.324823 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d92e0-04bd-4164-bcf5-f645d3ef011d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:34.325473 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d92e0-04bd-4164-bcf5-f645d3ef011d None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:34.325754 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d92e0-04bd-4164-bcf5-f645d3ef011d None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:34.326026 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d92e0-04bd-4164-bcf5-f645d3ef011d None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:34.326849 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d92e0-04bd-4164-bcf5-f645d3ef011d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:34.327153 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d92e0-04bd-4164-bcf5-f645d3ef011d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:34.328593 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d92e0-04bd-4164-bcf5-f645d3ef011d None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:34.344564 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 628/1254] 10.222.0.67 () {56 vars in 1143 bytes} [Mon Apr 11 13:45:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:34.350738 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98618110-83ba-4bf3-ad66-d8e52d6bda74 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:34.445016 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98618110-83ba-4bf3-ad66-d8e52d6bda74 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:34.476466 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8faeb-585c-432a-a731-a12a107edd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:34.477102 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8faeb-585c-432a-a731-a12a107edd14 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:34.477383 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8faeb-585c-432a-a731-a12a107edd14 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:34.477658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8faeb-585c-432a-a731-a12a107edd14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:34.540003 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8faeb-585c-432a-a731-a12a107edd14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:34.541431 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8faeb-585c-432a-a731-a12a107edd14 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:34.634501 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 627/1255] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:45:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:45:34.640360 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d92e0-04bd-4164-bcf5-f645d3ef011d None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:34.734356 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d92e0-04bd-4164-bcf5-f645d3ef011d None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:34.766225 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a05bc5-53d3-4ef0-adb4-ba724ab122d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:34.767007 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a05bc5-53d3-4ef0-adb4-ba724ab122d9 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:34.767290 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a05bc5-53d3-4ef0-adb4-ba724ab122d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:34.767562 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a05bc5-53d3-4ef0-adb4-ba724ab122d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:34.777067 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a05bc5-53d3-4ef0-adb4-ba724ab122d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:34.778505 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a05bc5-53d3-4ef0-adb4-ba724ab122d9 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:34.800045 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-05a05bc5-53d3-4ef0-adb4-ba724ab122d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:45:34.802200 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 629/1256] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:34.807998 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8faeb-585c-432a-a731-a12a107edd14 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:34.899286 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8faeb-585c-432a-a731-a12a107edd14 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:34.930811 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d64bb-98c8-4eda-a47a-48685edc3deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:34.931457 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d64bb-98c8-4eda-a47a-48685edc3deb None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:34.931769 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d64bb-98c8-4eda-a47a-48685edc3deb None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:34.932049 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d64bb-98c8-4eda-a47a-48685edc3deb None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:34.932763 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d64bb-98c8-4eda-a47a-48685edc3deb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:34.933068 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d64bb-98c8-4eda-a47a-48685edc3deb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:34.934673 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d64bb-98c8-4eda-a47a-48685edc3deb None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:34.945811 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 628/1257] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:34.951543 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a05bc5-53d3-4ef0-adb4-ba724ab122d9 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:35.044676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a05bc5-53d3-4ef0-adb4-ba724ab122d9 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:35.081349 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f28bdc-fadb-407a-ad0f-8832b68bc475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:35.082230 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f28bdc-fadb-407a-ad0f-8832b68bc475 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:35.082503 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f28bdc-fadb-407a-ad0f-8832b68bc475 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:35.082776 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f28bdc-fadb-407a-ad0f-8832b68bc475 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:35.089535 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f28bdc-fadb-407a-ad0f-8832b68bc475 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:35.090987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f28bdc-fadb-407a-ad0f-8832b68bc475 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:35.104491 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-95f28bdc-fadb-407a-ad0f-8832b68bc475 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:45:35.105655 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 630/1258] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:45:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:35.111526 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d64bb-98c8-4eda-a47a-48685edc3deb None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:35.207620 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d64bb-98c8-4eda-a47a-48685edc3deb None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:35.239193 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae0c91-fdc6-46cf-9ec4-b5cf24d317be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:35.239862 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae0c91-fdc6-46cf-9ec4-b5cf24d317be None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:35.240149 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae0c91-fdc6-46cf-9ec4-b5cf24d317be None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:35.240425 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae0c91-fdc6-46cf-9ec4-b5cf24d317be None admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:35.241200 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae0c91-fdc6-46cf-9ec4-b5cf24d317be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:35.241506 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae0c91-fdc6-46cf-9ec4-b5cf24d317be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:35.242914 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae0c91-fdc6-46cf-9ec4-b5cf24d317be None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:35.254192 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 629/1259] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:45:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:45:35.260164 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f28bdc-fadb-407a-ad0f-8832b68bc475 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:35.354198 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f28bdc-fadb-407a-ad0f-8832b68bc475 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:35.385693 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630bba2-94e7-4d49-8245-d2674ca780ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:35.386344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630bba2-94e7-4d49-8245-d2674ca780ca None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:35.386627 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630bba2-94e7-4d49-8245-d2674ca780ca None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:35.386902 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630bba2-94e7-4d49-8245-d2674ca780ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:35.387772 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630bba2-94e7-4d49-8245-d2674ca780ca None admin] RBAC: Adding query filter params (role.id=e3333fcf22b040e3a1f0bfbfe657cffa, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=1885d4d35b6743299a73b3c12b1793b1) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:35.388083 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630bba2-94e7-4d49-8245-d2674ca780ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:35.389515 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630bba2-94e7-4d49-8245-d2674ca780ca None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:35.394919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 631/1260] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:45:35 2022] GET /identity/v3/role_assignments?user.id=1885d4d35b6743299a73b3c12b1793b1&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=e3333fcf22b040e3a1f0bfbfe657cffa => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:37.696518 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bdd83-97db-4cae-99ef-fb951afdc67b None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:37.697029 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bdd83-97db-4cae-99ef-fb951afdc67b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:37.697029 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bdd83-97db-4cae-99ef-fb951afdc67b None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:37.698350 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 630/1261] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:45:37.703536 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56384f31-c540-4582-b698-6ad27c10d57c None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:37.703930 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56384f31-c540-4582-b698-6ad27c10d57c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:37.704130 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56384f31-c540-4582-b698-6ad27c10d57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:37.721609 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-56384f31-c540-4582-b698-6ad27c10d57c None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:45:37.722801 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-56384f31-c540-4582-b698-6ad27c10d57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:45:37.785516 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 632/1262] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:45:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:45:37.807832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bdd83-97db-4cae-99ef-fb951afdc67b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:37.900841 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bdd83-97db-4cae-99ef-fb951afdc67b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:37.931810 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bf264-a739-47d7-b766-46b597fbdb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:37.932581 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bf264-a739-47d7-b766-46b597fbdb68 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:37.932860 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bf264-a739-47d7-b766-46b597fbdb68 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:37.933382 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bf264-a739-47d7-b766-46b597fbdb68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:37.943035 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bf264-a739-47d7-b766-46b597fbdb68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:45:37.950063 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-408bf264-a739-47d7-b766-46b597fbdb68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:45:37.950924 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 631/1263] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:45:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:37.959109 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56384f31-c540-4582-b698-6ad27c10d57c None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:38.051530 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56384f31-c540-4582-b698-6ad27c10d57c None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:38.088337 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d18c3-3ec7-4b4f-97dc-f2dd518cc463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:38.089018 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d18c3-3ec7-4b4f-97dc-f2dd518cc463 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:38.089299 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d18c3-3ec7-4b4f-97dc-f2dd518cc463 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:38.089577 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d18c3-3ec7-4b4f-97dc-f2dd518cc463 None admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:38.090324 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d18c3-3ec7-4b4f-97dc-f2dd518cc463 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:38.090629 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d18c3-3ec7-4b4f-97dc-f2dd518cc463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:38.092051 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d18c3-3ec7-4b4f-97dc-f2dd518cc463 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:38.100918 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 633/1264] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:45:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:38.107230 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bf264-a739-47d7-b766-46b597fbdb68 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:38.203681 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bf264-a739-47d7-b766-46b597fbdb68 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:38.234730 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b5bff-7e56-466f-abd1-b10093f742d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:38.235509 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b5bff-7e56-466f-abd1-b10093f742d2 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:38.235818 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b5bff-7e56-466f-abd1-b10093f742d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:38.236096 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b5bff-7e56-466f-abd1-b10093f742d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:38.245949 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b5bff-7e56-466f-abd1-b10093f742d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:38.247373 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b5bff-7e56-466f-abd1-b10093f742d2 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:38.263375 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-345b5bff-7e56-466f-abd1-b10093f742d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:45:38.264564 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 632/1265] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:38.270933 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d18c3-3ec7-4b4f-97dc-f2dd518cc463 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:38.362682 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d18c3-3ec7-4b4f-97dc-f2dd518cc463 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:38.394908 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4bd4c3-d25a-47e5-abc8-0024db1c1353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:38.395563 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bd4c3-d25a-47e5-abc8-0024db1c1353 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:38.395874 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bd4c3-d25a-47e5-abc8-0024db1c1353 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:38.396148 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bd4c3-d25a-47e5-abc8-0024db1c1353 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:38.396867 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bd4c3-d25a-47e5-abc8-0024db1c1353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:38.397173 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bd4c3-d25a-47e5-abc8-0024db1c1353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:38.398539 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bd4c3-d25a-47e5-abc8-0024db1c1353 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:38.409874 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 634/1266] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:38.415452 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b5bff-7e56-466f-abd1-b10093f742d2 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:38.509458 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b5bff-7e56-466f-abd1-b10093f742d2 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:38.539893 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad1b67-cb3f-4f77-9777-4ef3b54a7181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:38.540679 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad1b67-cb3f-4f77-9777-4ef3b54a7181 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:38.540961 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad1b67-cb3f-4f77-9777-4ef3b54a7181 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:38.541234 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad1b67-cb3f-4f77-9777-4ef3b54a7181 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:38.548284 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad1b67-cb3f-4f77-9777-4ef3b54a7181 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:38.550336 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad1b67-cb3f-4f77-9777-4ef3b54a7181 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:38.563531 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-03ad1b67-cb3f-4f77-9777-4ef3b54a7181 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 13:45:38.565303 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 633/1267] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:45:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:38.570978 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4bd4c3-d25a-47e5-abc8-0024db1c1353 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:38.663634 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4bd4c3-d25a-47e5-abc8-0024db1c1353 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:38.696156 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4255f-3036-4d59-ab87-56ea3c9a0c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:38.696808 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4255f-3036-4d59-ab87-56ea3c9a0c18 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:38.697087 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4255f-3036-4d59-ab87-56ea3c9a0c18 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:38.697359 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4255f-3036-4d59-ab87-56ea3c9a0c18 None admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:38.698175 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4255f-3036-4d59-ab87-56ea3c9a0c18 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:38.698477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4255f-3036-4d59-ab87-56ea3c9a0c18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:38.699910 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4255f-3036-4d59-ab87-56ea3c9a0c18 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:38.715878 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 635/1268] 10.222.0.67 () {56 vars in 1143 bytes} [Mon Apr 11 13:45:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:38.721578 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad1b67-cb3f-4f77-9777-4ef3b54a7181 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:38.816779 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad1b67-cb3f-4f77-9777-4ef3b54a7181 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:38.848234 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a55cc-bf1a-4a7b-8a6e-6be040f7ffe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:38.849019 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a55cc-bf1a-4a7b-8a6e-6be040f7ffe6 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:38.849305 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a55cc-bf1a-4a7b-8a6e-6be040f7ffe6 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:38.849583 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a55cc-bf1a-4a7b-8a6e-6be040f7ffe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:38.860238 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a55cc-bf1a-4a7b-8a6e-6be040f7ffe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:38.862391 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a55cc-bf1a-4a7b-8a6e-6be040f7ffe6 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:38.877994 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-dd1a55cc-bf1a-4a7b-8a6e-6be040f7ffe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:45:38.879149 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 634/1269] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:38.884880 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4255f-3036-4d59-ab87-56ea3c9a0c18 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:38.977254 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4255f-3036-4d59-ab87-56ea3c9a0c18 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:39.008712 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08881177-33b3-489c-abee-19f9f02fe2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:39.009358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08881177-33b3-489c-abee-19f9f02fe2d7 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:39.009638 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08881177-33b3-489c-abee-19f9f02fe2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:39.009910 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08881177-33b3-489c-abee-19f9f02fe2d7 None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:39.010623 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08881177-33b3-489c-abee-19f9f02fe2d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:39.010927 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08881177-33b3-489c-abee-19f9f02fe2d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:39.012322 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08881177-33b3-489c-abee-19f9f02fe2d7 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:39.023119 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 636/1270] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:39.028654 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a55cc-bf1a-4a7b-8a6e-6be040f7ffe6 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:39.136014 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a55cc-bf1a-4a7b-8a6e-6be040f7ffe6 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:39.166991 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd56e8-a775-49b2-b6ca-887ce941398e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:39.167797 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd56e8-a775-49b2-b6ca-887ce941398e None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:39.168080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd56e8-a775-49b2-b6ca-887ce941398e None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:39.168354 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd56e8-a775-49b2-b6ca-887ce941398e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:39.175295 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd56e8-a775-49b2-b6ca-887ce941398e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:39.176750 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd56e8-a775-49b2-b6ca-887ce941398e None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:39.189949 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-b9fd56e8-a775-49b2-b6ca-887ce941398e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:45:39.191102 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 635/1271] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:45:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:39.196961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08881177-33b3-489c-abee-19f9f02fe2d7 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:39.292312 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08881177-33b3-489c-abee-19f9f02fe2d7 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:39.323777 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534b3cb-27e8-419b-83b7-e285a1035423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:39.324424 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534b3cb-27e8-419b-83b7-e285a1035423 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:39.324703 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534b3cb-27e8-419b-83b7-e285a1035423 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:39.324976 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534b3cb-27e8-419b-83b7-e285a1035423 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:39.325757 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534b3cb-27e8-419b-83b7-e285a1035423 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:39.326065 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534b3cb-27e8-419b-83b7-e285a1035423 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:39.327494 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534b3cb-27e8-419b-83b7-e285a1035423 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:39.339260 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 637/1272] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:45:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:39.345070 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd56e8-a775-49b2-b6ca-887ce941398e None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:39.440539 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd56e8-a775-49b2-b6ca-887ce941398e None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:39.471767 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5114c-3f79-4407-8a87-91d0ff868123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:39.472646 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5114c-3f79-4407-8a87-91d0ff868123 None admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:39.472929 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5114c-3f79-4407-8a87-91d0ff868123 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:39.473207 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5114c-3f79-4407-8a87-91d0ff868123 None admin] PATH_INFO: `/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/1885d4d35b6743299a73b3c12b1793b1/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:39.475145 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5114c-3f79-4407-8a87-91d0ff868123 None admin] RBAC: Authorizing `identity:create_grant(project_id=d46063ee60fd4f6dba86d1c5946e9381, user_id=1885d4d35b6743299a73b3c12b1793b1, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:39.476617 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5114c-3f79-4407-8a87-91d0ff868123 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:39.489258 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 636/1273] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Apr 11 13:45:39 2022] PUT /identity/v3/projects/d46063ee60fd4f6dba86d1c5946e9381/users/1885d4d35b6743299a73b3c12b1793b1/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:45:41.768223 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e39014-8220-4efb-a528-b95e8b62bf77 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:41.768714 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e39014-8220-4efb-a528-b95e8b62bf77 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:41.768714 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e39014-8220-4efb-a528-b95e8b62bf77 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:41.770014 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 638/1274] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:45:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:45:41.775150 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1f104-2ad2-445f-8601-8ab8ed7c03a7 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:41.775569 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1f104-2ad2-445f-8601-8ab8ed7c03a7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:41.775741 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1f104-2ad2-445f-8601-8ab8ed7c03a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:41.792047 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-71e1f104-2ad2-445f-8601-8ab8ed7c03a7 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:45:41.793209 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-71e1f104-2ad2-445f-8601-8ab8ed7c03a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:45:41.855550 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 637/1275] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:45:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:45:41.880680 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e39014-8220-4efb-a528-b95e8b62bf77 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:41.974320 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e39014-8220-4efb-a528-b95e8b62bf77 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:42.005685 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e31c3-22c0-4b06-93df-8639573b2e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:42.006456 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e31c3-22c0-4b06-93df-8639573b2e49 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:42.006733 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e31c3-22c0-4b06-93df-8639573b2e49 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:42.007005 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e31c3-22c0-4b06-93df-8639573b2e49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:42.016420 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e31c3-22c0-4b06-93df-8639573b2e49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 13:45:42.023505 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-9d4e31c3-22c0-4b06-93df-8639573b2e49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 13:45:42.024621 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 639/1276] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Apr 11 13:45:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:42.030579 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1f104-2ad2-445f-8601-8ab8ed7c03a7 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:42.140457 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1f104-2ad2-445f-8601-8ab8ed7c03a7 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:42.172366 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb91dd5-3f34-4822-b87d-66bffd9a6310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:42.173032 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb91dd5-3f34-4822-b87d-66bffd9a6310 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:42.173916 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb91dd5-3f34-4822-b87d-66bffd9a6310 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:42.174204 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb91dd5-3f34-4822-b87d-66bffd9a6310 None admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:42.174949 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb91dd5-3f34-4822-b87d-66bffd9a6310 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:42.175257 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb91dd5-3f34-4822-b87d-66bffd9a6310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:42.176658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb91dd5-3f34-4822-b87d-66bffd9a6310 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:42.184570 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 638/1277] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Apr 11 13:45:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:42.190396 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e31c3-22c0-4b06-93df-8639573b2e49 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:42.282217 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e31c3-22c0-4b06-93df-8639573b2e49 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:42.313279 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d75eb-2ceb-4606-a76e-f6f3479d06fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:42.314086 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d75eb-2ceb-4606-a76e-f6f3479d06fb None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:42.314391 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d75eb-2ceb-4606-a76e-f6f3479d06fb None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:42.314709 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d75eb-2ceb-4606-a76e-f6f3479d06fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:42.324439 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d75eb-2ceb-4606-a76e-f6f3479d06fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:42.325862 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d75eb-2ceb-4606-a76e-f6f3479d06fb None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:42.341782 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-252d75eb-2ceb-4606-a76e-f6f3479d06fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:45:42.342912 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 640/1278] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:45:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:42.349445 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb91dd5-3f34-4822-b87d-66bffd9a6310 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:42.443791 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb91dd5-3f34-4822-b87d-66bffd9a6310 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:42.476056 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c5afb-a7fc-45bd-b320-5b182c379d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:42.476714 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c5afb-a7fc-45bd-b320-5b182c379d3c None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:42.476999 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c5afb-a7fc-45bd-b320-5b182c379d3c None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:42.477278 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c5afb-a7fc-45bd-b320-5b182c379d3c None admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:42.477990 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c5afb-a7fc-45bd-b320-5b182c379d3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:42.478297 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c5afb-a7fc-45bd-b320-5b182c379d3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:42.479685 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c5afb-a7fc-45bd-b320-5b182c379d3c None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:42.491546 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 639/1279] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:42.497105 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d75eb-2ceb-4606-a76e-f6f3479d06fb None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:42.591587 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d75eb-2ceb-4606-a76e-f6f3479d06fb None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:42.621933 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a79ea-64b7-41b1-8a3f-f5eeec1867ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:42.622709 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a79ea-64b7-41b1-8a3f-f5eeec1867ad None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:42.622989 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a79ea-64b7-41b1-8a3f-f5eeec1867ad None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:42.623261 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a79ea-64b7-41b1-8a3f-f5eeec1867ad None admin] PATH_INFO: `/v3/users/placement` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:42.630849 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a79ea-64b7-41b1-8a3f-f5eeec1867ad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:42.632338 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a79ea-64b7-41b1-8a3f-f5eeec1867ad None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:42.645919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-203a79ea-64b7-41b1-8a3f-f5eeec1867ad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 13:45:42.647050 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 641/1280] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:45:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:42.652989 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c5afb-a7fc-45bd-b320-5b182c379d3c None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:42.745185 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c5afb-a7fc-45bd-b320-5b182c379d3c None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:42.777100 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943447c5-0935-43f6-b5a1-a40fa89a6079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:42.777754 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943447c5-0935-43f6-b5a1-a40fa89a6079 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:42.778033 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943447c5-0935-43f6-b5a1-a40fa89a6079 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:42.778307 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943447c5-0935-43f6-b5a1-a40fa89a6079 None admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:42.779133 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943447c5-0935-43f6-b5a1-a40fa89a6079 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:42.779436 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943447c5-0935-43f6-b5a1-a40fa89a6079 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:42.780880 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943447c5-0935-43f6-b5a1-a40fa89a6079 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:42.796860 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 640/1281] 10.222.0.67 () {56 vars in 1143 bytes} [Mon Apr 11 13:45:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:42.802687 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a79ea-64b7-41b1-8a3f-f5eeec1867ad None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:42.897883 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a79ea-64b7-41b1-8a3f-f5eeec1867ad None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:42.929176 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9be139-f0a5-4328-957a-2c16eb8bd252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:42.929810 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9be139-f0a5-4328-957a-2c16eb8bd252 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:42.930091 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9be139-f0a5-4328-957a-2c16eb8bd252 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:42.930362 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9be139-f0a5-4328-957a-2c16eb8bd252 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:42.994618 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9be139-f0a5-4328-957a-2c16eb8bd252 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:42.996089 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9be139-f0a5-4328-957a-2c16eb8bd252 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:43.087336 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 642/1282] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Apr 11 13:45:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 13:45:43.094326 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943447c5-0935-43f6-b5a1-a40fa89a6079 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:43.188786 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943447c5-0935-43f6-b5a1-a40fa89a6079 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:43.221939 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4af5e4-dc34-4788-8c6e-842ea470078d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:43.222723 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4af5e4-dc34-4788-8c6e-842ea470078d None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:43.223005 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4af5e4-dc34-4788-8c6e-842ea470078d None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:43.223281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4af5e4-dc34-4788-8c6e-842ea470078d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:43.232830 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4af5e4-dc34-4788-8c6e-842ea470078d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:43.234270 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4af5e4-dc34-4788-8c6e-842ea470078d None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:43.250363 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-5d4af5e4-dc34-4788-8c6e-842ea470078d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 13:45:43.251849 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 641/1283] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:43.257741 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9be139-f0a5-4328-957a-2c16eb8bd252 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:43.349567 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9be139-f0a5-4328-957a-2c16eb8bd252 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:43.381128 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6294e-7d64-49e2-a755-a357f0a90a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:43.381781 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6294e-7d64-49e2-a755-a357f0a90a2f None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:43.382063 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6294e-7d64-49e2-a755-a357f0a90a2f None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:43.382335 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6294e-7d64-49e2-a755-a357f0a90a2f None admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:43.383060 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6294e-7d64-49e2-a755-a357f0a90a2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:43.383361 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6294e-7d64-49e2-a755-a357f0a90a2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:43.384749 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6294e-7d64-49e2-a755-a357f0a90a2f None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:43.396122 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 643/1284] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Apr 11 13:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:43.401873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4af5e4-dc34-4788-8c6e-842ea470078d None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:43.496621 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4af5e4-dc34-4788-8c6e-842ea470078d None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:43.527807 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7bf51-6f89-4a3f-9837-1bb205b0151b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:43.528572 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7bf51-6f89-4a3f-9837-1bb205b0151b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:43.528851 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7bf51-6f89-4a3f-9837-1bb205b0151b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:43.529126 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7bf51-6f89-4a3f-9837-1bb205b0151b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:43.536027 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7bf51-6f89-4a3f-9837-1bb205b0151b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:43.537449 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7bf51-6f89-4a3f-9837-1bb205b0151b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:43.550539 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING keystone.server.flask.application [None req-4cf7bf51-6f89-4a3f-9837-1bb205b0151b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 13:45:43.551674 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 642/1285] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Apr 11 13:45:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:43.557703 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6294e-7d64-49e2-a755-a357f0a90a2f None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:43.650014 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6294e-7d64-49e2-a755-a357f0a90a2f None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:43.681927 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66895fe4-052f-4600-b989-5e3cd1644a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:43.682832 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66895fe4-052f-4600-b989-5e3cd1644a72 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:43.683114 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66895fe4-052f-4600-b989-5e3cd1644a72 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:43.683388 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66895fe4-052f-4600-b989-5e3cd1644a72 None admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:43.684193 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66895fe4-052f-4600-b989-5e3cd1644a72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:43.684501 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66895fe4-052f-4600-b989-5e3cd1644a72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:43.685919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66895fe4-052f-4600-b989-5e3cd1644a72 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:43.697321 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 644/1286] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Apr 11 13:45:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:43.703235 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7bf51-6f89-4a3f-9837-1bb205b0151b None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:43.795957 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7bf51-6f89-4a3f-9837-1bb205b0151b None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:43.826889 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13c300-9950-4654-baec-4f7ddbf462bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:43.827518 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13c300-9950-4654-baec-4f7ddbf462bf None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:43.827829 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13c300-9950-4654-baec-4f7ddbf462bf None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:43.828104 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13c300-9950-4654-baec-4f7ddbf462bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:43.828913 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13c300-9950-4654-baec-4f7ddbf462bf None admin] RBAC: Adding query filter params (role.id=e3333fcf22b040e3a1f0bfbfe657cffa, scope.project.id=d46063ee60fd4f6dba86d1c5946e9381, user.id=1885d4d35b6743299a73b3c12b1793b1) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:43.829221 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13c300-9950-4654-baec-4f7ddbf462bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:43.831246 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13c300-9950-4654-baec-4f7ddbf462bf None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:43.836854 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 643/1287] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Apr 11 13:45:43 2022] GET /identity/v3/role_assignments?user.id=1885d4d35b6743299a73b3c12b1793b1&scope.project.id=d46063ee60fd4f6dba86d1c5946e9381&role.id=e3333fcf22b040e3a1f0bfbfe657cffa => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:46.122759 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee2a23-d27b-431c-b43d-c7af358561a4 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:46.123348 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee2a23-d27b-431c-b43d-c7af358561a4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:46.123348 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee2a23-d27b-431c-b43d-c7af358561a4 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:46.124675 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 645/1288] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:45:46.131361 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c31e6-73bf-4bc6-84d3-2c34a121356d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:46.131801 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c31e6-73bf-4bc6-84d3-2c34a121356d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:46.132018 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c31e6-73bf-4bc6-84d3-2c34a121356d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:46.150511 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7f1c31e6-73bf-4bc6-84d3-2c34a121356d None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:45:46.151714 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7f1c31e6-73bf-4bc6-84d3-2c34a121356d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:45:46.218964 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 644/1289] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:45:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:45:46.242030 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee2a23-d27b-431c-b43d-c7af358561a4 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:46.336853 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee2a23-d27b-431c-b43d-c7af358561a4 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:46.367505 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c8fcc-b270-421d-b0c0-572420aa3754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:46.368310 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c8fcc-b270-421d-b0c0-572420aa3754 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:46.368592 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c8fcc-b270-421d-b0c0-572420aa3754 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:46.368865 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c8fcc-b270-421d-b0c0-572420aa3754 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:46.369508 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c8fcc-b270-421d-b0c0-572420aa3754 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:46.370909 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c8fcc-b270-421d-b0c0-572420aa3754 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:46.382060 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-ff4c8fcc-b270-421d-b0c0-572420aa3754 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 11 13:45:46.383218 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 646/1290] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Apr 11 13:45:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:46.390506 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c31e6-73bf-4bc6-84d3-2c34a121356d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:46.484196 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c31e6-73bf-4bc6-84d3-2c34a121356d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:46.516021 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ea997-4928-48cd-b1b6-037757a5fe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:46.517271 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ea997-4928-48cd-b1b6-037757a5fe05 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:46.517555 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ea997-4928-48cd-b1b6-037757a5fe05 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:46.517830 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ea997-4928-48cd-b1b6-037757a5fe05 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:46.518535 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ea997-4928-48cd-b1b6-037757a5fe05 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:46.518841 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ea997-4928-48cd-b1b6-037757a5fe05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:46.520230 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ea997-4928-48cd-b1b6-037757a5fe05 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:46.524833 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 645/1291] 10.222.0.67 () {56 vars in 1116 bytes} [Mon Apr 11 13:45:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:46.530468 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c8fcc-b270-421d-b0c0-572420aa3754 None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:46.623456 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c8fcc-b270-421d-b0c0-572420aa3754 None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:46.655221 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23499c96-08eb-4a60-b544-d60a372e9e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:46.655839 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23499c96-08eb-4a60-b544-d60a372e9e81 None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:46.656123 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23499c96-08eb-4a60-b544-d60a372e9e81 None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:46.656396 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23499c96-08eb-4a60-b544-d60a372e9e81 None admin] PATH_INFO: `/v3/services` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:46.657089 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23499c96-08eb-4a60-b544-d60a372e9e81 None admin] RBAC: Adding query filter params (type=placement) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:46.657414 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23499c96-08eb-4a60-b544-d60a372e9e81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:46.658774 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23499c96-08eb-4a60-b544-d60a372e9e81 None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:46.662933 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 647/1292] 10.222.0.67 () {56 vars in 1116 bytes} [Mon Apr 11 13:45:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:48.943387 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09683a2-5a72-422e-8750-4ce140c14233 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:48.943958 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09683a2-5a72-422e-8750-4ce140c14233 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:48.943958 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09683a2-5a72-422e-8750-4ce140c14233 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:48.945335 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 646/1293] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:45:48.950389 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dbc95-7cbd-4784-bcaf-1b65de6fa5a2 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:48.950750 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dbc95-7cbd-4784-bcaf-1b65de6fa5a2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:48.950941 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dbc95-7cbd-4784-bcaf-1b65de6fa5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:48.968415 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-374dbc95-7cbd-4784-bcaf-1b65de6fa5a2 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:45:48.970349 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-374dbc95-7cbd-4784-bcaf-1b65de6fa5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:45:49.033119 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 648/1294] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:45:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:45:49.057584 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09683a2-5a72-422e-8750-4ce140c14233 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:49.166134 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09683a2-5a72-422e-8750-4ce140c14233 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:49.197584 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d23bd-640f-42c4-8c28-babd51844629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:49.198184 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d23bd-640f-42c4-8c28-babd51844629 None admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:49.198466 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d23bd-640f-42c4-8c28-babd51844629 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:49.198740 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d23bd-640f-42c4-8c28-babd51844629 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:49.199456 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d23bd-640f-42c4-8c28-babd51844629 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:49.200840 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d23bd-640f-42c4-8c28-babd51844629 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:49.213316 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 647/1295] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Apr 11 13:45:49 2022] POST /identity/v3/services => generated 246 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:45:51.549449 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0e290-7ca6-44db-810e-3d0013bd2f49 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:51.550008 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0e290-7ca6-44db-810e-3d0013bd2f49 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:51.550107 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0e290-7ca6-44db-810e-3d0013bd2f49 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:51.551850 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 649/1296] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:45:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:45:51.557551 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bc267-7d35-41da-9001-130e259df478 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:51.558008 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bc267-7d35-41da-9001-130e259df478 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:51.558181 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bc267-7d35-41da-9001-130e259df478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:51.576232 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-bf9bc267-7d35-41da-9001-130e259df478 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:45:51.577628 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-bf9bc267-7d35-41da-9001-130e259df478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:45:51.651883 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 648/1297] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:45:51 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:45:51.675506 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0e290-7ca6-44db-810e-3d0013bd2f49 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:51.770889 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0e290-7ca6-44db-810e-3d0013bd2f49 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:51.801502 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a2e01-8775-40be-94bc-920d19bbac1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:51.802285 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a2e01-8775-40be-94bc-920d19bbac1a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:51.802567 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a2e01-8775-40be-94bc-920d19bbac1a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:51.802841 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a2e01-8775-40be-94bc-920d19bbac1a None admin] PATH_INFO: `/v3/services/placement` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:51.803489 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a2e01-8775-40be-94bc-920d19bbac1a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:51.804887 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a2e01-8775-40be-94bc-920d19bbac1a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:51.816252 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-221a2e01-8775-40be-94bc-920d19bbac1a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 11 13:45:51.817385 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 650/1298] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Apr 11 13:45:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:51.823375 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bc267-7d35-41da-9001-130e259df478 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:51.914669 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bc267-7d35-41da-9001-130e259df478 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:51.947000 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f814eb9-3975-4d6b-ade0-1be7d39aabf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:51.947670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f814eb9-3975-4d6b-ade0-1be7d39aabf9 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:51.947956 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f814eb9-3975-4d6b-ade0-1be7d39aabf9 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:51.948233 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f814eb9-3975-4d6b-ade0-1be7d39aabf9 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:51.948960 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f814eb9-3975-4d6b-ade0-1be7d39aabf9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:51.949232 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f814eb9-3975-4d6b-ade0-1be7d39aabf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:51.950581 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f814eb9-3975-4d6b-ade0-1be7d39aabf9 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:51.955492 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 649/1299] 10.222.0.67 () {56 vars in 1116 bytes} [Mon Apr 11 13:45:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:51.961199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a2e01-8775-40be-94bc-920d19bbac1a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:52.054623 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a2e01-8775-40be-94bc-920d19bbac1a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:52.095252 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174b664-b0b4-499c-bf9a-46001b2362ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:52.095981 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174b664-b0b4-499c-bf9a-46001b2362ee None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:52.096266 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174b664-b0b4-499c-bf9a-46001b2362ee None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:52.096543 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174b664-b0b4-499c-bf9a-46001b2362ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:52.097397 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174b664-b0b4-499c-bf9a-46001b2362ee None admin] RBAC: Adding query filter params (interface=public, service_id=774ec36adc524a439330ca3cdc19f3e0, region_id=RegionOne) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:52.097710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174b664-b0b4-499c-bf9a-46001b2362ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:52.099094 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174b664-b0b4-499c-bf9a-46001b2362ee None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:52.104243 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 651/1300] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Apr 11 13:45:51 2022] GET /identity/v3/endpoints?service_id=774ec36adc524a439330ca3cdc19f3e0&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:52.110075 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f814eb9-3975-4d6b-ade0-1be7d39aabf9 None admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:52.206174 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f814eb9-3975-4d6b-ade0-1be7d39aabf9 None admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:52.237889 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcd5d8-2573-4a30-8719-8d075a6c892b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:52.238552 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcd5d8-2573-4a30-8719-8d075a6c892b None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:52.238836 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcd5d8-2573-4a30-8719-8d075a6c892b None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:52.239115 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcd5d8-2573-4a30-8719-8d075a6c892b None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:52.239820 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcd5d8-2573-4a30-8719-8d075a6c892b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:52.241178 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcd5d8-2573-4a30-8719-8d075a6c892b None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:52.247745 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 650/1301] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Apr 11 13:45:52 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:45:54.514442 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459df06-dc3e-4905-b6b2-4d8a5b43a134 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:54.514998 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459df06-dc3e-4905-b6b2-4d8a5b43a134 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:54.514998 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459df06-dc3e-4905-b6b2-4d8a5b43a134 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:54.516997 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 652/1302] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:45:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:45:54.522305 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c18120-b056-4698-9505-686d29e64506 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:54.522749 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c18120-b056-4698-9505-686d29e64506 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:54.522855 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c18120-b056-4698-9505-686d29e64506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:54.540577 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-87c18120-b056-4698-9505-686d29e64506 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:45:54.541758 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-87c18120-b056-4698-9505-686d29e64506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:45:54.604044 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 651/1303] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:45:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 13:45:54.628680 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459df06-dc3e-4905-b6b2-4d8a5b43a134 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:54.723443 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459df06-dc3e-4905-b6b2-4d8a5b43a134 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:54.754091 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a3a8b-5385-4cea-8fcf-33971fd0d00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:54.754874 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a3a8b-5385-4cea-8fcf-33971fd0d00a None admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:54.755151 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a3a8b-5385-4cea-8fcf-33971fd0d00a None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:54.755420 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a3a8b-5385-4cea-8fcf-33971fd0d00a None admin] PATH_INFO: `/v3/services/placement` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:54.756089 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a3a8b-5385-4cea-8fcf-33971fd0d00a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:54.757439 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a3a8b-5385-4cea-8fcf-33971fd0d00a None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:54.768703 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING keystone.server.flask.application [None req-319a3a8b-5385-4cea-8fcf-33971fd0d00a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 11 13:45:54.769837 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 653/1304] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Apr 11 13:45:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 13:45:54.775802 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c18120-b056-4698-9505-686d29e64506 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:54.867186 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c18120-b056-4698-9505-686d29e64506 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:54.901369 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e824c7-7277-4b62-a021-4a4056103be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:54.902032 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e824c7-7277-4b62-a021-4a4056103be8 None admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:54.902314 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e824c7-7277-4b62-a021-4a4056103be8 None admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:54.902586 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e824c7-7277-4b62-a021-4a4056103be8 None admin] PATH_INFO: `/v3/services` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:54.903289 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e824c7-7277-4b62-a021-4a4056103be8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:45:54.903594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e824c7-7277-4b62-a021-4a4056103be8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:54.904974 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e824c7-7277-4b62-a021-4a4056103be8 None admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:54.909929 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 652/1305] 10.222.0.67 () {56 vars in 1116 bytes} [Mon Apr 11 13:45:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:45:54.915814 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a3a8b-5385-4cea-8fcf-33971fd0d00a None admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:45:55.009776 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a3a8b-5385-4cea-8fcf-33971fd0d00a None admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:45:55.040300 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce39a0-1dcb-4bf4-bd60-2c5d5d5b8bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:45:55.040942 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce39a0-1dcb-4bf4-bd60-2c5d5d5b8bec None admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:45:55.041220 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce39a0-1dcb-4bf4-bd60-2c5d5d5b8bec None admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:45:55.041493 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce39a0-1dcb-4bf4-bd60-2c5d5d5b8bec None admin] PATH_INFO: `/v3/endpoints` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:45:55.042220 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce39a0-1dcb-4bf4-bd60-2c5d5d5b8bec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:45:55.043582 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce39a0-1dcb-4bf4-bd60-2c5d5d5b8bec None admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:45:55.062073 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 654/1306] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Apr 11 13:45:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:46:59.562411 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246d5f9-8ddf-4a54-9934-b427621cf6a1 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:46:59.563332 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246d5f9-8ddf-4a54-9934-b427621cf6a1 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:46:59.563818 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246d5f9-8ddf-4a54-9934-b427621cf6a1 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:46:59.565357 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 653/1307] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:46:59.570546 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcba97-cc21-4e6c-aefc-e67f1f3d68f2 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:46:59.570958 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcba97-cc21-4e6c-aefc-e67f1f3d68f2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:46:59.571100 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcba97-cc21-4e6c-aefc-e67f1f3d68f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:46:59.709195 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-73bcba97-cc21-4e6c-aefc-e67f1f3d68f2 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:46:59.710618 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-73bcba97-cc21-4e6c-aefc-e67f1f3d68f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:46:59.919664 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 655/1308] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:46:59.966410 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e22817-68e6-4681-96cf-f0b0fbdee436 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:46:59.966918 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e22817-68e6-4681-96cf-f0b0fbdee436 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:46:59.967376 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e22817-68e6-4681-96cf-f0b0fbdee436 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:46:59.969267 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 654/1309] 10.222.0.67 () {54 vars in 963 bytes} [Mon Apr 11 13:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:46:59.975084 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bae40-da06-4348-bd99-108fd264139e None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:46:59.975351 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bae40-da06-4348-bd99-108fd264139e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:46:59.975645 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bae40-da06-4348-bd99-108fd264139e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:00.095376 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-989bae40-da06-4348-bd99-108fd264139e None None] MFA Rules not processed for user `c084d218ea414d638ef2dc45364a492c`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:47:00.096794 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-989bae40-da06-4348-bd99-108fd264139e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:00.191152 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 656/1310] 10.222.0.67 () {58 vars in 1060 bytes} [Mon Apr 11 13:46:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:47:00.191357 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e22817-68e6-4681-96cf-f0b0fbdee436 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:47:00.193060 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e4e22817-68e6-4681-96cf-f0b0fbdee436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:00.311236 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e22817-68e6-4681-96cf-f0b0fbdee436 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:47:00.394127 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029b0cd-1eb5-4b11-97fc-b2fcd9ccc5ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:47:00.395182 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029b0cd-1eb5-4b11-97fc-b2fcd9ccc5ab service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:00.395705 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029b0cd-1eb5-4b11-97fc-b2fcd9ccc5ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:00.396180 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029b0cd-1eb5-4b11-97fc-b2fcd9ccc5ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:00.398661 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d029b0cd-1eb5-4b11-97fc-b2fcd9ccc5ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:00.516388 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029b0cd-1eb5-4b11-97fc-b2fcd9ccc5ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:47:00.518155 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029b0cd-1eb5-4b11-97fc-b2fcd9ccc5ab service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:47:00.540461 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 655/1311] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:47:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:47:03.195379 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819a9e8-d13c-4656-afac-752edf2e24e3 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:03.195875 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819a9e8-d13c-4656-afac-752edf2e24e3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:03.195978 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819a9e8-d13c-4656-afac-752edf2e24e3 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:03.198065 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 657/1312] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:47:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:47:03.203321 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5665f4-2f59-4704-b0c9-78c715a66d77 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:03.203781 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5665f4-2f59-4704-b0c9-78c715a66d77 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:03.203923 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5665f4-2f59-4704-b0c9-78c715a66d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:03.307661 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-9e5665f4-2f59-4704-b0c9-78c715a66d77 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:47:03.308928 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9e5665f4-2f59-4704-b0c9-78c715a66d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:03.409075 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 656/1313] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:47:03.448955 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819a9e8-d13c-4656-afac-752edf2e24e3 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:47:03.450482 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c819a9e8-d13c-4656-afac-752edf2e24e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:03.549045 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819a9e8-d13c-4656-afac-752edf2e24e3 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:47:03.618876 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8073fa2-443e-4fa3-82ad-8dde69cdd6e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:47:03.619561 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8073fa2-443e-4fa3-82ad-8dde69cdd6e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:03.619866 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8073fa2-443e-4fa3-82ad-8dde69cdd6e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:03.620137 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8073fa2-443e-4fa3-82ad-8dde69cdd6e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:03.621781 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b8073fa2-443e-4fa3-82ad-8dde69cdd6e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:03.725745 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8073fa2-443e-4fa3-82ad-8dde69cdd6e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:47:03.727100 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8073fa2-443e-4fa3-82ad-8dde69cdd6e3 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:47:03.746750 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 658/1314] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:47:06.351893 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f1aaf-ac12-41cc-a5bd-01bff1a10206 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:06.352421 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f1aaf-ac12-41cc-a5bd-01bff1a10206 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:06.352541 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f1aaf-ac12-41cc-a5bd-01bff1a10206 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:06.353857 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 657/1315] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:47:06.359011 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928b2a7-908c-4feb-b4b5-cc7131f87aa8 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:06.359401 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928b2a7-908c-4feb-b4b5-cc7131f87aa8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:06.359571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928b2a7-908c-4feb-b4b5-cc7131f87aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:06.420826 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-2928b2a7-908c-4feb-b4b5-cc7131f87aa8 None None] MFA Rules not processed for user `80fe3955cd0843e783a1c35d76b757b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:47:06.422009 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2928b2a7-908c-4feb-b4b5-cc7131f87aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:06.511813 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 659/1316] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:47:06 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:47:06.553153 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f1aaf-ac12-41cc-a5bd-01bff1a10206 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:47:06.554682 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c24f1aaf-ac12-41cc-a5bd-01bff1a10206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:06.657305 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f1aaf-ac12-41cc-a5bd-01bff1a10206 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:47:06.727383 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbd907-8982-4768-ba9d-f11c9a833e97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:47:06.728063 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbd907-8982-4768-ba9d-f11c9a833e97 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:06.728348 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbd907-8982-4768-ba9d-f11c9a833e97 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:06.728655 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbd907-8982-4768-ba9d-f11c9a833e97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:06.730309 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1efbd907-8982-4768-ba9d-f11c9a833e97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:06.831953 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efbd907-8982-4768-ba9d-f11c9a833e97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:47:06.833388 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efbd907-8982-4768-ba9d-f11c9a833e97 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:47:06.852391 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 658/1317] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:47:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:47:09.662476 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc175028-f3d6-4b96-8fed-a9bacd165ee2 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:09.662997 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc175028-f3d6-4b96-8fed-a9bacd165ee2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:09.662997 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc175028-f3d6-4b96-8fed-a9bacd165ee2 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:09.664348 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 660/1318] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:47:09.670079 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12226f8c-8f4f-4c85-9e89-1d59e9311a3b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:09.670512 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12226f8c-8f4f-4c85-9e89-1d59e9311a3b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:09.670658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12226f8c-8f4f-4c85-9e89-1d59e9311a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:09.732630 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-12226f8c-8f4f-4c85-9e89-1d59e9311a3b None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:47:09.733814 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-12226f8c-8f4f-4c85-9e89-1d59e9311a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:09.825176 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 659/1319] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:47:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:47:09.865025 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc175028-f3d6-4b96-8fed-a9bacd165ee2 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:47:09.866552 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fc175028-f3d6-4b96-8fed-a9bacd165ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:09.966417 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc175028-f3d6-4b96-8fed-a9bacd165ee2 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:47:10.035115 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032b419-15e3-4edb-a9c7-3b19d00b1e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:47:10.035817 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032b419-15e3-4edb-a9c7-3b19d00b1e90 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:10.036103 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032b419-15e3-4edb-a9c7-3b19d00b1e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:10.036384 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032b419-15e3-4edb-a9c7-3b19d00b1e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:10.038024 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3032b419-15e3-4edb-a9c7-3b19d00b1e90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:10.142872 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032b419-15e3-4edb-a9c7-3b19d00b1e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:47:10.144336 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032b419-15e3-4edb-a9c7-3b19d00b1e90 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:47:10.162299 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 661/1320] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:47:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:47:13.118963 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4f5e5-eaa1-49d9-a967-7335fbe3e1e2 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:13.119502 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4f5e5-eaa1-49d9-a967-7335fbe3e1e2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:13.119502 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4f5e5-eaa1-49d9-a967-7335fbe3e1e2 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:13.121103 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 660/1321] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:47:13.126304 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8fe5c-99b0-40dc-88fe-fe844dc8c6db None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:13.126755 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8fe5c-99b0-40dc-88fe-fe844dc8c6db None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:13.126977 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8fe5c-99b0-40dc-88fe-fe844dc8c6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:13.191013 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-eaf8fe5c-99b0-40dc-88fe-fe844dc8c6db None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:47:13.192237 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-eaf8fe5c-99b0-40dc-88fe-fe844dc8c6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:13.284734 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 662/1322] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:47:13.322617 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4f5e5-eaa1-49d9-a967-7335fbe3e1e2 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:47:13.324591 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e6c4f5e5-eaa1-49d9-a967-7335fbe3e1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:13.429262 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4f5e5-eaa1-49d9-a967-7335fbe3e1e2 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:47:13.499364 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36d8dc-73d0-4ed7-b3d2-1eaa99e6d818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:47:13.500051 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36d8dc-73d0-4ed7-b3d2-1eaa99e6d818 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:13.500335 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36d8dc-73d0-4ed7-b3d2-1eaa99e6d818 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:13.500615 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36d8dc-73d0-4ed7-b3d2-1eaa99e6d818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:13.502256 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9d36d8dc-73d0-4ed7-b3d2-1eaa99e6d818 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:13.606727 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36d8dc-73d0-4ed7-b3d2-1eaa99e6d818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:47:13.608436 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36d8dc-73d0-4ed7-b3d2-1eaa99e6d818 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:47:13.626799 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 661/1323] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:47:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:47:15.994545 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8e316-465c-4f2b-8179-2329bd3a99c0 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:15.995699 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8e316-465c-4f2b-8179-2329bd3a99c0 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:15.995699 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8e316-465c-4f2b-8179-2329bd3a99c0 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:15.997156 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 663/1324] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:47:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:47:16.002355 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b83f8-7d74-4549-ad12-5cad95314dcc None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:16.002768 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b83f8-7d74-4549-ad12-5cad95314dcc None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:16.002918 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b83f8-7d74-4549-ad12-5cad95314dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:16.067292 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a84b83f8-7d74-4549-ad12-5cad95314dcc None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:47:16.068681 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a84b83f8-7d74-4549-ad12-5cad95314dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:16.161529 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 662/1325] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:47:16.199567 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8e316-465c-4f2b-8179-2329bd3a99c0 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:47:16.201122 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fff8e316-465c-4f2b-8179-2329bd3a99c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:16.300783 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8e316-465c-4f2b-8179-2329bd3a99c0 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:47:16.371918 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973bfc6-00e5-43d3-b3e9-84d7115c0c31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:47:16.372571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973bfc6-00e5-43d3-b3e9-84d7115c0c31 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:16.372855 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973bfc6-00e5-43d3-b3e9-84d7115c0c31 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:16.373131 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973bfc6-00e5-43d3-b3e9-84d7115c0c31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:16.374799 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6973bfc6-00e5-43d3-b3e9-84d7115c0c31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:16.479231 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6973bfc6-00e5-43d3-b3e9-84d7115c0c31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:47:16.481331 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6973bfc6-00e5-43d3-b3e9-84d7115c0c31 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:47:16.498979 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 664/1326] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:47:18.836240 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9958121-be36-4048-b8ca-b1f73f99035a None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:18.836798 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9958121-be36-4048-b8ca-b1f73f99035a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:18.836798 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9958121-be36-4048-b8ca-b1f73f99035a None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:18.838299 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 663/1327] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:47:18.843825 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6676dc-1100-4311-9fb7-d66ded3392e4 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:18.844252 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6676dc-1100-4311-9fb7-d66ded3392e4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:18.844384 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6676dc-1100-4311-9fb7-d66ded3392e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:18.906203 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-8a6676dc-1100-4311-9fb7-d66ded3392e4 None None] MFA Rules not processed for user `80fe3955cd0843e783a1c35d76b757b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:47:18.907398 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-8a6676dc-1100-4311-9fb7-d66ded3392e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:19.001114 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 665/1328] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:47:18 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:47:19.056297 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6dbd7-f9e8-44fe-969e-d81264cd0808 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:19.056594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6dbd7-f9e8-44fe-969e-d81264cd0808 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:19.056877 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6dbd7-f9e8-44fe-969e-d81264cd0808 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:19.058854 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 664/1329] 10.222.0.67 () {54 vars in 963 bytes} [Mon Apr 11 13:47:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:47:19.064911 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182228bf-6430-4aed-96df-169a1c498ad2 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:19.065204 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182228bf-6430-4aed-96df-169a1c498ad2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:19.065484 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182228bf-6430-4aed-96df-169a1c498ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:19.137527 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-182228bf-6430-4aed-96df-169a1c498ad2 None None] MFA Rules not processed for user `c084d218ea414d638ef2dc45364a492c`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:47:19.138720 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-182228bf-6430-4aed-96df-169a1c498ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:19.211230 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 666/1330] 10.222.0.67 () {58 vars in 1060 bytes} [Mon Apr 11 13:47:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:47:19.220770 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6dbd7-f9e8-44fe-969e-d81264cd0808 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:47:19.222278 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c7f6dbd7-f9e8-44fe-969e-d81264cd0808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:19.320779 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6dbd7-f9e8-44fe-969e-d81264cd0808 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:47:19.392225 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce87f80-26fd-4e69-982d-333fe40b0173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:47:19.392801 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce87f80-26fd-4e69-982d-333fe40b0173 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:19.393148 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce87f80-26fd-4e69-982d-333fe40b0173 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:19.393358 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce87f80-26fd-4e69-982d-333fe40b0173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:19.395021 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-dce87f80-26fd-4e69-982d-333fe40b0173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:19.500327 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce87f80-26fd-4e69-982d-333fe40b0173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:47:19.501764 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce87f80-26fd-4e69-982d-333fe40b0173 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:47:19.518843 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 665/1331] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:47:19 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:47:22.477594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a6cee-654a-4f5d-8fec-a25fd3237023 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:22.478070 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a6cee-654a-4f5d-8fec-a25fd3237023 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:22.478192 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a6cee-654a-4f5d-8fec-a25fd3237023 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:22.479521 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 667/1332] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:47:22.485645 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eeed7f-791c-4b88-a412-47b63e7491f8 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:22.486093 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eeed7f-791c-4b88-a412-47b63e7491f8 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:22.486275 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eeed7f-791c-4b88-a412-47b63e7491f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:22.553736 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e6eeed7f-791c-4b88-a412-47b63e7491f8 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:47:22.554956 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e6eeed7f-791c-4b88-a412-47b63e7491f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:22.652083 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 666/1333] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:47:22.690142 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a6cee-654a-4f5d-8fec-a25fd3237023 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:47:22.691713 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-8f0a6cee-654a-4f5d-8fec-a25fd3237023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:22.790644 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a6cee-654a-4f5d-8fec-a25fd3237023 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:47:22.861196 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18f2c7-fc88-4fc6-82cf-c3e1c3fec32c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:47:22.861770 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18f2c7-fc88-4fc6-82cf-c3e1c3fec32c service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:22.862058 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18f2c7-fc88-4fc6-82cf-c3e1c3fec32c service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:22.862336 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18f2c7-fc88-4fc6-82cf-c3e1c3fec32c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:22.864047 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-8c18f2c7-fc88-4fc6-82cf-c3e1c3fec32c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:22.968533 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18f2c7-fc88-4fc6-82cf-c3e1c3fec32c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:47:22.969977 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18f2c7-fc88-4fc6-82cf-c3e1c3fec32c service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:47:22.987189 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 668/1334] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:47:25.324972 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33667a98-305c-4c25-902a-d81c5ef77426 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:25.325535 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33667a98-305c-4c25-902a-d81c5ef77426 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:25.325650 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33667a98-305c-4c25-902a-d81c5ef77426 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:25.327012 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 667/1335] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:47:25.332102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1917e-d899-49a0-b3ef-ae004a8a1b9e None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:25.332493 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1917e-d899-49a0-b3ef-ae004a8a1b9e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:25.332660 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1917e-d899-49a0-b3ef-ae004a8a1b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:25.405955 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-04f1917e-d899-49a0-b3ef-ae004a8a1b9e None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:47:25.407152 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-04f1917e-d899-49a0-b3ef-ae004a8a1b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:25.497786 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 669/1336] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:47:25.538987 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33667a98-305c-4c25-902a-d81c5ef77426 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:47:25.540515 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-33667a98-305c-4c25-902a-d81c5ef77426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:25.637207 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33667a98-305c-4c25-902a-d81c5ef77426 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:47:25.705847 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7c315-e8ff-4c78-ad66-16b7ec397f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:47:25.706477 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7c315-e8ff-4c78-ad66-16b7ec397f89 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:25.706753 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7c315-e8ff-4c78-ad66-16b7ec397f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:25.707023 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7c315-e8ff-4c78-ad66-16b7ec397f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:25.708647 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-55f7c315-e8ff-4c78-ad66-16b7ec397f89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:25.810108 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7c315-e8ff-4c78-ad66-16b7ec397f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:47:25.811543 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7c315-e8ff-4c78-ad66-16b7ec397f89 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:47:25.829547 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 668/1337] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:47:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:47:28.444151 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5d6e0-67e5-4557-86af-303e4d611f0a None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:28.444637 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5d6e0-67e5-4557-86af-303e4d611f0a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:28.444742 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5d6e0-67e5-4557-86af-303e4d611f0a None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:28.446123 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 670/1338] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:47:28.451478 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26147c73-82c6-42fa-ad84-a98dc95bd3c7 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:28.451899 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26147c73-82c6-42fa-ad84-a98dc95bd3c7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:28.452072 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26147c73-82c6-42fa-ad84-a98dc95bd3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:28.513502 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-26147c73-82c6-42fa-ad84-a98dc95bd3c7 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:47:28.514674 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-26147c73-82c6-42fa-ad84-a98dc95bd3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:28.607095 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 669/1339] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:47:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:47:28.641882 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5d6e0-67e5-4557-86af-303e4d611f0a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:47:28.643403 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-8ae5d6e0-67e5-4557-86af-303e4d611f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:28.743158 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5d6e0-67e5-4557-86af-303e4d611f0a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:47:28.815242 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ea4c3-a293-4941-a21f-f8449cb10c34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:47:28.815923 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ea4c3-a293-4941-a21f-f8449cb10c34 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:28.816205 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ea4c3-a293-4941-a21f-f8449cb10c34 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:28.816476 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ea4c3-a293-4941-a21f-f8449cb10c34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:28.818116 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-157ea4c3-a293-4941-a21f-f8449cb10c34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:28.920309 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ea4c3-a293-4941-a21f-f8449cb10c34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:47:28.921727 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ea4c3-a293-4941-a21f-f8449cb10c34 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:47:28.939114 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 671/1340] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:47:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:47:33.255944 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e7d13-b3c2-4753-81cd-5326f9f3f0f4 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:33.256463 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e7d13-b3c2-4753-81cd-5326f9f3f0f4 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:33.256574 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e7d13-b3c2-4753-81cd-5326f9f3f0f4 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:33.257875 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 670/1341] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:47:33.264318 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75224e05-8a01-4f85-bbba-4c66a336f135 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:33.264717 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75224e05-8a01-4f85-bbba-4c66a336f135 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:33.264886 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75224e05-8a01-4f85-bbba-4c66a336f135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:33.333701 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-75224e05-8a01-4f85-bbba-4c66a336f135 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:47:33.334893 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-75224e05-8a01-4f85-bbba-4c66a336f135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:33.445204 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 672/1342] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:47:33.488425 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e7d13-b3c2-4753-81cd-5326f9f3f0f4 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:47:33.490602 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6a5e7d13-b3c2-4753-81cd-5326f9f3f0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:33.583305 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e7d13-b3c2-4753-81cd-5326f9f3f0f4 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:47:33.586798 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765e76b-8530-44da-9b27-7ed363c16195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:47:33.587446 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765e76b-8530-44da-9b27-7ed363c16195 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:33.587768 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765e76b-8530-44da-9b27-7ed363c16195 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:33.588041 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765e76b-8530-44da-9b27-7ed363c16195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:33.596785 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765e76b-8530-44da-9b27-7ed363c16195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:47:33.598218 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765e76b-8530-44da-9b27-7ed363c16195 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:47:33.607549 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 671/1343] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:47:36.720961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99d427-0731-4669-87c8-bb5eae2db4a0 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:36.721504 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99d427-0731-4669-87c8-bb5eae2db4a0 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:36.721504 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99d427-0731-4669-87c8-bb5eae2db4a0 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:36.722963 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 673/1344] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:47:36.728239 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596a34d-a9c2-4eac-abf7-806ae423cfe3 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:36.728698 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596a34d-a9c2-4eac-abf7-806ae423cfe3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:36.728886 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596a34d-a9c2-4eac-abf7-806ae423cfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:36.756582 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-9596a34d-a9c2-4eac-abf7-806ae423cfe3 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:47:36.757765 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9596a34d-a9c2-4eac-abf7-806ae423cfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:36.831802 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 672/1345] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:47:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:47:36.868971 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99d427-0731-4669-87c8-bb5eae2db4a0 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:47:36.879953 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99d427-0731-4669-87c8-bb5eae2db4a0 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:47:36.883345 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f9bf5-cb06-42f2-8f91-01d176a23d56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:47:36.884007 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f9bf5-cb06-42f2-8f91-01d176a23d56 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:36.884283 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f9bf5-cb06-42f2-8f91-01d176a23d56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:36.884553 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f9bf5-cb06-42f2-8f91-01d176a23d56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:36.893938 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f9bf5-cb06-42f2-8f91-01d176a23d56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:47:36.895378 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f9bf5-cb06-42f2-8f91-01d176a23d56 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:47:36.904721 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 674/1346] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:47:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:47:41.447816 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07234173-c33f-47c3-8a63-f920b448196e None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:41.448351 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07234173-c33f-47c3-8a63-f920b448196e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:41.448444 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07234173-c33f-47c3-8a63-f920b448196e None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:41.450264 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 673/1347] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:47:41.455368 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b03492-dc0f-4d42-ab9b-7d758dbcaec6 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:41.455810 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b03492-dc0f-4d42-ab9b-7d758dbcaec6 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:41.455958 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b03492-dc0f-4d42-ab9b-7d758dbcaec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:41.473925 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-71b03492-dc0f-4d42-ab9b-7d758dbcaec6 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:47:41.475107 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-71b03492-dc0f-4d42-ab9b-7d758dbcaec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:41.483043 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 675/1348] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:47:41.522095 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07234173-c33f-47c3-8a63-f920b448196e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:47:41.533535 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07234173-c33f-47c3-8a63-f920b448196e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:47:41.537500 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c4842-c30e-49ad-9060-4de848ef7855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:47:41.538179 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c4842-c30e-49ad-9060-4de848ef7855 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:41.538470 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c4842-c30e-49ad-9060-4de848ef7855 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:41.538749 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c4842-c30e-49ad-9060-4de848ef7855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:41.549627 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c4842-c30e-49ad-9060-4de848ef7855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:47:41.551075 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c4842-c30e-49ad-9060-4de848ef7855 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:47:41.561895 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 674/1349] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:47:46.905251 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20363f6-c096-44a4-b6a8-d3a2c7463314 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:46.906126 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20363f6-c096-44a4-b6a8-d3a2c7463314 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:46.906578 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20363f6-c096-44a4-b6a8-d3a2c7463314 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:46.908693 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 676/1350] 10.222.0.67 () {54 vars in 921 bytes} [Mon Apr 11 13:47:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:47:46.913907 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29c4e4-c035-49b7-a077-e738f2ebabad None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:46.914680 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29c4e4-c035-49b7-a077-e738f2ebabad None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:46.915103 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29c4e4-c035-49b7-a077-e738f2ebabad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:46.983317 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-8e29c4e4-c035-49b7-a077-e738f2ebabad None None] MFA Rules not processed for user `1885d4d35b6743299a73b3c12b1793b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:47:46.984870 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8e29c4e4-c035-49b7-a077-e738f2ebabad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:47.058629 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 675/1351] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Apr 11 13:47:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:47:51.524888 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad193ae-23e8-4130-ad25-e274428d5807 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:51.525417 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad193ae-23e8-4130-ad25-e274428d5807 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:51.525417 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad193ae-23e8-4130-ad25-e274428d5807 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:51.527020 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 677/1352] 10.222.0.67 () {54 vars in 921 bytes} [Mon Apr 11 13:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:47:51.532744 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4213bba-7e86-49d5-9cb6-f14c10103840 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:51.533176 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4213bba-7e86-49d5-9cb6-f14c10103840 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:51.533293 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4213bba-7e86-49d5-9cb6-f14c10103840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:51.553055 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c4213bba-7e86-49d5-9cb6-f14c10103840 None None] MFA Rules not processed for user `1885d4d35b6743299a73b3c12b1793b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:47:51.554588 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c4213bba-7e86-49d5-9cb6-f14c10103840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:51.565371 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 676/1353] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Apr 11 13:47:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:47:53.073224 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707727db-9ec4-4ca4-a4d9-1765f2cd6769 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:53.073768 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707727db-9ec4-4ca4-a4d9-1765f2cd6769 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:53.074213 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707727db-9ec4-4ca4-a4d9-1765f2cd6769 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:53.075981 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 678/1354] 10.222.0.67 () {54 vars in 921 bytes} [Mon Apr 11 13:47:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:47:53.081518 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2a79d-c0f7-427a-a314-da09de202ecc None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:53.081993 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2a79d-c0f7-427a-a314-da09de202ecc None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:53.082386 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2a79d-c0f7-427a-a314-da09de202ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:53.101292 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d6f2a79d-c0f7-427a-a314-da09de202ecc None None] MFA Rules not processed for user `1885d4d35b6743299a73b3c12b1793b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:47:53.107943 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d6f2a79d-c0f7-427a-a314-da09de202ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:53.111953 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 677/1355] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Apr 11 13:47:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:47:56.996023 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f2dda-218f-44d3-ba2a-afcf55754aa6 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:56.996609 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f2dda-218f-44d3-ba2a-afcf55754aa6 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:56.996609 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f2dda-218f-44d3-ba2a-afcf55754aa6 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:56.998448 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 679/1356] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:47:57.003586 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58a0de-3ac6-4043-8ec9-228d5c7318e1 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:57.004422 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58a0de-3ac6-4043-8ec9-228d5c7318e1 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:57.004873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58a0de-3ac6-4043-8ec9-228d5c7318e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:57.023498 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7f58a0de-3ac6-4043-8ec9-228d5c7318e1 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:47:57.024950 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7f58a0de-3ac6-4043-8ec9-228d5c7318e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:57.036100 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 678/1357] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:47:57.084211 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab25d6-5735-4eda-a0cb-bab41fb2c417 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:57.084524 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab25d6-5735-4eda-a0cb-bab41fb2c417 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:57.084784 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab25d6-5735-4eda-a0cb-bab41fb2c417 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:57.086267 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 680/1358] 10.222.0.67 () {54 vars in 960 bytes} [Mon Apr 11 13:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:47:57.093199 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54e99e-2aa5-4902-a1d7-7c520ee81fd6 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:57.093501 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54e99e-2aa5-4902-a1d7-7c520ee81fd6 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:57.093793 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54e99e-2aa5-4902-a1d7-7c520ee81fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:57.143719 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-dd54e99e-2aa5-4902-a1d7-7c520ee81fd6 None None] MFA Rules not processed for user `fedd2314dc594bcba749bf7b0d1e50fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:47:57.144935 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-dd54e99e-2aa5-4902-a1d7-7c520ee81fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:57.228324 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 679/1359] 10.222.0.67 () {58 vars in 1057 bytes} [Mon Apr 11 13:47:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:47:57.236216 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab25d6-5735-4eda-a0cb-bab41fb2c417 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:47:57.250853 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab25d6-5735-4eda-a0cb-bab41fb2c417 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:47:57.256348 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dbfdb-dec9-458d-9afb-fc582b692a47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:47:57.256995 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dbfdb-dec9-458d-9afb-fc582b692a47 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:57.257276 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dbfdb-dec9-458d-9afb-fc582b692a47 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:57.257680 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dbfdb-dec9-458d-9afb-fc582b692a47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:57.267541 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dbfdb-dec9-458d-9afb-fc582b692a47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:47:57.269254 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dbfdb-dec9-458d-9afb-fc582b692a47 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:47:57.278898 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 681/1360] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:47:59.805486 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28777df2-cb80-455a-b0b6-f5e6de2876f5 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:59.806267 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28777df2-cb80-455a-b0b6-f5e6de2876f5 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:59.806376 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28777df2-cb80-455a-b0b6-f5e6de2876f5 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:59.807717 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 680/1361] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:47:59.813578 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ff447-024c-4496-8155-22f3c36db891 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:59.814369 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ff447-024c-4496-8155-22f3c36db891 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:59.814648 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ff447-024c-4496-8155-22f3c36db891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:59.832913 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-494ff447-024c-4496-8155-22f3c36db891 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:47:59.834134 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-494ff447-024c-4496-8155-22f3c36db891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:47:59.842962 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 682/1362] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:47:59.889793 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28777df2-cb80-455a-b0b6-f5e6de2876f5 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:47:59.904341 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28777df2-cb80-455a-b0b6-f5e6de2876f5 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:47:59.909728 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422dfeee-8204-4371-a708-8a6f0a1b0bf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:47:59.910931 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422dfeee-8204-4371-a708-8a6f0a1b0bf7 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:47:59.910931 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422dfeee-8204-4371-a708-8a6f0a1b0bf7 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:47:59.910931 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422dfeee-8204-4371-a708-8a6f0a1b0bf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:47:59.919557 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422dfeee-8204-4371-a708-8a6f0a1b0bf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:47:59.921324 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422dfeee-8204-4371-a708-8a6f0a1b0bf7 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:47:59.930974 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 681/1363] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:47:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:02.580500 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2d37f-855d-41f0-9d02-11f425378316 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:02.580988 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2d37f-855d-41f0-9d02-11f425378316 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:02.581082 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2d37f-855d-41f0-9d02-11f425378316 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:02.582469 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 683/1364] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:02.587906 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aa7e1-9426-4a1a-b6fc-3a219da10211 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:02.588299 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aa7e1-9426-4a1a-b6fc-3a219da10211 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:02.588459 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aa7e1-9426-4a1a-b6fc-3a219da10211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:02.607008 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-748aa7e1-9426-4a1a-b6fc-3a219da10211 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:02.608994 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-748aa7e1-9426-4a1a-b6fc-3a219da10211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:02.616912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 682/1365] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:02.663781 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b6c59-bee0-4a4c-a14a-6c100b4046c7 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:02.664069 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b6c59-bee0-4a4c-a14a-6c100b4046c7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:02.664343 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b6c59-bee0-4a4c-a14a-6c100b4046c7 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:02.665896 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 684/1366] 10.222.0.67 () {54 vars in 960 bytes} [Mon Apr 11 13:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:02.672012 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621688a-a8f1-447e-bf96-8917f5a68706 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:02.672691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621688a-a8f1-447e-bf96-8917f5a68706 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:02.673109 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621688a-a8f1-447e-bf96-8917f5a68706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:02.693113 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-1621688a-a8f1-447e-bf96-8917f5a68706 None None] MFA Rules not processed for user `fedd2314dc594bcba749bf7b0d1e50fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:02.694323 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1621688a-a8f1-447e-bf96-8917f5a68706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:02.715573 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 683/1367] 10.222.0.67 () {58 vars in 1057 bytes} [Mon Apr 11 13:48:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:02.723422 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b6c59-bee0-4a4c-a14a-6c100b4046c7 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:48:02.741461 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b6c59-bee0-4a4c-a14a-6c100b4046c7 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:48:02.746981 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c880ba-2244-43a6-8206-cd0e75f0c815 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:48:02.749290 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c880ba-2244-43a6-8206-cd0e75f0c815 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:02.750343 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c880ba-2244-43a6-8206-cd0e75f0c815 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:02.750343 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c880ba-2244-43a6-8206-cd0e75f0c815 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:02.759285 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c880ba-2244-43a6-8206-cd0e75f0c815 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:48:02.761033 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c880ba-2244-43a6-8206-cd0e75f0c815 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:48:02.771334 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 685/1368] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:05.153656 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd75ec6-6536-4627-bb89-8d5076862aa4 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:05.154722 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd75ec6-6536-4627-bb89-8d5076862aa4 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:05.154809 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd75ec6-6536-4627-bb89-8d5076862aa4 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:05.156686 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 684/1369] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:48:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:05.161656 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d04314-75fe-4cb0-b711-8d6813cff873 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:05.162102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d04314-75fe-4cb0-b711-8d6813cff873 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:05.162221 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d04314-75fe-4cb0-b711-8d6813cff873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:05.180989 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-11d04314-75fe-4cb0-b711-8d6813cff873 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:05.182423 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-11d04314-75fe-4cb0-b711-8d6813cff873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:05.190597 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 686/1370] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:05.196314 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1f3fb-0ee4-4b14-a416-500883055b53 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:05.196599 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1f3fb-0ee4-4b14-a416-500883055b53 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:05.196866 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1f3fb-0ee4-4b14-a416-500883055b53 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:05.198687 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 685/1371] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:05.203986 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb16d7d-56d7-43f4-9b54-0547a68a2cb5 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:05.204278 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb16d7d-56d7-43f4-9b54-0547a68a2cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:05.204556 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb16d7d-56d7-43f4-9b54-0547a68a2cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:05.224141 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-dcb16d7d-56d7-43f4-9b54-0547a68a2cb5 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:05.225375 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-dcb16d7d-56d7-43f4-9b54-0547a68a2cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:05.234679 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 687/1372] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:05.236357 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1f3fb-0ee4-4b14-a416-500883055b53 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:48:05.250746 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1f3fb-0ee4-4b14-a416-500883055b53 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:48:05.256390 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c944f3b-3094-441b-8651-e6bac3d214ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:48:05.257042 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c944f3b-3094-441b-8651-e6bac3d214ac service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:05.257317 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c944f3b-3094-441b-8651-e6bac3d214ac service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:05.257587 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c944f3b-3094-441b-8651-e6bac3d214ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:05.266333 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c944f3b-3094-441b-8651-e6bac3d214ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:48:05.267953 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c944f3b-3094-441b-8651-e6bac3d214ac service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:48:05.277911 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 686/1373] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:48:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:05.551610 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4050a0-43a4-4dca-9c6a-6b69776e41e2 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:05.552032 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4050a0-43a4-4dca-9c6a-6b69776e41e2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:05.552503 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4050a0-43a4-4dca-9c6a-6b69776e41e2 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:05.554055 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 688/1374] 10.222.0.67 () {54 vars in 962 bytes} [Mon Apr 11 13:48:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:05.560164 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c36b6a-7775-45ee-9921-6304ee14b156 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:05.561185 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c36b6a-7775-45ee-9921-6304ee14b156 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:05.561711 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c36b6a-7775-45ee-9921-6304ee14b156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:05.612024 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e6c36b6a-7775-45ee-9921-6304ee14b156 None None] MFA Rules not processed for user `af2e8f671cba49969ccf9e13778b5052`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:05.613316 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e6c36b6a-7775-45ee-9921-6304ee14b156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:05.673636 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 687/1375] 10.222.0.67 () {58 vars in 1059 bytes} [Mon Apr 11 13:48:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:48:05.681226 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4050a0-43a4-4dca-9c6a-6b69776e41e2 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:48:05.693250 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4050a0-43a4-4dca-9c6a-6b69776e41e2 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:48:05.696821 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80897e25-aca4-4a7b-9aa4-8b0eb1000c14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:48:05.697459 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80897e25-aca4-4a7b-9aa4-8b0eb1000c14 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:05.697742 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80897e25-aca4-4a7b-9aa4-8b0eb1000c14 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:05.698012 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80897e25-aca4-4a7b-9aa4-8b0eb1000c14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:05.709105 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80897e25-aca4-4a7b-9aa4-8b0eb1000c14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:48:05.710552 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80897e25-aca4-4a7b-9aa4-8b0eb1000c14 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:48:05.721252 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 689/1376] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:48:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:07.689401 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963356fd-c0e1-43bb-8128-245074d2e30d None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:07.689923 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963356fd-c0e1-43bb-8128-245074d2e30d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:07.690014 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963356fd-c0e1-43bb-8128-245074d2e30d None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:07.691331 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 688/1377] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:07.696787 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1f0eb-42bb-459d-b3e4-1fe010a8a4b3 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:07.697207 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1f0eb-42bb-459d-b3e4-1fe010a8a4b3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:07.697338 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1f0eb-42bb-459d-b3e4-1fe010a8a4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:07.715978 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-64b1f0eb-42bb-459d-b3e4-1fe010a8a4b3 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:07.717842 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-64b1f0eb-42bb-459d-b3e4-1fe010a8a4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:07.726070 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 690/1378] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:07.771198 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963356fd-c0e1-43bb-8128-245074d2e30d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:48:07.786282 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963356fd-c0e1-43bb-8128-245074d2e30d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:48:07.792681 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30730ff-34c3-4798-a406-14b47bf66474 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:48:07.793405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30730ff-34c3-4798-a406-14b47bf66474 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:07.793754 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30730ff-34c3-4798-a406-14b47bf66474 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:07.794031 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30730ff-34c3-4798-a406-14b47bf66474 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:07.803401 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30730ff-34c3-4798-a406-14b47bf66474 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:48:07.805013 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30730ff-34c3-4798-a406-14b47bf66474 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:48:07.815481 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 689/1379] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:10.162667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4df37-bebe-4b4b-8d1e-c41a9472368f None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:10.163513 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4df37-bebe-4b4b-8d1e-c41a9472368f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:10.163824 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4df37-bebe-4b4b-8d1e-c41a9472368f None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:10.165173 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 691/1380] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:48:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:10.170503 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add6f1b-8f3b-4889-8999-7be96f8ae04c None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:10.170923 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add6f1b-8f3b-4889-8999-7be96f8ae04c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:10.171006 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add6f1b-8f3b-4889-8999-7be96f8ae04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:10.188406 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-6add6f1b-8f3b-4889-8999-7be96f8ae04c None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:10.189568 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6add6f1b-8f3b-4889-8999-7be96f8ae04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:10.197380 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 690/1381] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:10.243424 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4df37-bebe-4b4b-8d1e-c41a9472368f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:48:10.258786 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4df37-bebe-4b4b-8d1e-c41a9472368f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:48:10.266336 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf7eb8-7991-4358-9ed7-b62f987c85f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:48:10.266966 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf7eb8-7991-4358-9ed7-b62f987c85f4 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:10.267243 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf7eb8-7991-4358-9ed7-b62f987c85f4 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:10.267516 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf7eb8-7991-4358-9ed7-b62f987c85f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:10.275485 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf7eb8-7991-4358-9ed7-b62f987c85f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:48:10.277086 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf7eb8-7991-4358-9ed7-b62f987c85f4 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:48:10.287359 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 692/1382] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:48:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:12.641782 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b2d70-453b-40a9-8e3c-4f3d6b6eadc9 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:12.642334 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b2d70-453b-40a9-8e3c-4f3d6b6eadc9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:12.642334 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b2d70-453b-40a9-8e3c-4f3d6b6eadc9 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:12.643732 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 691/1383] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:12.648984 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40679264-b4a4-42d9-9a34-ce1112facffc None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:12.649410 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40679264-b4a4-42d9-9a34-ce1112facffc None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:12.649529 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40679264-b4a4-42d9-9a34-ce1112facffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:12.667099 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-40679264-b4a4-42d9-9a34-ce1112facffc None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:12.668307 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-40679264-b4a4-42d9-9a34-ce1112facffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:12.676421 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 693/1384] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:12.719543 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b2d70-453b-40a9-8e3c-4f3d6b6eadc9 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:48:12.733592 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b2d70-453b-40a9-8e3c-4f3d6b6eadc9 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:48:12.739501 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe9919-5dc1-4d40-96a0-b19b26476aa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:48:12.740334 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe9919-5dc1-4d40-96a0-b19b26476aa8 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:12.740719 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe9919-5dc1-4d40-96a0-b19b26476aa8 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:12.741097 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe9919-5dc1-4d40-96a0-b19b26476aa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:12.750543 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe9919-5dc1-4d40-96a0-b19b26476aa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:48:12.752273 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe9919-5dc1-4d40-96a0-b19b26476aa8 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:48:12.762181 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 692/1385] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:48:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:15.415866 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292c3f5-9996-4fa6-9445-9a655d190420 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:15.416408 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292c3f5-9996-4fa6-9445-9a655d190420 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:15.416561 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292c3f5-9996-4fa6-9445-9a655d190420 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:15.417994 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 694/1386] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:15.424517 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2266c-274c-4852-b7b4-bc8d48782a11 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:15.424946 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2266c-274c-4852-b7b4-bc8d48782a11 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:15.425307 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2266c-274c-4852-b7b4-bc8d48782a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:15.448082 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-54b2266c-274c-4852-b7b4-bc8d48782a11 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:15.449678 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-54b2266c-274c-4852-b7b4-bc8d48782a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:15.460084 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 693/1387] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:15.506744 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292c3f5-9996-4fa6-9445-9a655d190420 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:48:15.521883 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292c3f5-9996-4fa6-9445-9a655d190420 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:48:15.527451 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a6cf4-43cd-4fa0-abd8-6ace7318594a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:48:15.528145 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a6cf4-43cd-4fa0-abd8-6ace7318594a service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:15.528440 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a6cf4-43cd-4fa0-abd8-6ace7318594a service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:15.528717 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a6cf4-43cd-4fa0-abd8-6ace7318594a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:15.537112 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a6cf4-43cd-4fa0-abd8-6ace7318594a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:48:15.538759 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a6cf4-43cd-4fa0-abd8-6ace7318594a service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:48:15.548373 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 695/1388] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:48:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:17.939229 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1b860-8c28-40d4-bd0d-8c757bb7bf0d None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:17.939820 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1b860-8c28-40d4-bd0d-8c757bb7bf0d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:17.939820 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1b860-8c28-40d4-bd0d-8c757bb7bf0d None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:17.941188 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 694/1389] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:17.946865 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf7796-bb42-45b8-ac8b-f427524d57cb None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:17.947397 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf7796-bb42-45b8-ac8b-f427524d57cb None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:17.947975 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf7796-bb42-45b8-ac8b-f427524d57cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:17.972088 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-31bf7796-bb42-45b8-ac8b-f427524d57cb None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:17.974079 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-31bf7796-bb42-45b8-ac8b-f427524d57cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:17.984683 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 696/1390] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:18.031217 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1b860-8c28-40d4-bd0d-8c757bb7bf0d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:48:18.050557 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1b860-8c28-40d4-bd0d-8c757bb7bf0d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:48:18.057902 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d86c4-5b43-41b5-9a66-40d0a7863cae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:48:18.058781 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d86c4-5b43-41b5-9a66-40d0a7863cae service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:18.059140 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d86c4-5b43-41b5-9a66-40d0a7863cae service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:18.059488 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d86c4-5b43-41b5-9a66-40d0a7863cae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:18.070061 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d86c4-5b43-41b5-9a66-40d0a7863cae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:48:18.072317 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d86c4-5b43-41b5-9a66-40d0a7863cae service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:48:18.086349 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 695/1391] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:48:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:20.688864 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f4c0b-cb51-48d3-bcb0-07a54335a420 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:20.689421 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f4c0b-cb51-48d3-bcb0-07a54335a420 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:20.689421 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f4c0b-cb51-48d3-bcb0-07a54335a420 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:20.690722 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 697/1392] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:20.696086 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698bae7-81b6-4bea-876e-cd33218412ba None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:20.696499 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698bae7-81b6-4bea-876e-cd33218412ba None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:20.696646 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698bae7-81b6-4bea-876e-cd33218412ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:20.713805 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-b698bae7-81b6-4bea-876e-cd33218412ba None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:20.715019 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b698bae7-81b6-4bea-876e-cd33218412ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:20.722868 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 696/1393] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:20.768060 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f4c0b-cb51-48d3-bcb0-07a54335a420 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:48:20.782711 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f4c0b-cb51-48d3-bcb0-07a54335a420 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:48:20.788156 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4f435-facc-4cf4-a970-88754389f6fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:48:20.788789 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4f435-facc-4cf4-a970-88754389f6fe service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:20.789071 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4f435-facc-4cf4-a970-88754389f6fe service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:20.789344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4f435-facc-4cf4-a970-88754389f6fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:20.797829 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4f435-facc-4cf4-a970-88754389f6fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:48:20.799405 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4f435-facc-4cf4-a970-88754389f6fe service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:48:20.808852 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 698/1394] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:48:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:21.692137 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4fb49-2a31-49a4-a6f8-aa4983935879 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:21.692336 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4fb49-2a31-49a4-a6f8-aa4983935879 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:21.692614 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4fb49-2a31-49a4-a6f8-aa4983935879 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:21.694012 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 697/1395] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:21.699179 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ff7ab-c545-428b-8a66-ef75c3093bfc None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:21.699664 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ff7ab-c545-428b-8a66-ef75c3093bfc None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:21.699766 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ff7ab-c545-428b-8a66-ef75c3093bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:21.718216 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-dd4ff7ab-c545-428b-8a66-ef75c3093bfc None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:21.719488 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-dd4ff7ab-c545-428b-8a66-ef75c3093bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:21.727836 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 699/1396] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:21.786988 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a53747-d7f1-47ae-b42a-96d2543b6bce None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:21.787476 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a53747-d7f1-47ae-b42a-96d2543b6bce None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:21.787567 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a53747-d7f1-47ae-b42a-96d2543b6bce None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:21.789085 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 698/1397] 10.222.0.67 () {54 vars in 961 bytes} [Mon Apr 11 13:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:21.793909 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39af3b-64d2-4192-aadb-09836f82a90b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:21.794212 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39af3b-64d2-4192-aadb-09836f82a90b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:21.794486 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39af3b-64d2-4192-aadb-09836f82a90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:21.843355 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0e39af3b-64d2-4192-aadb-09836f82a90b None None] MFA Rules not processed for user `08cbf69574af4e25b940ec038f9e1bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:21.844593 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0e39af3b-64d2-4192-aadb-09836f82a90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:21.903463 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 700/1398] 10.222.0.67 () {58 vars in 1058 bytes} [Mon Apr 11 13:48:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:21.911476 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a53747-d7f1-47ae-b42a-96d2543b6bce None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:48:21.922295 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a53747-d7f1-47ae-b42a-96d2543b6bce None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:48:21.925789 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adb5b0-d7b0-4452-9ea4-b5edc5bb6b24 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cbf69574af4e25b940ec038f9e1bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:48:21.926599 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adb5b0-d7b0-4452-9ea4-b5edc5bb6b24 service glance] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:21.926703 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adb5b0-d7b0-4452-9ea4-b5edc5bb6b24 service glance] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:21.927215 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adb5b0-d7b0-4452-9ea4-b5edc5bb6b24 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:21.937361 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adb5b0-d7b0-4452-9ea4-b5edc5bb6b24 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:48:21.938911 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adb5b0-d7b0-4452-9ea4-b5edc5bb6b24 service glance] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:48:21.948408 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 699/1399] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:48:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:22.363551 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aee7f7-304b-4882-978d-195f3f43b82e None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:22.364077 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aee7f7-304b-4882-978d-195f3f43b82e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:22.364419 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aee7f7-304b-4882-978d-195f3f43b82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:22.413201 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b5aee7f7-304b-4882-978d-195f3f43b82e None None] MFA Rules not processed for user `920ed843195243f8abd6dfb2ebb3a549`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:22.414408 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b5aee7f7-304b-4882-978d-195f3f43b82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:22.476258 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 701/1400] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Apr 11 13:48:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:22.519769 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c4772-5126-4bdf-8ba8-80b126c02524 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:22.519961 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c4772-5126-4bdf-8ba8-80b126c02524 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:22.520357 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c4772-5126-4bdf-8ba8-80b126c02524 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:22.521925 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 700/1401] 10.222.0.67 () {54 vars in 942 bytes} [Mon Apr 11 13:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:22.531003 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0291b-e2c4-4b04-af77-042850db5df4 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:22.531298 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0291b-e2c4-4b04-af77-042850db5df4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:22.531580 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0291b-e2c4-4b04-af77-042850db5df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:22.580225 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-caa0291b-e2c4-4b04-af77-042850db5df4 None None] MFA Rules not processed for user `6660794b27ff4a7bbe9b6b043593598c`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:22.581470 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-caa0291b-e2c4-4b04-af77-042850db5df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:22.650616 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 702/1402] 10.222.0.67 () {58 vars in 1039 bytes} [Mon Apr 11 13:48:22 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:22.659496 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c4772-5126-4bdf-8ba8-80b126c02524 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:48:22.673250 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c4772-5126-4bdf-8ba8-80b126c02524 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:48:22.678118 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7a5e5-0494-436b-a86e-22baba98ab30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6660794b27ff4a7bbe9b6b043593598c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:48:22.678757 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7a5e5-0494-436b-a86e-22baba98ab30 service swift] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:22.679044 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7a5e5-0494-436b-a86e-22baba98ab30 service swift] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:22.679324 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7a5e5-0494-436b-a86e-22baba98ab30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:22.688311 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7a5e5-0494-436b-a86e-22baba98ab30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:48:22.689895 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7a5e5-0494-436b-a86e-22baba98ab30 service swift] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:48:22.697836 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 701/1403] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Apr 11 13:48:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:48:23.188548 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9f0ee-6719-4230-9899-4ade07883159 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:23.189108 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9f0ee-6719-4230-9899-4ade07883159 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:23.189108 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9f0ee-6719-4230-9899-4ade07883159 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:23.190607 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 703/1404] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:23.195823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a80f1-8677-4daf-bb2a-bcc4769f5642 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:23.196260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a80f1-8677-4daf-bb2a-bcc4769f5642 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:23.196418 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a80f1-8677-4daf-bb2a-bcc4769f5642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:23.214887 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-b90a80f1-8677-4daf-bb2a-bcc4769f5642 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:23.216214 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b90a80f1-8677-4daf-bb2a-bcc4769f5642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:23.225698 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 702/1405] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:23.276835 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9f0ee-6719-4230-9899-4ade07883159 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:48:23.292663 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9f0ee-6719-4230-9899-4ade07883159 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:48:23.301895 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d57ae-6133-4ba3-b00c-ddeb4e20cb29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:48:23.302551 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d57ae-6133-4ba3-b00c-ddeb4e20cb29 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:23.302830 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d57ae-6133-4ba3-b00c-ddeb4e20cb29 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:23.303103 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d57ae-6133-4ba3-b00c-ddeb4e20cb29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:23.312977 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d57ae-6133-4ba3-b00c-ddeb4e20cb29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:48:23.314567 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d57ae-6133-4ba3-b00c-ddeb4e20cb29 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:48:23.325975 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 704/1406] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:48:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:25.776254 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaf7e1-e109-4e34-8396-b89f9d4165ec None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:25.776764 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaf7e1-e109-4e34-8396-b89f9d4165ec None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:25.776764 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaf7e1-e109-4e34-8396-b89f9d4165ec None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:25.778092 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 703/1407] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:25.783548 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df7327-f465-4c82-ab4e-51ad90e3cc4a None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:25.784363 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df7327-f465-4c82-ab4e-51ad90e3cc4a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:25.784648 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df7327-f465-4c82-ab4e-51ad90e3cc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:25.803363 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-08df7327-f465-4c82-ab4e-51ad90e3cc4a None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:25.804622 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-08df7327-f465-4c82-ab4e-51ad90e3cc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:25.815672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 705/1408] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:25.859018 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaf7e1-e109-4e34-8396-b89f9d4165ec None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:48:25.877921 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaf7e1-e109-4e34-8396-b89f9d4165ec None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:48:25.883379 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51c0fd-3245-478b-a88c-4f2258846b34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:48:25.884052 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51c0fd-3245-478b-a88c-4f2258846b34 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:25.884331 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51c0fd-3245-478b-a88c-4f2258846b34 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:25.884600 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51c0fd-3245-478b-a88c-4f2258846b34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:25.894797 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51c0fd-3245-478b-a88c-4f2258846b34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:48:25.896431 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51c0fd-3245-478b-a88c-4f2258846b34 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:48:25.906917 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 704/1409] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:46.533159 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c79a3-a8a3-43c1-b721-9bc221986df0 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:46.533773 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c79a3-a8a3-43c1-b721-9bc221986df0 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:46.533773 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c79a3-a8a3-43c1-b721-9bc221986df0 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:46.535079 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 706/1410] 10.222.0.67 () {54 vars in 918 bytes} [Mon Apr 11 13:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:48:46.540372 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a4412-3ac8-4b72-ab16-5656bf66640b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:46.540824 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a4412-3ac8-4b72-ab16-5656bf66640b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:46.541007 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a4412-3ac8-4b72-ab16-5656bf66640b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:46.559109 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-969a4412-3ac8-4b72-ab16-5656bf66640b None None] MFA Rules not processed for user `1885d4d35b6743299a73b3c12b1793b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:46.560304 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-969a4412-3ac8-4b72-ab16-5656bf66640b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:46.569133 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 705/1411] 10.222.0.67 () {58 vars in 1015 bytes} [Mon Apr 11 13:48:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:48:46.583782 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c717bb-3d3c-476d-a52f-e55055d73535 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:46.584074 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c717bb-3d3c-476d-a52f-e55055d73535 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:46.584354 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c717bb-3d3c-476d-a52f-e55055d73535 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:46.585716 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 707/1412] 10.222.0.67 () {54 vars in 918 bytes} [Mon Apr 11 13:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:46.590132 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cd6ad-6c19-4533-94da-71d0f7b7faec None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:46.590420 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cd6ad-6c19-4533-94da-71d0f7b7faec None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:46.590701 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cd6ad-6c19-4533-94da-71d0f7b7faec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:46.608003 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-cd8cd6ad-6c19-4533-94da-71d0f7b7faec None None] MFA Rules not processed for user `fedd2314dc594bcba749bf7b0d1e50fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:46.609387 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-cd8cd6ad-6c19-4533-94da-71d0f7b7faec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:46.618406 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 706/1413] 10.222.0.67 () {58 vars in 1015 bytes} [Mon Apr 11 13:48:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:49.394076 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fc280-3bec-47ff-af8a-af8cd54ef497 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:49.394657 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fc280-3bec-47ff-af8a-af8cd54ef497 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:49.394948 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fc280-3bec-47ff-af8a-af8cd54ef497 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:49.396961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:48:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:49.402276 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc279f5-ab02-4a34-bc03-6061df631eb7 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:49.402697 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc279f5-ab02-4a34-bc03-6061df631eb7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:49.402849 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc279f5-ab02-4a34-bc03-6061df631eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:49.420349 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-5dc279f5-ab02-4a34-bc03-6061df631eb7 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:49.422198 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5dc279f5-ab02-4a34-bc03-6061df631eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:49.429965 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:49.473650 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fc280-3bec-47ff-af8a-af8cd54ef497 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:48:49.488238 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fc280-3bec-47ff-af8a-af8cd54ef497 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:48:49.493641 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88bbac-fb68-4b27-ba8b-cdc91d5680d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:48:49.494269 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88bbac-fb68-4b27-ba8b-cdc91d5680d8 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:49.494549 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88bbac-fb68-4b27-ba8b-cdc91d5680d8 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:49.494848 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88bbac-fb68-4b27-ba8b-cdc91d5680d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:49.502720 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88bbac-fb68-4b27-ba8b-cdc91d5680d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:48:49.504370 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88bbac-fb68-4b27-ba8b-cdc91d5680d8 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:48:49.513439 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 709/1416] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:48:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:50.873560 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b2050-9e05-4dd6-b8b1-35fd0558d0e9 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:50.874068 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b2050-9e05-4dd6-b8b1-35fd0558d0e9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:50.874068 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b2050-9e05-4dd6-b8b1-35fd0558d0e9 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:50.876013 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:50.881031 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8db9fc-a7ae-44b6-9fa0-a863d36d61be None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:50.881463 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8db9fc-a7ae-44b6-9fa0-a863d36d61be None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:50.881592 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8db9fc-a7ae-44b6-9fa0-a863d36d61be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:50.899687 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0a8db9fc-a7ae-44b6-9fa0-a863d36d61be None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:50.900888 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0a8db9fc-a7ae-44b6-9fa0-a863d36d61be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:50.909141 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:51.071955 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b2050-9e05-4dd6-b8b1-35fd0558d0e9 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:48:51.086595 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b2050-9e05-4dd6-b8b1-35fd0558d0e9 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:48:51.092191 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db9ea8-603c-405b-8fb2-718c8d82225e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:48:51.092821 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db9ea8-603c-405b-8fb2-718c8d82225e service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:51.093101 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db9ea8-603c-405b-8fb2-718c8d82225e service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:51.093494 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db9ea8-603c-405b-8fb2-718c8d82225e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:51.101477 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db9ea8-603c-405b-8fb2-718c8d82225e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:48:51.103061 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db9ea8-603c-405b-8fb2-718c8d82225e service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:48:51.112163 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 709/1419] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:48:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:52.425092 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2726d1-3c9d-49a2-92cf-5e34a8e760a1 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:52.425567 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2726d1-3c9d-49a2-92cf-5e34a8e760a1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:52.425675 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2726d1-3c9d-49a2-92cf-5e34a8e760a1 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:52.427039 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:52.431897 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e099f-3512-4b5a-8840-2fc90e8c287c None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:52.432289 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e099f-3512-4b5a-8840-2fc90e8c287c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:52.432450 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e099f-3512-4b5a-8840-2fc90e8c287c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:52.451443 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-ee1e099f-3512-4b5a-8840-2fc90e8c287c None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:52.453357 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ee1e099f-3512-4b5a-8840-2fc90e8c287c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:52.461242 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:52.610922 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2726d1-3c9d-49a2-92cf-5e34a8e760a1 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:48:52.625582 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2726d1-3c9d-49a2-92cf-5e34a8e760a1 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:48:52.630957 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806b61c-c879-4b1c-89e8-752ab3f9ba5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:48:52.631589 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806b61c-c879-4b1c-89e8-752ab3f9ba5d service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:52.631904 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806b61c-c879-4b1c-89e8-752ab3f9ba5d service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:52.632180 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806b61c-c879-4b1c-89e8-752ab3f9ba5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:52.640891 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806b61c-c879-4b1c-89e8-752ab3f9ba5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:48:52.642475 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806b61c-c879-4b1c-89e8-752ab3f9ba5d service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:48:52.651780 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 712/1422] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:48:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:53.989934 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543f055-63d8-40c1-8155-dd1b3c4d595e None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:53.990494 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543f055-63d8-40c1-8155-dd1b3c4d595e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:53.990779 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543f055-63d8-40c1-8155-dd1b3c4d595e None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:53.992523 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:48:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:53.997847 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131e01c-69c6-4bb2-a962-c5ebaa29bc3f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:53.998283 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131e01c-69c6-4bb2-a962-c5ebaa29bc3f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:53.998395 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131e01c-69c6-4bb2-a962-c5ebaa29bc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:54.016849 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-7131e01c-69c6-4bb2-a962-c5ebaa29bc3f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:54.018067 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7131e01c-69c6-4bb2-a962-c5ebaa29bc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:54.028192 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:54.186658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543f055-63d8-40c1-8155-dd1b3c4d595e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:48:54.203054 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543f055-63d8-40c1-8155-dd1b3c4d595e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:48:54.209308 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b0c7c-044c-4bbd-8843-4674091b0b89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:48:54.209967 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b0c7c-044c-4bbd-8843-4674091b0b89 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:54.210286 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b0c7c-044c-4bbd-8843-4674091b0b89 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:54.210546 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b0c7c-044c-4bbd-8843-4674091b0b89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:54.219822 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b0c7c-044c-4bbd-8843-4674091b0b89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:48:54.221698 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b0c7c-044c-4bbd-8843-4674091b0b89 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:48:54.232572 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 712/1425] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:48:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:55.558302 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87af16-6b2e-4b1b-860b-8c2cb77fb1e4 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:55.559085 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87af16-6b2e-4b1b-860b-8c2cb77fb1e4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:55.559085 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87af16-6b2e-4b1b-860b-8c2cb77fb1e4 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:55.560493 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:48:55.566024 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079895b1-f6fa-4c63-82d4-de099995a076 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:55.566410 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079895b1-f6fa-4c63-82d4-de099995a076 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:55.566597 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079895b1-f6fa-4c63-82d4-de099995a076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:55.584975 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-079895b1-f6fa-4c63-82d4-de099995a076 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:55.586182 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-079895b1-f6fa-4c63-82d4-de099995a076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:55.594353 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:55.744441 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87af16-6b2e-4b1b-860b-8c2cb77fb1e4 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:48:55.758932 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87af16-6b2e-4b1b-860b-8c2cb77fb1e4 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:48:55.764344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6fe9b-08aa-41e0-a7b8-38785e573c64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:48:55.764973 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6fe9b-08aa-41e0-a7b8-38785e573c64 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:55.765287 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6fe9b-08aa-41e0-a7b8-38785e573c64 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:55.765564 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6fe9b-08aa-41e0-a7b8-38785e573c64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:55.773510 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6fe9b-08aa-41e0-a7b8-38785e573c64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:48:55.775087 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6fe9b-08aa-41e0-a7b8-38785e573c64 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:48:55.784416 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 715/1428] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:48:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:48:57.034632 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17bb34-b460-45d7-b961-c20801d38eb6 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:57.035203 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17bb34-b460-45d7-b961-c20801d38eb6 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:57.035203 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17bb34-b460-45d7-b961-c20801d38eb6 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:57.036583 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:57.041585 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530b12d-eea4-45da-90c8-409180e16fbc None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:57.041987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530b12d-eea4-45da-90c8-409180e16fbc None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:57.042171 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530b12d-eea4-45da-90c8-409180e16fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:57.060427 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-f530b12d-eea4-45da-90c8-409180e16fbc None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:57.061629 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f530b12d-eea4-45da-90c8-409180e16fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:57.069397 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:57.220775 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17bb34-b460-45d7-b961-c20801d38eb6 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:48:57.234832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17bb34-b460-45d7-b961-c20801d38eb6 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:48:57.240212 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b23a72-0ba6-4bb0-a028-ca0f30cdf942 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:48:57.240846 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b23a72-0ba6-4bb0-a028-ca0f30cdf942 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:57.241129 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b23a72-0ba6-4bb0-a028-ca0f30cdf942 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:57.241409 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b23a72-0ba6-4bb0-a028-ca0f30cdf942 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:57.249328 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b23a72-0ba6-4bb0-a028-ca0f30cdf942 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:48:57.250921 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b23a72-0ba6-4bb0-a028-ca0f30cdf942 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:48:57.260307 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 715/1431] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:48:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:48:58.526210 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c8d8a-5401-440d-97d8-09e03aac3a11 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:58.526759 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c8d8a-5401-440d-97d8-09e03aac3a11 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:58.526759 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c8d8a-5401-440d-97d8-09e03aac3a11 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:58.528177 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:48:58.533622 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722eb237-a09b-4759-900a-b5da15375664 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:58.534033 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722eb237-a09b-4759-900a-b5da15375664 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:58.534181 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722eb237-a09b-4759-900a-b5da15375664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:58.552662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-722eb237-a09b-4759-900a-b5da15375664 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:48:58.553841 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-722eb237-a09b-4759-900a-b5da15375664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:48:58.561820 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:48:58.716536 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c8d8a-5401-440d-97d8-09e03aac3a11 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:48:58.730804 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c8d8a-5401-440d-97d8-09e03aac3a11 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:48:58.736795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e2f48-18e2-462c-834d-915830fc633d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:48:58.737429 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e2f48-18e2-462c-834d-915830fc633d service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:48:58.737739 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e2f48-18e2-462c-834d-915830fc633d service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:48:58.738016 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e2f48-18e2-462c-834d-915830fc633d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:48:58.746176 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e2f48-18e2-462c-834d-915830fc633d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:48:58.747813 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e2f48-18e2-462c-834d-915830fc633d service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:48:58.759038 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 718/1434] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:48:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:49:00.006084 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73166e1c-6846-4331-a593-b8fa31930e88 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:00.006587 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73166e1c-6846-4331-a593-b8fa31930e88 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:00.006680 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73166e1c-6846-4331-a593-b8fa31930e88 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:00.008090 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:49:00.013130 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2551b-cb4d-49ba-8f04-ed27d438b863 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:00.013513 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2551b-cb4d-49ba-8f04-ed27d438b863 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:00.013696 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f2551b-cb4d-49ba-8f04-ed27d438b863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:00.031598 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-f6f2551b-cb4d-49ba-8f04-ed27d438b863 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:49:00.032824 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f6f2551b-cb4d-49ba-8f04-ed27d438b863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:49:00.040607 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:49:00.195851 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73166e1c-6846-4331-a593-b8fa31930e88 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:49:00.210604 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73166e1c-6846-4331-a593-b8fa31930e88 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:49:00.215987 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2356b8-f086-4aa1-bbe2-8b80ddb6c366 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:49:00.216622 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2356b8-f086-4aa1-bbe2-8b80ddb6c366 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:00.216926 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2356b8-f086-4aa1-bbe2-8b80ddb6c366 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:00.217189 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2356b8-f086-4aa1-bbe2-8b80ddb6c366 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:00.225738 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2356b8-f086-4aa1-bbe2-8b80ddb6c366 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:49:00.227312 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2356b8-f086-4aa1-bbe2-8b80ddb6c366 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:49:00.236568 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 718/1437] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:49:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:49:01.494082 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa49cb-7eee-4df1-8ddb-a871ff43fdb0 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:01.494638 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa49cb-7eee-4df1-8ddb-a871ff43fdb0 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:01.494638 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa49cb-7eee-4df1-8ddb-a871ff43fdb0 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:01.496004 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:49:01.500911 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fc5f0-04d1-48bd-97e9-f5e0426430e4 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:01.501318 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fc5f0-04d1-48bd-97e9-f5e0426430e4 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:01.501486 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fc5f0-04d1-48bd-97e9-f5e0426430e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:01.518800 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-b72fc5f0-04d1-48bd-97e9-f5e0426430e4 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:49:01.520043 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b72fc5f0-04d1-48bd-97e9-f5e0426430e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:49:01.527714 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:49:01.677199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa49cb-7eee-4df1-8ddb-a871ff43fdb0 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:49:01.691710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa49cb-7eee-4df1-8ddb-a871ff43fdb0 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:49:01.696998 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7366b5-4615-43ba-b5ad-89f4577e6665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:49:01.697621 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7366b5-4615-43ba-b5ad-89f4577e6665 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:01.697901 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7366b5-4615-43ba-b5ad-89f4577e6665 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:01.698171 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7366b5-4615-43ba-b5ad-89f4577e6665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:01.706545 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7366b5-4615-43ba-b5ad-89f4577e6665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:49:01.708152 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7366b5-4615-43ba-b5ad-89f4577e6665 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:49:01.717153 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 721/1440] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:49:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:49:03.905182 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b155e39-885b-41cc-b1c0-b9c08289d4d8 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:03.905743 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b155e39-885b-41cc-b1c0-b9c08289d4d8 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:03.905877 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b155e39-885b-41cc-b1c0-b9c08289d4d8 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:03.907446 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:49:03.912669 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bdcbc-f164-444c-95f2-50e247f68f3f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:03.913132 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bdcbc-f164-444c-95f2-50e247f68f3f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:03.913230 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bdcbc-f164-444c-95f2-50e247f68f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:03.931783 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4b4bdcbc-f164-444c-95f2-50e247f68f3f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:49:03.932977 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4b4bdcbc-f164-444c-95f2-50e247f68f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:49:03.941553 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:49:03.979870 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b155e39-885b-41cc-b1c0-b9c08289d4d8 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:49:03.990799 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b155e39-885b-41cc-b1c0-b9c08289d4d8 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:49:03.994308 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2fae9-ec7f-4b5d-b026-f669299f0fd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:49:03.994946 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2fae9-ec7f-4b5d-b026-f669299f0fd1 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:03.995228 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2fae9-ec7f-4b5d-b026-f669299f0fd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:03.995506 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2fae9-ec7f-4b5d-b026-f669299f0fd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:04.005022 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2fae9-ec7f-4b5d-b026-f669299f0fd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:49:04.006453 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2fae9-ec7f-4b5d-b026-f669299f0fd1 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:49:04.015642 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 721/1443] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:49:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:49:06.478852 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c89501-2beb-47e1-a897-55166a3c065e None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:06.479433 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c89501-2beb-47e1-a897-55166a3c065e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:06.479433 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c89501-2beb-47e1-a897-55166a3c065e None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:06.480786 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:49:06.486660 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601f62f-6988-4efd-8db1-9358566a8aca None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:06.487113 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601f62f-6988-4efd-8db1-9358566a8aca None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:06.487256 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8601f62f-6988-4efd-8db1-9358566a8aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:06.505100 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-8601f62f-6988-4efd-8db1-9358566a8aca None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:49:06.506289 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8601f62f-6988-4efd-8db1-9358566a8aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:49:06.514102 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:49:06.554593 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c89501-2beb-47e1-a897-55166a3c065e None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:49:06.556345 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e4c89501-2beb-47e1-a897-55166a3c065e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:49:06.569283 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c89501-2beb-47e1-a897-55166a3c065e None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:49:06.572801 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa587b28-a581-4746-b36c-8a13e5808896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:49:06.573432 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa587b28-a581-4746-b36c-8a13e5808896 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:06.573714 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa587b28-a581-4746-b36c-8a13e5808896 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:06.573990 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa587b28-a581-4746-b36c-8a13e5808896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:06.582649 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa587b28-a581-4746-b36c-8a13e5808896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:49:06.584158 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa587b28-a581-4746-b36c-8a13e5808896 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:49:06.593238 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 724/1446] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:49:09.189500 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360a41f-c4ca-4de6-b341-0feb6db7486c None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:09.190065 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360a41f-c4ca-4de6-b341-0feb6db7486c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:09.190065 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360a41f-c4ca-4de6-b341-0feb6db7486c None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:09.191425 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:49:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:49:09.196637 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dcfb2-e42b-40f0-ad88-1b31e758ac00 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:09.197045 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dcfb2-e42b-40f0-ad88-1b31e758ac00 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:09.197183 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dcfb2-e42b-40f0-ad88-1b31e758ac00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:09.214159 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-134dcfb2-e42b-40f0-ad88-1b31e758ac00 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:49:09.215334 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-134dcfb2-e42b-40f0-ad88-1b31e758ac00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:49:09.223100 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:49:09.262608 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360a41f-c4ca-4de6-b341-0feb6db7486c None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:49:09.273298 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360a41f-c4ca-4de6-b341-0feb6db7486c None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:49:09.276789 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba96f89-2df1-432b-860c-7adfe727c29a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:49:09.277421 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba96f89-2df1-432b-860c-7adfe727c29a service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:09.277703 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba96f89-2df1-432b-860c-7adfe727c29a service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:09.277979 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba96f89-2df1-432b-860c-7adfe727c29a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:09.286815 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba96f89-2df1-432b-860c-7adfe727c29a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:49:09.288278 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba96f89-2df1-432b-860c-7adfe727c29a service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:49:09.298034 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 724/1449] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:49:11.788868 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff6dae-7174-475f-b33b-d954d4116ced None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:11.789414 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff6dae-7174-475f-b33b-d954d4116ced None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:11.789414 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff6dae-7174-475f-b33b-d954d4116ced None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:11.790720 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:49:11.795814 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c2282-0b7a-42de-8f7b-abafb06ec11d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:11.796197 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c2282-0b7a-42de-8f7b-abafb06ec11d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:11.796362 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c2282-0b7a-42de-8f7b-abafb06ec11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:11.814805 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-5c8c2282-0b7a-42de-8f7b-abafb06ec11d None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:49:11.816018 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5c8c2282-0b7a-42de-8f7b-abafb06ec11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:49:11.823564 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:49:11.863366 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff6dae-7174-475f-b33b-d954d4116ced None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:49:11.873843 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff6dae-7174-475f-b33b-d954d4116ced None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:49:11.877872 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f15ab-732e-4d22-9361-cd482afdeb53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:49:11.878503 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f15ab-732e-4d22-9361-cd482afdeb53 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:11.878786 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f15ab-732e-4d22-9361-cd482afdeb53 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:11.879064 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f15ab-732e-4d22-9361-cd482afdeb53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:11.887724 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f15ab-732e-4d22-9361-cd482afdeb53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:49:11.889144 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f15ab-732e-4d22-9361-cd482afdeb53 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:49:11.899302 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 727/1452] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:49:14.234315 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece8b97-2cc9-4989-8891-28b0fe4b0cc6 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:14.235324 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece8b97-2cc9-4989-8891-28b0fe4b0cc6 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:14.235324 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece8b97-2cc9-4989-8891-28b0fe4b0cc6 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:14.236687 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:49:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:49:14.241805 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767931c-5406-4368-b342-edb36e1cbcdd None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:14.242197 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767931c-5406-4368-b342-edb36e1cbcdd None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:14.242359 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767931c-5406-4368-b342-edb36e1cbcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:14.259377 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e767931c-5406-4368-b342-edb36e1cbcdd None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:49:14.260609 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e767931c-5406-4368-b342-edb36e1cbcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:49:14.268340 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:49:14.307675 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece8b97-2cc9-4989-8891-28b0fe4b0cc6 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:49:14.318412 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece8b97-2cc9-4989-8891-28b0fe4b0cc6 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:49:14.321882 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28086d1-1d17-420c-898c-0a80aec6b941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:49:14.322515 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28086d1-1d17-420c-898c-0a80aec6b941 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:14.322799 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28086d1-1d17-420c-898c-0a80aec6b941 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:14.323075 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28086d1-1d17-420c-898c-0a80aec6b941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:14.331704 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28086d1-1d17-420c-898c-0a80aec6b941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:49:14.333139 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28086d1-1d17-420c-898c-0a80aec6b941 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:49:14.342333 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 727/1455] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:49:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:49:16.694673 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a2fe6-b4de-44b1-8b38-c30ca20e4f01 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:16.695187 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a2fe6-b4de-44b1-8b38-c30ca20e4f01 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:16.695187 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a2fe6-b4de-44b1-8b38-c30ca20e4f01 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:16.696532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:49:16.701815 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d3b88-f96e-4b71-bb79-d61d8b318b80 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:16.702261 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d3b88-f96e-4b71-bb79-d61d8b318b80 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:16.702358 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d3b88-f96e-4b71-bb79-d61d8b318b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:16.719910 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-1c2d3b88-f96e-4b71-bb79-d61d8b318b80 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:49:16.721097 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1c2d3b88-f96e-4b71-bb79-d61d8b318b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:49:16.729201 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:49:16.770039 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a2fe6-b4de-44b1-8b38-c30ca20e4f01 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:49:16.780402 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a2fe6-b4de-44b1-8b38-c30ca20e4f01 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:49:16.783879 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88178202-036a-4468-b5fe-042ae0a4ad94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:49:16.784509 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88178202-036a-4468-b5fe-042ae0a4ad94 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:16.784790 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88178202-036a-4468-b5fe-042ae0a4ad94 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:16.785064 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88178202-036a-4468-b5fe-042ae0a4ad94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:16.794570 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88178202-036a-4468-b5fe-042ae0a4ad94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:49:16.796088 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88178202-036a-4468-b5fe-042ae0a4ad94 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:49:16.806155 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 730/1458] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:49:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:49:19.142077 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523ca9c-3fc2-44c1-bd25-f62f8651aa25 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:19.143128 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523ca9c-3fc2-44c1-bd25-f62f8651aa25 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:19.143236 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523ca9c-3fc2-44c1-bd25-f62f8651aa25 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:19.144678 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:49:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:49:19.149927 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62533bfc-27cd-4134-9ca8-7d92b37eb435 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:19.150345 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62533bfc-27cd-4134-9ca8-7d92b37eb435 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:19.150512 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62533bfc-27cd-4134-9ca8-7d92b37eb435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:19.168201 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-62533bfc-27cd-4134-9ca8-7d92b37eb435 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:49:19.169383 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-62533bfc-27cd-4134-9ca8-7d92b37eb435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:49:19.177220 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:49:19.215024 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523ca9c-3fc2-44c1-bd25-f62f8651aa25 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:49:19.226093 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523ca9c-3fc2-44c1-bd25-f62f8651aa25 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:49:19.229446 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda72ca-f077-403b-b6bc-ad631c40419a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:49:19.230071 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda72ca-f077-403b-b6bc-ad631c40419a service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:19.230350 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda72ca-f077-403b-b6bc-ad631c40419a service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:19.230623 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda72ca-f077-403b-b6bc-ad631c40419a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:19.239234 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda72ca-f077-403b-b6bc-ad631c40419a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:49:19.240680 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda72ca-f077-403b-b6bc-ad631c40419a service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:49:19.249697 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 730/1461] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:49:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:49:21.598371 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d18b64-66a9-4c76-92ba-9c45a8477943 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:21.598899 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d18b64-66a9-4c76-92ba-9c45a8477943 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:21.598899 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d18b64-66a9-4c76-92ba-9c45a8477943 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:21.600310 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:49:21.605586 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22924c5a-45bc-4ebc-b209-f229972e904d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:21.606036 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22924c5a-45bc-4ebc-b209-f229972e904d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:21.606141 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22924c5a-45bc-4ebc-b209-f229972e904d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:21.623988 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-22924c5a-45bc-4ebc-b209-f229972e904d None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:49:21.625200 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-22924c5a-45bc-4ebc-b209-f229972e904d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:49:21.633212 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:49:21.672219 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d18b64-66a9-4c76-92ba-9c45a8477943 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:49:21.683315 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d18b64-66a9-4c76-92ba-9c45a8477943 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:49:21.687045 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76b164-7da9-4775-88a3-cae7e80c7650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:49:21.687692 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76b164-7da9-4775-88a3-cae7e80c7650 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:21.687972 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76b164-7da9-4775-88a3-cae7e80c7650 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:21.688244 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76b164-7da9-4775-88a3-cae7e80c7650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:21.696913 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76b164-7da9-4775-88a3-cae7e80c7650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:49:21.698324 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76b164-7da9-4775-88a3-cae7e80c7650 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:49:21.707530 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 733/1464] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:49:24.043011 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64503380-3782-4c41-b3e2-3c7855532540 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:24.043556 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64503380-3782-4c41-b3e2-3c7855532540 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:24.043677 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64503380-3782-4c41-b3e2-3c7855532540 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:24.045017 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:49:24.050987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0241cd-5832-4a66-b08d-d9d3ef4a4fd5 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:24.051400 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0241cd-5832-4a66-b08d-d9d3ef4a4fd5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:24.051561 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0241cd-5832-4a66-b08d-d9d3ef4a4fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:24.068848 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-8f0241cd-5832-4a66-b08d-d9d3ef4a4fd5 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:49:24.070024 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-8f0241cd-5832-4a66-b08d-d9d3ef4a4fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:49:24.077690 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:49:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:49:24.115864 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64503380-3782-4c41-b3e2-3c7855532540 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:49:24.126406 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64503380-3782-4c41-b3e2-3c7855532540 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:49:24.130034 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6c5df-b742-422f-a007-e9f7f4d0385e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:49:24.130667 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6c5df-b742-422f-a007-e9f7f4d0385e service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:24.130951 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6c5df-b742-422f-a007-e9f7f4d0385e service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:24.131234 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6c5df-b742-422f-a007-e9f7f4d0385e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:24.139890 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6c5df-b742-422f-a007-e9f7f4d0385e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:49:24.141319 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6c5df-b742-422f-a007-e9f7f4d0385e service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:49:24.150934 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 733/1467] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:49:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:49:26.440489 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14772873-a95c-4680-907f-5568d369edec None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:26.441018 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14772873-a95c-4680-907f-5568d369edec None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:26.441018 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14772873-a95c-4680-907f-5568d369edec None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:26.442419 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:49:26.447910 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f0cdb-9a5d-4d3f-b628-edcb48f5ad51 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:26.448351 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f0cdb-9a5d-4d3f-b628-edcb48f5ad51 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:26.448457 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f0cdb-9a5d-4d3f-b628-edcb48f5ad51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:26.466045 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-af7f0cdb-9a5d-4d3f-b628-edcb48f5ad51 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:49:26.467223 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-af7f0cdb-9a5d-4d3f-b628-edcb48f5ad51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:49:26.475552 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:49:26.512355 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14772873-a95c-4680-907f-5568d369edec None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:49:26.523228 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14772873-a95c-4680-907f-5568d369edec None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:49:26.526754 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77613cb2-56eb-4041-8096-d21a2107a627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:49:26.527379 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77613cb2-56eb-4041-8096-d21a2107a627 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:26.527687 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77613cb2-56eb-4041-8096-d21a2107a627 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:26.527965 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77613cb2-56eb-4041-8096-d21a2107a627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:26.537511 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77613cb2-56eb-4041-8096-d21a2107a627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:49:26.538939 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77613cb2-56eb-4041-8096-d21a2107a627 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:49:26.548038 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 736/1470] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:49:59.925288 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c2b38-2a5f-4033-bd7e-ee987a62b7e6 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:59.925877 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c2b38-2a5f-4033-bd7e-ee987a62b7e6 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:59.926266 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c2b38-2a5f-4033-bd7e-ee987a62b7e6 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:59.928823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 735/1471] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:49:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:49:59.934182 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fea7ae-105b-4402-b0ab-0a1716986842 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:49:59.934641 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fea7ae-105b-4402-b0ab-0a1716986842 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:49:59.934745 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fea7ae-105b-4402-b0ab-0a1716986842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:49:59.952144 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-50fea7ae-105b-4402-b0ab-0a1716986842 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:49:59.953327 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-50fea7ae-105b-4402-b0ab-0a1716986842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:49:59.961215 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 737/1472] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:50:00.008484 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a534bbb-88f0-452c-817d-54c930d65820 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:50:00.008773 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a534bbb-88f0-452c-817d-54c930d65820 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:50:00.009052 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a534bbb-88f0-452c-817d-54c930d65820 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:50:00.010427 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 736/1473] 10.222.0.67 () {54 vars in 961 bytes} [Mon Apr 11 13:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:50:00.015425 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a63a1a-9240-4554-bbf8-e0e8ca484119 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:50:00.015755 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a63a1a-9240-4554-bbf8-e0e8ca484119 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:50:00.016034 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a63a1a-9240-4554-bbf8-e0e8ca484119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:50:00.034898 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-19a63a1a-9240-4554-bbf8-e0e8ca484119 None None] MFA Rules not processed for user `08cbf69574af4e25b940ec038f9e1bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:50:00.036138 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-19a63a1a-9240-4554-bbf8-e0e8ca484119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:50:00.042552 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 738/1474] 10.222.0.67 () {58 vars in 1058 bytes} [Mon Apr 11 13:50:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:50:00.050506 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a534bbb-88f0-452c-817d-54c930d65820 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:50:00.062048 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a534bbb-88f0-452c-817d-54c930d65820 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:50:00.065727 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b04ee8-3a6c-4f0d-8bd8-16637a5fca08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cbf69574af4e25b940ec038f9e1bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:50:00.066539 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b04ee8-3a6c-4f0d-8bd8-16637a5fca08 service glance] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:50:00.066910 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b04ee8-3a6c-4f0d-8bd8-16637a5fca08 service glance] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:50:00.067221 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b04ee8-3a6c-4f0d-8bd8-16637a5fca08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:50:00.076780 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b04ee8-3a6c-4f0d-8bd8-16637a5fca08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:50:00.078221 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b04ee8-3a6c-4f0d-8bd8-16637a5fca08 service glance] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:50:00.087636 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 737/1475] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:50:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:50:02.474473 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e68ed-487a-4c1b-906d-939ee7df0030 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:50:02.475018 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e68ed-487a-4c1b-906d-939ee7df0030 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:50:02.475018 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e68ed-487a-4c1b-906d-939ee7df0030 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:50:02.476457 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 739/1476] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:50:02.481850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd425c9-2124-4af1-a4fc-2e74c528b888 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:50:02.482285 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd425c9-2124-4af1-a4fc-2e74c528b888 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:50:02.482396 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd425c9-2124-4af1-a4fc-2e74c528b888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:50:02.499549 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-fcd425c9-2124-4af1-a4fc-2e74c528b888 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:50:02.500752 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-fcd425c9-2124-4af1-a4fc-2e74c528b888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:50:02.508389 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 738/1477] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:50:02.532566 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e68ed-487a-4c1b-906d-939ee7df0030 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:50:02.545805 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e68ed-487a-4c1b-906d-939ee7df0030 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:50:02.550509 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4142ce-22b7-44d7-85f8-a7c45bfa99ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:50:02.551195 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4142ce-22b7-44d7-85f8-a7c45bfa99ef admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:50:02.551475 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4142ce-22b7-44d7-85f8-a7c45bfa99ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:50:02.551795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4142ce-22b7-44d7-85f8-a7c45bfa99ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:50:02.552585 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4142ce-22b7-44d7-85f8-a7c45bfa99ef admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:50:02.554256 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING py.warnings [None req-ad4142ce-22b7-44d7-85f8-a7c45bfa99ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:50:02.554256 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: warnings.warn(msg) Apr 11 13:50:02.554256 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: Apr 11 13:50:02.555401 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4142ce-22b7-44d7-85f8-a7c45bfa99ef admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:50:02.574452 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 740/1478] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Apr 11 13:50:02 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:50:04.883787 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e507ec4-97d7-48c3-9238-5c5e7de8b5ac None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:50:04.884348 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e507ec4-97d7-48c3-9238-5c5e7de8b5ac None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:50:04.884348 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e507ec4-97d7-48c3-9238-5c5e7de8b5ac None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:50:04.885705 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 739/1479] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:50:04.890980 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02f5aa-474c-4688-88df-a5e757de0f47 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:50:04.891398 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02f5aa-474c-4688-88df-a5e757de0f47 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:50:04.891535 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02f5aa-474c-4688-88df-a5e757de0f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:50:04.909906 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-8e02f5aa-474c-4688-88df-a5e757de0f47 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:50:04.911089 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-8e02f5aa-474c-4688-88df-a5e757de0f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:50:04.918811 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 741/1480] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:50:04.961015 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e507ec4-97d7-48c3-9238-5c5e7de8b5ac None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:50:04.975115 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e507ec4-97d7-48c3-9238-5c5e7de8b5ac None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:50:04.980514 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50f75c-09b5-49ab-b276-dfcd9d6a6a2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:50:04.981147 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50f75c-09b5-49ab-b276-dfcd9d6a6a2e service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:50:04.981431 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50f75c-09b5-49ab-b276-dfcd9d6a6a2e service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:50:04.981705 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50f75c-09b5-49ab-b276-dfcd9d6a6a2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:50:04.990399 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50f75c-09b5-49ab-b276-dfcd9d6a6a2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:50:04.992023 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50f75c-09b5-49ab-b276-dfcd9d6a6a2e service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:50:05.001105 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 740/1481] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:50:07.476488 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107c661-3947-4c63-b608-dd02a6d69627 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:50:07.477116 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107c661-3947-4c63-b608-dd02a6d69627 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:50:07.477116 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107c661-3947-4c63-b608-dd02a6d69627 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:50:07.478419 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 742/1482] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:50:07.483667 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a0bac-5edc-4f55-b5b5-dcca63f9ab8f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:50:07.484106 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a0bac-5edc-4f55-b5b5-dcca63f9ab8f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:50:07.484211 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a0bac-5edc-4f55-b5b5-dcca63f9ab8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:50:07.502216 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-478a0bac-5edc-4f55-b5b5-dcca63f9ab8f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:50:07.503563 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-478a0bac-5edc-4f55-b5b5-dcca63f9ab8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:50:07.511933 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 741/1483] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:50:07.548259 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107c661-3947-4c63-b608-dd02a6d69627 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:50:07.558710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107c661-3947-4c63-b608-dd02a6d69627 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:50:07.562535 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20658a3-7af1-4119-a30c-83fb02c5ca9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:50:07.563171 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20658a3-7af1-4119-a30c-83fb02c5ca9c service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:50:07.563453 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20658a3-7af1-4119-a30c-83fb02c5ca9c service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:50:07.563774 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20658a3-7af1-4119-a30c-83fb02c5ca9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:50:07.573233 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20658a3-7af1-4119-a30c-83fb02c5ca9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:50:07.574669 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20658a3-7af1-4119-a30c-83fb02c5ca9c service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:50:07.584586 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 743/1484] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:50:09.942441 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc4be5-5d6f-452d-b6c1-b6fda3e1bf61 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:50:09.943000 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc4be5-5d6f-452d-b6c1-b6fda3e1bf61 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:50:09.943000 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc4be5-5d6f-452d-b6c1-b6fda3e1bf61 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:50:09.944412 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 742/1485] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:50:09.949534 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cb18d-d550-4739-94b1-e414aa3f0036 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:50:09.949992 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cb18d-d550-4739-94b1-e414aa3f0036 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:50:09.950097 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cb18d-d550-4739-94b1-e414aa3f0036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:50:09.968225 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b35cb18d-d550-4739-94b1-e414aa3f0036 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:50:09.969412 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b35cb18d-d550-4739-94b1-e414aa3f0036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:50:09.977839 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 744/1486] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:50:10.015044 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc4be5-5d6f-452d-b6c1-b6fda3e1bf61 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:50:10.026611 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc4be5-5d6f-452d-b6c1-b6fda3e1bf61 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:50:10.030134 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7fd1e-b0b3-4150-8481-33097dc63fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:50:10.030770 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7fd1e-b0b3-4150-8481-33097dc63fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:50:10.031052 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7fd1e-b0b3-4150-8481-33097dc63fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:50:10.031331 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7fd1e-b0b3-4150-8481-33097dc63fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:50:10.041267 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7fd1e-b0b3-4150-8481-33097dc63fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:50:10.042692 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7fd1e-b0b3-4150-8481-33097dc63fa8 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:50:10.052246 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 743/1487] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:50:12.509682 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa31030-972e-4beb-8f6f-43b0802529a6 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:50:12.510198 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa31030-972e-4beb-8f6f-43b0802529a6 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:50:12.510313 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa31030-972e-4beb-8f6f-43b0802529a6 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:50:12.511594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 745/1488] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:50:12.516673 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a0ef3-e8f6-410c-aa02-189f6fdbe886 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:50:12.517112 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a0ef3-e8f6-410c-aa02-189f6fdbe886 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:50:12.517348 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a0ef3-e8f6-410c-aa02-189f6fdbe886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:50:12.536391 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c72a0ef3-e8f6-410c-aa02-189f6fdbe886 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:50:12.537612 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c72a0ef3-e8f6-410c-aa02-189f6fdbe886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:50:12.545481 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 744/1489] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:50:12.586636 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa31030-972e-4beb-8f6f-43b0802529a6 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:50:12.597548 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa31030-972e-4beb-8f6f-43b0802529a6 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:50:12.601148 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441cd5a-68e2-45a4-a572-7f0d71c9ef16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:50:12.601780 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441cd5a-68e2-45a4-a572-7f0d71c9ef16 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:50:12.602064 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441cd5a-68e2-45a4-a572-7f0d71c9ef16 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:50:12.602341 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441cd5a-68e2-45a4-a572-7f0d71c9ef16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:50:12.611191 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441cd5a-68e2-45a4-a572-7f0d71c9ef16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:50:12.612610 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441cd5a-68e2-45a4-a572-7f0d71c9ef16 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:50:12.622039 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 746/1490] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:50:15.059034 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedffbf-530b-40da-826d-300ccee64219 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:50:15.059602 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedffbf-530b-40da-826d-300ccee64219 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:50:15.059602 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedffbf-530b-40da-826d-300ccee64219 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:50:15.061321 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 745/1491] 10.222.0.67 () {54 vars in 926 bytes} [Mon Apr 11 13:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:50:15.066667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774f25a-2082-4e4c-bb6c-7d64acacd9bd None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:50:15.067096 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774f25a-2082-4e4c-bb6c-7d64acacd9bd None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:50:15.067215 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774f25a-2082-4e4c-bb6c-7d64acacd9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:50:15.084370 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-6774f25a-2082-4e4c-bb6c-7d64acacd9bd None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:50:15.085585 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6774f25a-2082-4e4c-bb6c-7d64acacd9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:50:15.093421 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 747/1492] 10.222.0.67 () {58 vars in 1023 bytes} [Mon Apr 11 13:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:50:15.132969 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedffbf-530b-40da-826d-300ccee64219 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:50:15.144071 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedffbf-530b-40da-826d-300ccee64219 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:50:15.147560 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480952bc-4560-4292-ad1b-7f290f5d8435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:50:15.148249 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480952bc-4560-4292-ad1b-7f290f5d8435 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:50:15.148527 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480952bc-4560-4292-ad1b-7f290f5d8435 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:50:15.148802 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480952bc-4560-4292-ad1b-7f290f5d8435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:50:15.157584 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480952bc-4560-4292-ad1b-7f290f5d8435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:50:15.159660 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480952bc-4560-4292-ad1b-7f290f5d8435 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:50:15.168763 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 746/1493] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:51:45.541016 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f8126-fe0d-47ab-a51b-45bcc532be66 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:51:45.541587 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f8126-fe0d-47ab-a51b-45bcc532be66 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:51:45.541587 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f8126-fe0d-47ab-a51b-45bcc532be66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:51:45.559169 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-862f8126-fe0d-47ab-a51b-45bcc532be66 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:51:45.560683 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-862f8126-fe0d-47ab-a51b-45bcc532be66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:51:45.569238 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 748/1494] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:51:45.577110 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd74a58-9182-4ae4-a895-9dd003e1b88c None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:51:45.578297 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd74a58-9182-4ae4-a895-9dd003e1b88c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:51:45.578403 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd74a58-9182-4ae4-a895-9dd003e1b88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:51:45.596440 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-fdd74a58-9182-4ae4-a895-9dd003e1b88c None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:51:45.597635 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-fdd74a58-9182-4ae4-a895-9dd003e1b88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:51:45.605371 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 747/1495] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:51:45.610049 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f8126-fe0d-47ab-a51b-45bcc532be66 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:51:45.619340 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f8126-fe0d-47ab-a51b-45bcc532be66 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:51:45.623794 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07043e15-aaf1-4822-9d63-4e0c7e1ee911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:51:45.625091 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07043e15-aaf1-4822-9d63-4e0c7e1ee911 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:51:45.625458 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07043e15-aaf1-4822-9d63-4e0c7e1ee911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:51:45.625738 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07043e15-aaf1-4822-9d63-4e0c7e1ee911 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:51:45.626459 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07043e15-aaf1-4822-9d63-4e0c7e1ee911 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:51:45.626762 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07043e15-aaf1-4822-9d63-4e0c7e1ee911 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:51:45.627795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING py.warnings [None req-07043e15-aaf1-4822-9d63-4e0c7e1ee911 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:51:45.627795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: warnings.warn(msg) Apr 11 13:51:45.627795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: Apr 11 13:51:45.628662 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07043e15-aaf1-4822-9d63-4e0c7e1ee911 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:51:45.639558 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 749/1496] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:51:45.648314 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd74a58-9182-4ae4-a895-9dd003e1b88c None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:51:45.657335 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd74a58-9182-4ae4-a895-9dd003e1b88c None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:51:45.661864 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7b492-6817-4641-a3f7-ff06d7206f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:51:45.662507 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7b492-6817-4641-a3f7-ff06d7206f3e admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:51:45.662792 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7b492-6817-4641-a3f7-ff06d7206f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:51:45.663070 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7b492-6817-4641-a3f7-ff06d7206f3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:51:45.663788 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7b492-6817-4641-a3f7-ff06d7206f3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:51:45.665512 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING py.warnings [None req-2ba7b492-6817-4641-a3f7-ff06d7206f3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:51:45.665512 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: warnings.warn(msg) Apr 11 13:51:45.665512 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: Apr 11 13:51:45.666734 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7b492-6817-4641-a3f7-ff06d7206f3e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:51:45.701435 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 748/1497] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:51:45 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:51:45.705668 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07043e15-aaf1-4822-9d63-4e0c7e1ee911 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:51:45.715384 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07043e15-aaf1-4822-9d63-4e0c7e1ee911 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:51:45.769321 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c048b5-c36a-4474-96db-599bfb3d4987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:51:45.769980 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c048b5-c36a-4474-96db-599bfb3d4987 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:51:45.770261 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c048b5-c36a-4474-96db-599bfb3d4987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:51:45.770535 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c048b5-c36a-4474-96db-599bfb3d4987 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:51:45.771229 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c048b5-c36a-4474-96db-599bfb3d4987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:51:45.772281 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING py.warnings [None req-b4c048b5-c36a-4474-96db-599bfb3d4987 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:51:45.772281 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: warnings.warn(msg) Apr 11 13:51:45.772281 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: Apr 11 13:51:45.773477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c048b5-c36a-4474-96db-599bfb3d4987 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:51:45.792783 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 750/1498] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:51:45 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:51:45.797848 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7b492-6817-4641-a3f7-ff06d7206f3e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:51:45.807799 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7b492-6817-4641-a3f7-ff06d7206f3e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:51:45.812773 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301621d-d3de-4e8f-bb89-e794769c7df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:51:45.813431 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301621d-d3de-4e8f-bb89-e794769c7df0 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:51:45.813715 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301621d-d3de-4e8f-bb89-e794769c7df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:51:45.813992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301621d-d3de-4e8f-bb89-e794769c7df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:51:45.814720 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301621d-d3de-4e8f-bb89-e794769c7df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:51:45.815752 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING py.warnings [None req-c301621d-d3de-4e8f-bb89-e794769c7df0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:51:45.815752 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: warnings.warn(msg) Apr 11 13:51:45.815752 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: Apr 11 13:51:45.816634 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301621d-d3de-4e8f-bb89-e794769c7df0 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:51:45.829281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 749/1499] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:51:45.833012 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c048b5-c36a-4474-96db-599bfb3d4987 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:51:45.842584 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c048b5-c36a-4474-96db-599bfb3d4987 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:51:45.847795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a13907-ecbc-4dd9-9f38-2af771f85791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:51:45.848455 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a13907-ecbc-4dd9-9f38-2af771f85791 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:51:45.848765 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a13907-ecbc-4dd9-9f38-2af771f85791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:51:45.849041 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a13907-ecbc-4dd9-9f38-2af771f85791 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:51:45.849796 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a13907-ecbc-4dd9-9f38-2af771f85791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:51:45.850810 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING py.warnings [None req-32a13907-ecbc-4dd9-9f38-2af771f85791 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:51:45.850810 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: warnings.warn(msg) Apr 11 13:51:45.850810 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: Apr 11 13:51:45.851873 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a13907-ecbc-4dd9-9f38-2af771f85791 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:51:45.865871 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 751/1500] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:51:45.869932 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301621d-d3de-4e8f-bb89-e794769c7df0 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:51:45.879579 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301621d-d3de-4e8f-bb89-e794769c7df0 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:51:45.884083 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36353e0-f78d-4b33-affe-c2ccdbe5b9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:51:45.884955 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36353e0-f78d-4b33-affe-c2ccdbe5b9bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:51:45.885240 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36353e0-f78d-4b33-affe-c2ccdbe5b9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:51:45.885518 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36353e0-f78d-4b33-affe-c2ccdbe5b9bf admin admin] PATH_INFO: `/v3/projects/b623b76d2f954cfea4c32b12cc9e42b2/users/0d720116cc64410a87cd383a4756cf35/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:51:45.900263 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36353e0-f78d-4b33-affe-c2ccdbe5b9bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b623b76d2f954cfea4c32b12cc9e42b2, user_id=0d720116cc64410a87cd383a4756cf35, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:51:45.901217 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING py.warnings [None req-f36353e0-f78d-4b33-affe-c2ccdbe5b9bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:51:45.901217 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: warnings.warn(msg) Apr 11 13:51:45.901217 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: Apr 11 13:51:45.903139 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36353e0-f78d-4b33-affe-c2ccdbe5b9bf admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:51:45.915841 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 750/1501] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:51:45 2022] PUT /identity/v3/projects/b623b76d2f954cfea4c32b12cc9e42b2/users/0d720116cc64410a87cd383a4756cf35/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:51:45.927166 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee61ff-be07-4240-97dd-71beb52632be None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:51:45.927455 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee61ff-be07-4240-97dd-71beb52632be None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:51:45.927771 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee61ff-be07-4240-97dd-71beb52632be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:51:45.953317 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ceee61ff-be07-4240-97dd-71beb52632be None None] MFA Rules not processed for user `0d720116cc64410a87cd383a4756cf35`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:51:45.954637 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ceee61ff-be07-4240-97dd-71beb52632be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:51:46.014331 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 752/1502] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:51:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:51:46.025871 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36353e0-f78d-4b33-affe-c2ccdbe5b9bf admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:51:46.098367 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36353e0-f78d-4b33-affe-c2ccdbe5b9bf admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:51:46.104791 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce2eeb-3247-4d6c-8ad6-32ddaa9f924b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:51:46.105468 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce2eeb-3247-4d6c-8ad6-32ddaa9f924b service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:51:46.105750 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce2eeb-3247-4d6c-8ad6-32ddaa9f924b service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:51:46.106026 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce2eeb-3247-4d6c-8ad6-32ddaa9f924b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:51:46.113800 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce2eeb-3247-4d6c-8ad6-32ddaa9f924b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:51:46.115377 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce2eeb-3247-4d6c-8ad6-32ddaa9f924b service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:51:46.123911 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 751/1503] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:51:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:51:46.193740 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb9a88-51d3-433f-926e-05bcfea3a20c None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:51:46.194030 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb9a88-51d3-433f-926e-05bcfea3a20c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:51:46.194306 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb9a88-51d3-433f-926e-05bcfea3a20c None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:51:46.195620 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 753/1504] 10.222.0.67 () {52 vars in 829 bytes} [Mon Apr 11 13:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:51:46.199354 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce2eeb-3247-4d6c-8ad6-32ddaa9f924b service nova] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:51:46.258865 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce2eeb-3247-4d6c-8ad6-32ddaa9f924b service nova] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:51:46.263385 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7ed07-8106-46b1-ac60-8507bba6a2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:51:46.264274 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7ed07-8106-46b1-ac60-8507bba6a2cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:51:46.264556 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7ed07-8106-46b1-ac60-8507bba6a2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:51:46.264831 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7ed07-8106-46b1-ac60-8507bba6a2cd admin admin] PATH_INFO: `/v3/users/0d720116cc64410a87cd383a4756cf35` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:51:46.266567 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7ed07-8106-46b1-ac60-8507bba6a2cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d720116cc64410a87cd383a4756cf35)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:51:46.267568 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING py.warnings [None req-e2e7ed07-8106-46b1-ac60-8507bba6a2cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:51:46.267568 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: warnings.warn(msg) Apr 11 13:51:46.267568 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: Apr 11 13:51:46.268792 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7ed07-8106-46b1-ac60-8507bba6a2cd admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:51:46.329466 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e2e7ed07-8106-46b1-ac60-8507bba6a2cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d720116cc64410a87cd383a4756cf35'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:51:46.330192 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e2e7ed07-8106-46b1-ac60-8507bba6a2cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d720116cc64410a87cd383a4756cf35'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:51:46.342290 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e2e7ed07-8106-46b1-ac60-8507bba6a2cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d720116cc64410a87cd383a4756cf35'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:51:46.351308 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e2e7ed07-8106-46b1-ac60-8507bba6a2cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d720116cc64410a87cd383a4756cf35'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:51:46.352132 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e2e7ed07-8106-46b1-ac60-8507bba6a2cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d720116cc64410a87cd383a4756cf35'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:51:46.375251 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 752/1505] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:51:46 2022] DELETE /identity/v3/users/0d720116cc64410a87cd383a4756cf35 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:51:46.380595 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579f0e4-2643-4b52-af9b-9f3c240b52b6 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:51:46.381027 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579f0e4-2643-4b52-af9b-9f3c240b52b6 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:51:46.381442 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579f0e4-2643-4b52-af9b-9f3c240b52b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:51:46.399945 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b579f0e4-2643-4b52-af9b-9f3c240b52b6 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:51:46.401153 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b579f0e4-2643-4b52-af9b-9f3c240b52b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:51:46.457585 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 754/1506] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:51:46.467185 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7ed07-8106-46b1-ac60-8507bba6a2cd admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:51:46.468628 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e2e7ed07-8106-46b1-ac60-8507bba6a2cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:51:46.523073 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7ed07-8106-46b1-ac60-8507bba6a2cd admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:51:46.526654 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b45dfc-dd59-4c8f-a94d-c557db8e5b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:51:46.527295 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b45dfc-dd59-4c8f-a94d-c557db8e5b29 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:51:46.527577 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b45dfc-dd59-4c8f-a94d-c557db8e5b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:51:46.527881 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b45dfc-dd59-4c8f-a94d-c557db8e5b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:51:46.536799 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b45dfc-dd59-4c8f-a94d-c557db8e5b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:51:46.538220 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b45dfc-dd59-4c8f-a94d-c557db8e5b29 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:51:46.547533 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 753/1507] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:51:46.968402 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579f0e4-2643-4b52-af9b-9f3c240b52b6 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:51:46.969881 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b579f0e4-2643-4b52-af9b-9f3c240b52b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:51:46.982060 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579f0e4-2643-4b52-af9b-9f3c240b52b6 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:51:46.987711 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9c1c7-68da-4899-b682-06742574c471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:51:46.988684 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9c1c7-68da-4899-b682-06742574c471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:51:46.989036 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9c1c7-68da-4899-b682-06742574c471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:51:46.989379 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9c1c7-68da-4899-b682-06742574c471 admin admin] PATH_INFO: `/v3/projects/b623b76d2f954cfea4c32b12cc9e42b2` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:51:46.990747 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9c1c7-68da-4899-b682-06742574c471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b623b76d2f954cfea4c32b12cc9e42b2)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:51:46.991754 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING py.warnings [None req-85b9c1c7-68da-4899-b682-06742574c471 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:51:46.991754 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: warnings.warn(msg) Apr 11 13:51:46.991754 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: Apr 11 13:51:46.992971 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9c1c7-68da-4899-b682-06742574c471 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:51:47.053109 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-85b9c1c7-68da-4899-b682-06742574c471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b623b76d2f954cfea4c32b12cc9e42b2', 'request_id': 'req-85b9c1c7-68da-4899-b682-06742574c471'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:51:47.062104 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-85b9c1c7-68da-4899-b682-06742574c471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b623b76d2f954cfea4c32b12cc9e42b2', 'request_id': 'req-85b9c1c7-68da-4899-b682-06742574c471'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:51:47.068192 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-85b9c1c7-68da-4899-b682-06742574c471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b623b76d2f954cfea4c32b12cc9e42b2', 'request_id': 'req-85b9c1c7-68da-4899-b682-06742574c471'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:51:47.086215 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-85b9c1c7-68da-4899-b682-06742574c471 admin admin] The token cache is being invalidate because project b623b76d2f954cfea4c32b12cc9e42b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:51:47.086502 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-85b9c1c7-68da-4899-b682-06742574c471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:51:47.087146 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-85b9c1c7-68da-4899-b682-06742574c471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:51:47.088922 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 755/1508] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:51:46 2022] DELETE /identity/v3/projects/b623b76d2f954cfea4c32b12cc9e42b2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:53:26.004677 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f01556-9b78-402c-a843-382f65b42baa None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:26.005295 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f01556-9b78-402c-a843-382f65b42baa None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:26.005295 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f01556-9b78-402c-a843-382f65b42baa None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:26.006608 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 754/1509] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:53:26.012948 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2f3fe-d231-4e4d-a1a7-58c20d3356b1 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:26.013426 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2f3fe-d231-4e4d-a1a7-58c20d3356b1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:26.013530 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2f3fe-d231-4e4d-a1a7-58c20d3356b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:26.030928 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-3ba2f3fe-d231-4e4d-a1a7-58c20d3356b1 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:53:26.032181 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3ba2f3fe-d231-4e4d-a1a7-58c20d3356b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:53:26.094393 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 756/1510] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:53:26.244279 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f01556-9b78-402c-a843-382f65b42baa None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:53:26.246568 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-90f01556-9b78-402c-a843-382f65b42baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:53:26.320059 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f01556-9b78-402c-a843-382f65b42baa None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:53:26.328169 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291aaf30-be9e-45f2-9bfd-deeea62ed957 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:53:26.328819 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291aaf30-be9e-45f2-9bfd-deeea62ed957 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:26.329098 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291aaf30-be9e-45f2-9bfd-deeea62ed957 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:26.329369 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291aaf30-be9e-45f2-9bfd-deeea62ed957 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:26.337757 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291aaf30-be9e-45f2-9bfd-deeea62ed957 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:53:26.339494 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291aaf30-be9e-45f2-9bfd-deeea62ed957 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:53:26.348698 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 755/1511] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:53:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:53:26.595896 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b510b-2a7e-48b9-8601-860e5403e331 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:26.596108 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b510b-2a7e-48b9-8601-860e5403e331 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:26.596373 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b510b-2a7e-48b9-8601-860e5403e331 None None] PATH_INFO: `/v3` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:26.597748 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 757/1512] 10.222.0.75 () {54 vars in 925 bytes} [Mon Apr 11 13:53:26 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:53:26.603728 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97590795-8fd5-4408-8520-3d9d8e567a59 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:26.604021 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97590795-8fd5-4408-8520-3d9d8e567a59 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:26.604417 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97590795-8fd5-4408-8520-3d9d8e567a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:26.625629 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-97590795-8fd5-4408-8520-3d9d8e567a59 None None] MFA Rules not processed for user `1885d4d35b6743299a73b3c12b1793b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:53:26.626827 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-97590795-8fd5-4408-8520-3d9d8e567a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:53:26.688038 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 756/1513] 10.222.0.75 () {58 vars in 1015 bytes} [Mon Apr 11 13:53:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:53:27.643661 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640d1cd-6c58-4b09-b896-1aebebb389e5 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:27.644214 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640d1cd-6c58-4b09-b896-1aebebb389e5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:27.644214 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640d1cd-6c58-4b09-b896-1aebebb389e5 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:27.645587 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:53:27.650494 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153863d-0a31-451f-99d1-367ee1b70228 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:27.650924 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153863d-0a31-451f-99d1-367ee1b70228 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:27.651021 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153863d-0a31-451f-99d1-367ee1b70228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:27.670021 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-f153863d-0a31-451f-99d1-367ee1b70228 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:53:27.671227 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f153863d-0a31-451f-99d1-367ee1b70228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:53:27.678995 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:53:27.832880 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640d1cd-6c58-4b09-b896-1aebebb389e5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:53:27.847731 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640d1cd-6c58-4b09-b896-1aebebb389e5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:53:27.853108 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36239c14-41e2-4e1d-9ae1-f87ba43f7a01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:53:27.853741 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36239c14-41e2-4e1d-9ae1-f87ba43f7a01 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:27.854023 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36239c14-41e2-4e1d-9ae1-f87ba43f7a01 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:27.854302 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36239c14-41e2-4e1d-9ae1-f87ba43f7a01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:27.863037 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36239c14-41e2-4e1d-9ae1-f87ba43f7a01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:53:27.864751 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36239c14-41e2-4e1d-9ae1-f87ba43f7a01 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:53:27.874305 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 759/1516] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:53:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:53:30.655471 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d936d8c-f5dd-44df-823a-b7afd511ce29 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:30.656052 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d936d8c-f5dd-44df-823a-b7afd511ce29 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:30.656052 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d936d8c-f5dd-44df-823a-b7afd511ce29 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:30.657367 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 758/1517] 10.222.0.67 () {54 vars in 960 bytes} [Mon Apr 11 13:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:53:30.662728 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb2320-2127-4acd-a092-be031c3117d2 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:30.663206 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb2320-2127-4acd-a092-be031c3117d2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:30.663301 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb2320-2127-4acd-a092-be031c3117d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:30.684788 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e9eb2320-2127-4acd-a092-be031c3117d2 None None] MFA Rules not processed for user `1885d4d35b6743299a73b3c12b1793b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:53:30.685985 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e9eb2320-2127-4acd-a092-be031c3117d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:53:30.694428 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 760/1518] 10.222.0.67 () {58 vars in 1057 bytes} [Mon Apr 11 13:53:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:53:30.702567 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d936d8c-f5dd-44df-823a-b7afd511ce29 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:53:30.715708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d936d8c-f5dd-44df-823a-b7afd511ce29 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:53:30.720594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506a0e2-8925-42bb-af78-fda74e1e9d8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1885d4d35b6743299a73b3c12b1793b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:53:30.721226 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506a0e2-8925-42bb-af78-fda74e1e9d8e service placement] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:30.721511 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506a0e2-8925-42bb-af78-fda74e1e9d8e service placement] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:30.721788 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506a0e2-8925-42bb-af78-fda74e1e9d8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:30.729924 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506a0e2-8925-42bb-af78-fda74e1e9d8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:53:30.731512 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506a0e2-8925-42bb-af78-fda74e1e9d8e service placement] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:53:30.740850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 759/1519] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:53:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:53:39.553727 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d29cb0-b8aa-4a86-951c-44d445aef3a4 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:39.554262 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d29cb0-b8aa-4a86-951c-44d445aef3a4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:39.554357 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d29cb0-b8aa-4a86-951c-44d445aef3a4 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:39.555667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 761/1520] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:53:39.561590 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e52cf6-7335-421c-b684-8a41b0e6b03a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:39.562015 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e52cf6-7335-421c-b684-8a41b0e6b03a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:39.562126 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e52cf6-7335-421c-b684-8a41b0e6b03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:39.580264 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a0e52cf6-7335-421c-b684-8a41b0e6b03a None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:53:39.581431 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a0e52cf6-7335-421c-b684-8a41b0e6b03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:53:39.589106 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 760/1521] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:53:39.738769 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d29cb0-b8aa-4a86-951c-44d445aef3a4 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:53:39.753394 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d29cb0-b8aa-4a86-951c-44d445aef3a4 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:53:39.758737 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80b5c7-8a14-4745-949d-3c37dc226a2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:53:39.759370 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80b5c7-8a14-4745-949d-3c37dc226a2d service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:39.759672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80b5c7-8a14-4745-949d-3c37dc226a2d service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:39.759950 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80b5c7-8a14-4745-949d-3c37dc226a2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:39.768614 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80b5c7-8a14-4745-949d-3c37dc226a2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:53:39.770221 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80b5c7-8a14-4745-949d-3c37dc226a2d service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:53:39.779885 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 762/1522] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:53:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:53:41.030565 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ce088-68ce-4bd2-aa43-61b7b73dc338 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:41.031131 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ce088-68ce-4bd2-aa43-61b7b73dc338 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:41.031131 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ce088-68ce-4bd2-aa43-61b7b73dc338 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:41.032581 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 761/1523] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 13:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:53:41.037319 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032ee4a-77a3-403a-aea3-be23c0f9a4fc None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:41.037727 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032ee4a-77a3-403a-aea3-be23c0f9a4fc None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:41.037868 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032ee4a-77a3-403a-aea3-be23c0f9a4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:41.055927 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e032ee4a-77a3-403a-aea3-be23c0f9a4fc None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:53:41.057537 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e032ee4a-77a3-403a-aea3-be23c0f9a4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:53:41.065126 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 763/1524] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 13:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:53:41.212457 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ce088-68ce-4bd2-aa43-61b7b73dc338 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:53:41.226905 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ce088-68ce-4bd2-aa43-61b7b73dc338 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:53:41.232921 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8961f8-f806-4fc9-b335-fba310fbc229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:53:41.233555 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8961f8-f806-4fc9-b335-fba310fbc229 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:41.233838 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8961f8-f806-4fc9-b335-fba310fbc229 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:41.234122 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8961f8-f806-4fc9-b335-fba310fbc229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:41.247496 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8961f8-f806-4fc9-b335-fba310fbc229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:53:41.250153 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8961f8-f806-4fc9-b335-fba310fbc229 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:53:41.259774 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 762/1525] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:53:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:53:45.683517 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5c518-427e-4811-a26f-ce4a7a247e5f None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:45.684116 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5c518-427e-4811-a26f-ce4a7a247e5f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:45.684116 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5c518-427e-4811-a26f-ce4a7a247e5f None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:45.685358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 764/1526] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:53:45.690536 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57919095-5075-4a0a-866a-48cb57d13704 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:45.690933 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57919095-5075-4a0a-866a-48cb57d13704 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:45.691095 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57919095-5075-4a0a-866a-48cb57d13704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:45.708586 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-57919095-5075-4a0a-866a-48cb57d13704 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:53:45.709792 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-57919095-5075-4a0a-866a-48cb57d13704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:53:45.718193 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 763/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:53:45.755052 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5c518-427e-4811-a26f-ce4a7a247e5f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:53:45.756788 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-41a5c518-427e-4811-a26f-ce4a7a247e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:53:45.811394 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5c518-427e-4811-a26f-ce4a7a247e5f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:53:45.814875 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeb1e2-7656-43c0-9e7b-6204d3f77841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:53:45.815510 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeb1e2-7656-43c0-9e7b-6204d3f77841 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:45.815823 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeb1e2-7656-43c0-9e7b-6204d3f77841 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:45.816102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeb1e2-7656-43c0-9e7b-6204d3f77841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:45.824758 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeb1e2-7656-43c0-9e7b-6204d3f77841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:53:45.826181 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeb1e2-7656-43c0-9e7b-6204d3f77841 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:53:45.835246 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 765/1528] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:53:48.122009 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ddcc1-8d31-4a7f-9aca-273d86b3933c None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:48.122590 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ddcc1-8d31-4a7f-9aca-273d86b3933c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:48.122590 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ddcc1-8d31-4a7f-9aca-273d86b3933c None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:48.123976 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 764/1529] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:53:48.129053 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da162e-a3cb-4210-84a5-07e62be01e72 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:48.129452 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da162e-a3cb-4210-84a5-07e62be01e72 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:48.129614 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da162e-a3cb-4210-84a5-07e62be01e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:48.147382 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b6da162e-a3cb-4210-84a5-07e62be01e72 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:53:48.148608 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b6da162e-a3cb-4210-84a5-07e62be01e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:53:48.156630 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 766/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:53:48.192553 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ddcc1-8d31-4a7f-9aca-273d86b3933c None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:53:48.202972 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ddcc1-8d31-4a7f-9aca-273d86b3933c None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:53:48.206406 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5abec-dce8-4184-8af5-48fc03ea5ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:53:48.207034 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5abec-dce8-4184-8af5-48fc03ea5ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:48.207314 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5abec-dce8-4184-8af5-48fc03ea5ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:48.207588 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5abec-dce8-4184-8af5-48fc03ea5ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:48.216371 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5abec-dce8-4184-8af5-48fc03ea5ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:53:48.217825 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5abec-dce8-4184-8af5-48fc03ea5ce0 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:53:48.227119 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 765/1531] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:53:52.044088 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd48e17-16a1-4019-83ba-14a6c060d057 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:52.044661 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd48e17-16a1-4019-83ba-14a6c060d057 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:52.044661 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd48e17-16a1-4019-83ba-14a6c060d057 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:52.045986 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 767/1532] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:53:52.051251 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af4ec8-3f9d-4191-97bd-9568ce50d28f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:52.051682 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af4ec8-3f9d-4191-97bd-9568ce50d28f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:52.051850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af4ec8-3f9d-4191-97bd-9568ce50d28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:52.070236 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-94af4ec8-3f9d-4191-97bd-9568ce50d28f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:53:52.071425 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-94af4ec8-3f9d-4191-97bd-9568ce50d28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:53:52.079810 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 766/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:53:52.352599 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd48e17-16a1-4019-83ba-14a6c060d057 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:53:52.354998 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7fd48e17-16a1-4019-83ba-14a6c060d057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:53:52.410986 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd48e17-16a1-4019-83ba-14a6c060d057 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:53:52.414575 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e93e6b-bab1-403c-8337-a598831e47ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:53:52.415225 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e93e6b-bab1-403c-8337-a598831e47ff service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:52.415508 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e93e6b-bab1-403c-8337-a598831e47ff service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:52.416411 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e93e6b-bab1-403c-8337-a598831e47ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:52.425429 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e93e6b-bab1-403c-8337-a598831e47ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:53:52.426878 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e93e6b-bab1-403c-8337-a598831e47ff service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:53:52.436501 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 768/1534] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:53:54.784070 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941429d-cf8d-43c7-8abd-ae9e9bd38a95 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:54.784604 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941429d-cf8d-43c7-8abd-ae9e9bd38a95 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:54.784604 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941429d-cf8d-43c7-8abd-ae9e9bd38a95 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:54.785928 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 767/1535] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 13:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:53:54.791954 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad642e1-822f-4f07-9652-09234b517791 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:54.792386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad642e1-822f-4f07-9652-09234b517791 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:54.792498 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad642e1-822f-4f07-9652-09234b517791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:54.810410 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0ad642e1-822f-4f07-9652-09234b517791 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:53:54.811595 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0ad642e1-822f-4f07-9652-09234b517791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:53:54.819257 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 769/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 13:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:53:55.089717 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76f80f-b723-4a3b-b700-b4be937cba7f None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:55.090008 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76f80f-b723-4a3b-b700-b4be937cba7f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:55.090287 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76f80f-b723-4a3b-b700-b4be937cba7f None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:55.091655 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 768/1537] 10.222.0.67 () {54 vars in 962 bytes} [Mon Apr 11 13:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:53:55.096433 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74091b-75eb-4302-9e6a-edc119a5b056 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:55.096728 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74091b-75eb-4302-9e6a-edc119a5b056 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:55.097009 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74091b-75eb-4302-9e6a-edc119a5b056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:55.114967 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-2f74091b-75eb-4302-9e6a-edc119a5b056 None None] MFA Rules not processed for user `af2e8f671cba49969ccf9e13778b5052`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:53:55.116189 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2f74091b-75eb-4302-9e6a-edc119a5b056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:53:55.122860 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 770/1538] 10.222.0.67 () {58 vars in 1059 bytes} [Mon Apr 11 13:53:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:53:55.130293 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76f80f-b723-4a3b-b700-b4be937cba7f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:53:55.141448 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76f80f-b723-4a3b-b700-b4be937cba7f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:53:55.144951 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b273cb-fe90-4d9a-9242-f40f64ac062f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:53:55.145577 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b273cb-fe90-4d9a-9242-f40f64ac062f service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:53:55.145861 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b273cb-fe90-4d9a-9242-f40f64ac062f service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:53:55.146136 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b273cb-fe90-4d9a-9242-f40f64ac062f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:53:55.155701 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b273cb-fe90-4d9a-9242-f40f64ac062f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:53:55.157130 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b273cb-fe90-4d9a-9242-f40f64ac062f service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:53:55.166307 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 769/1539] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:53:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:24.316764 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c36ac-9e25-4b48-9ea5-18e99b4d284b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.317856 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c36ac-9e25-4b48-9ea5-18e99b4d284b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.318340 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c36ac-9e25-4b48-9ea5-18e99b4d284b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.357418 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-108c36ac-9e25-4b48-9ea5-18e99b4d284b None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:24.359033 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-108c36ac-9e25-4b48-9ea5-18e99b4d284b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:24.375616 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 771/1540] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:24.389280 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53504deb-2aaa-4c94-a177-2b696da77186 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.389867 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53504deb-2aaa-4c94-a177-2b696da77186 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.389867 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53504deb-2aaa-4c94-a177-2b696da77186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.417539 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-53504deb-2aaa-4c94-a177-2b696da77186 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:24.418733 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-53504deb-2aaa-4c94-a177-2b696da77186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:24.436750 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 770/1541] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:24.442520 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c36ac-9e25-4b48-9ea5-18e99b4d284b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:24.457637 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c36ac-9e25-4b48-9ea5-18e99b4d284b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:24.468461 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8c42b-7a0e-4f64-ae85-79820cc6c008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:24.469602 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8c42b-7a0e-4f64-ae85-79820cc6c008 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.470097 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8c42b-7a0e-4f64-ae85-79820cc6c008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.470587 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8c42b-7a0e-4f64-ae85-79820cc6c008 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.471560 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8c42b-7a0e-4f64-ae85-79820cc6c008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:55:24.472122 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8c42b-7a0e-4f64-ae85-79820cc6c008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:24.474028 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8c42b-7a0e-4f64-ae85-79820cc6c008 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:24.490816 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 772/1542] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:55:24.500559 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53504deb-2aaa-4c94-a177-2b696da77186 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:24.511343 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53504deb-2aaa-4c94-a177-2b696da77186 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:24.520092 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e053d9-e100-4793-a81e-f9f8d63a1bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:24.520769 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e053d9-e100-4793-a81e-f9f8d63a1bca admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.521051 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e053d9-e100-4793-a81e-f9f8d63a1bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.521323 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e053d9-e100-4793-a81e-f9f8d63a1bca admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.522039 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e053d9-e100-4793-a81e-f9f8d63a1bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:24.524872 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e053d9-e100-4793-a81e-f9f8d63a1bca admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:24.556530 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a9f22-a4d2-4160-9117-8ca695c78754 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.557193 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a9f22-a4d2-4160-9117-8ca695c78754 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.557685 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a9f22-a4d2-4160-9117-8ca695c78754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.569727 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 771/1543] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:24 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:24.574598 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e053d9-e100-4793-a81e-f9f8d63a1bca admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:24.588170 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-221a9f22-a4d2-4160-9117-8ca695c78754 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:24.589698 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-221a9f22-a4d2-4160-9117-8ca695c78754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:24.652921 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e053d9-e100-4793-a81e-f9f8d63a1bca admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:24.658930 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22215acb-734b-4ebc-97bb-d4d5f6e2de23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:24.659609 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22215acb-734b-4ebc-97bb-d4d5f6e2de23 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.659921 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22215acb-734b-4ebc-97bb-d4d5f6e2de23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.660199 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22215acb-734b-4ebc-97bb-d4d5f6e2de23 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.661062 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22215acb-734b-4ebc-97bb-d4d5f6e2de23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:24.662085 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING py.warnings [None req-22215acb-734b-4ebc-97bb-d4d5f6e2de23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:55:24.662085 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: warnings.warn(msg) Apr 11 13:55:24.662085 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: Apr 11 13:55:24.663529 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22215acb-734b-4ebc-97bb-d4d5f6e2de23 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:24.683906 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 773/1544] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:24.686255 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c78b19-4751-4da3-9c02-3f79a349422c None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.686809 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c78b19-4751-4da3-9c02-3f79a349422c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.687276 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c78b19-4751-4da3-9c02-3f79a349422c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.691697 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 772/1545] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:24 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:24.695340 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac531997-31ac-40fd-b26c-a29d2f7534d6 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.695800 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac531997-31ac-40fd-b26c-a29d2f7534d6 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.696071 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac531997-31ac-40fd-b26c-a29d2f7534d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.714308 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-42c78b19-4751-4da3-9c02-3f79a349422c None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:24.715538 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-42c78b19-4751-4da3-9c02-3f79a349422c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:24.716498 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-ac531997-31ac-40fd-b26c-a29d2f7534d6 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:24.717791 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ac531997-31ac-40fd-b26c-a29d2f7534d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:24.723675 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 774/1546] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:24.725143 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0127cb-7aa7-498f-bd01-3e8dfa083cef None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.725754 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0127cb-7aa7-498f-bd01-3e8dfa083cef None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.726109 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0127cb-7aa7-498f-bd01-3e8dfa083cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.729711 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 773/1547] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:24.731087 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62479d-65e5-4a60-a65e-523510ae1896 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.731378 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62479d-65e5-4a60-a65e-523510ae1896 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.731673 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62479d-65e5-4a60-a65e-523510ae1896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.744383 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ad0127cb-7aa7-498f-bd01-3e8dfa083cef None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:24.745586 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ad0127cb-7aa7-498f-bd01-3e8dfa083cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:24.753372 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-5c62479d-65e5-4a60-a65e-523510ae1896 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:24.754525 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5c62479d-65e5-4a60-a65e-523510ae1896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:24.756103 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 775/1548] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:24.757702 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0127cb-7aa7-498f-bd01-3e8dfa083cef None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:24.763343 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 774/1549] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:24.764860 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86514dbc-b1eb-4486-8fc1-b5010687eee5 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.765351 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86514dbc-b1eb-4486-8fc1-b5010687eee5 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.765790 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86514dbc-b1eb-4486-8fc1-b5010687eee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.771368 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0127cb-7aa7-498f-bd01-3e8dfa083cef None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:24.777737 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c598f-5771-44a7-a2e1-73c50b7e0ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:24.778419 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c598f-5771-44a7-a2e1-73c50b7e0ebb admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.778684 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c598f-5771-44a7-a2e1-73c50b7e0ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.778954 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c598f-5771-44a7-a2e1-73c50b7e0ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.779775 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c598f-5771-44a7-a2e1-73c50b7e0ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:24.781577 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c598f-5771-44a7-a2e1-73c50b7e0ebb admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:24.783105 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-86514dbc-b1eb-4486-8fc1-b5010687eee5 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:24.784294 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-86514dbc-b1eb-4486-8fc1-b5010687eee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:24.792511 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 775/1550] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:24.795899 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 776/1551] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:24.796061 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2e65c-cdaf-476d-884e-e50397d5d039 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.796284 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66510957-c9f4-4544-9592-84d3a47d7ab0 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.796379 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2e65c-cdaf-476d-884e-e50397d5d039 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.796475 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66510957-c9f4-4544-9592-84d3a47d7ab0 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.796569 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2e65c-cdaf-476d-884e-e50397d5d039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.796672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66510957-c9f4-4544-9592-84d3a47d7ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.813471 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-34b2e65c-cdaf-476d-884e-e50397d5d039 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:24.814002 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-66510957-c9f4-4544-9592-84d3a47d7ab0 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:24.814668 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-34b2e65c-cdaf-476d-884e-e50397d5d039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:24.815143 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-66510957-c9f4-4544-9592-84d3a47d7ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:24.822714 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 776/1552] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:24.824194 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8968f9-93a3-4a94-8a3f-6194ba356f0c None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.824330 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 777/1553] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:24.825474 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44beb2a-a11c-43a3-a973-d3fd8c9b43fc None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.825822 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44beb2a-a11c-43a3-a973-d3fd8c9b43fc None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.826164 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44beb2a-a11c-43a3-a973-d3fd8c9b43fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.828196 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8968f9-93a3-4a94-8a3f-6194ba356f0c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.829035 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8968f9-93a3-4a94-8a3f-6194ba356f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.845951 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-f44beb2a-a11c-43a3-a973-d3fd8c9b43fc None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:24.847152 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f44beb2a-a11c-43a3-a973-d3fd8c9b43fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:24.847986 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-bf8968f9-93a3-4a94-8a3f-6194ba356f0c None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:24.849123 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-bf8968f9-93a3-4a94-8a3f-6194ba356f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:24.855610 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 778/1554] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:24.856853 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92324518-23a0-4645-94a3-af60699a1b67 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.857141 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92324518-23a0-4645-94a3-af60699a1b67 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.857264 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 777/1555] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:24.857452 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92324518-23a0-4645-94a3-af60699a1b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.858410 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb4204-1593-478f-86d7-06f829aeb6c7 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.858693 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb4204-1593-478f-86d7-06f829aeb6c7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.858965 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb4204-1593-478f-86d7-06f829aeb6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.875826 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-92324518-23a0-4645-94a3-af60699a1b67 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:24.876044 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7bdb4204-1593-478f-86d7-06f829aeb6c7 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:24.877003 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7bdb4204-1593-478f-86d7-06f829aeb6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:24.877114 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-92324518-23a0-4645-94a3-af60699a1b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:24.885464 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 779/1556] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:24.889125 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 778/1557] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:24.889291 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92324518-23a0-4645-94a3-af60699a1b67 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:24.889390 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb4204-1593-478f-86d7-06f829aeb6c7 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:24.897970 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92324518-23a0-4645-94a3-af60699a1b67 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:24.898243 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb4204-1593-478f-86d7-06f829aeb6c7 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:24.902590 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538df8be-3ae7-4a10-9201-a06fc979c668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:24.902741 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec446918-cd68-4bdd-8b27-0270b851f088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:24.903244 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538df8be-3ae7-4a10-9201-a06fc979c668 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.903352 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec446918-cd68-4bdd-8b27-0270b851f088 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.903528 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538df8be-3ae7-4a10-9201-a06fc979c668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.903660 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec446918-cd68-4bdd-8b27-0270b851f088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.903845 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538df8be-3ae7-4a10-9201-a06fc979c668 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.903964 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec446918-cd68-4bdd-8b27-0270b851f088 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.904572 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538df8be-3ae7-4a10-9201-a06fc979c668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:24.904672 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec446918-cd68-4bdd-8b27-0270b851f088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:55:24.904876 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec446918-cd68-4bdd-8b27-0270b851f088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:24.905873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING py.warnings [None req-ec446918-cd68-4bdd-8b27-0270b851f088 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:55:24.905873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: warnings.warn(msg) Apr 11 13:55:24.905873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: Apr 11 13:55:24.906175 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538df8be-3ae7-4a10-9201-a06fc979c668 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:24.906756 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec446918-cd68-4bdd-8b27-0270b851f088 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:24.919655 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 780/1558] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:24.919655 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b25e5b-ebf9-41a3-8a38-19866de765b7 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.919655 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b25e5b-ebf9-41a3-8a38-19866de765b7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.919655 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b25e5b-ebf9-41a3-8a38-19866de765b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.920048 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 779/1559] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:55:24.920048 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e604162-3e60-45c0-b5c2-fef14cb4c6f9 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.920644 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e604162-3e60-45c0-b5c2-fef14cb4c6f9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.920644 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e604162-3e60-45c0-b5c2-fef14cb4c6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.937902 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b2b25e5b-ebf9-41a3-8a38-19866de765b7 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:24.938086 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-9e604162-3e60-45c0-b5c2-fef14cb4c6f9 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:24.939007 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b2b25e5b-ebf9-41a3-8a38-19866de765b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:24.939213 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9e604162-3e60-45c0-b5c2-fef14cb4c6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:24.947080 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 781/1560] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:24.950690 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 780/1561] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:24.950690 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e604162-3e60-45c0-b5c2-fef14cb4c6f9 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:24.951539 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b25e5b-ebf9-41a3-8a38-19866de765b7 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:24.957925 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e604162-3e60-45c0-b5c2-fef14cb4c6f9 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:24.960717 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b25e5b-ebf9-41a3-8a38-19866de765b7 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:24.962445 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ebc86-b6ea-4bbd-a544-5fd14a478a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:24.963083 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ebc86-b6ea-4bbd-a544-5fd14a478a99 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.963366 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ebc86-b6ea-4bbd-a544-5fd14a478a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.963650 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ebc86-b6ea-4bbd-a544-5fd14a478a99 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.964390 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ebc86-b6ea-4bbd-a544-5fd14a478a99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:55:24.964694 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ebc86-b6ea-4bbd-a544-5fd14a478a99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:24.965414 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a852fc-7425-4451-8d5b-1c0afb599780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:24.966060 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a852fc-7425-4451-8d5b-1c0afb599780 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.966284 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ebc86-b6ea-4bbd-a544-5fd14a478a99 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:24.966388 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a852fc-7425-4451-8d5b-1c0afb599780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.966603 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a852fc-7425-4451-8d5b-1c0afb599780 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.967329 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a852fc-7425-4451-8d5b-1c0afb599780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:55:24.967670 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a852fc-7425-4451-8d5b-1c0afb599780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:24.969254 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a852fc-7425-4451-8d5b-1c0afb599780 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:24.977992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 781/1562] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:55:24.978881 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ebc86-b6ea-4bbd-a544-5fd14a478a99 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:24.987950 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 782/1563] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:55:24.987950 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a852fc-7425-4451-8d5b-1c0afb599780 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:24.988737 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ebc86-b6ea-4bbd-a544-5fd14a478a99 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:24.993960 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a5a39-6bce-4268-8875-46c56e34dfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:24.994600 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a5a39-6bce-4268-8875-46c56e34dfed admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:24.994879 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a5a39-6bce-4268-8875-46c56e34dfed admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:24.995149 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a5a39-6bce-4268-8875-46c56e34dfed admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:24.995885 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a5a39-6bce-4268-8875-46c56e34dfed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:55:24.996198 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a5a39-6bce-4268-8875-46c56e34dfed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:24.997770 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a5a39-6bce-4268-8875-46c56e34dfed admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:24.998487 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a852fc-7425-4451-8d5b-1c0afb599780 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.003285 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7a540-4862-4496-b96b-9d07ffcf2ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.003976 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7a540-4862-4496-b96b-9d07ffcf2ebc admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.004256 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7a540-4862-4496-b96b-9d07ffcf2ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.004531 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7a540-4862-4496-b96b-9d07ffcf2ebc admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.005256 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7a540-4862-4496-b96b-9d07ffcf2ebc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:55:25.005562 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7a540-4862-4496-b96b-9d07ffcf2ebc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.007219 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7a540-4862-4496-b96b-9d07ffcf2ebc admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.009726 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 782/1564] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:55:25.010489 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a5a39-6bce-4268-8875-46c56e34dfed admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.019544 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a5a39-6bce-4268-8875-46c56e34dfed admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.020717 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 783/1565] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:55:25.021596 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7a540-4862-4496-b96b-9d07ffcf2ebc admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.031077 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7a540-4862-4496-b96b-9d07ffcf2ebc admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.031905 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acee007-e1c6-4c81-9d3a-abd562390ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.032793 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acee007-e1c6-4c81-9d3a-abd562390ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.033075 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acee007-e1c6-4c81-9d3a-abd562390ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.033347 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acee007-e1c6-4c81-9d3a-abd562390ccb admin admin] PATH_INFO: `/v3/projects/93aa1a74c2fc48ce81fde5490e3604bf/users/6b10dd2bce99432abf55a8d348cf1ad9/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.035591 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93be67-d88a-4e2c-98ed-5898b5b97d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.036241 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93be67-d88a-4e2c-98ed-5898b5b97d4e admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.036520 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93be67-d88a-4e2c-98ed-5898b5b97d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.036788 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93be67-d88a-4e2c-98ed-5898b5b97d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.037465 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93be67-d88a-4e2c-98ed-5898b5b97d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.038973 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING py.warnings [None req-fe93be67-d88a-4e2c-98ed-5898b5b97d4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:55:25.038973 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: warnings.warn(msg) Apr 11 13:55:25.038973 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: Apr 11 13:55:25.040180 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93be67-d88a-4e2c-98ed-5898b5b97d4e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.048912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acee007-e1c6-4c81-9d3a-abd562390ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=93aa1a74c2fc48ce81fde5490e3604bf, user_id=6b10dd2bce99432abf55a8d348cf1ad9, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.051849 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acee007-e1c6-4c81-9d3a-abd562390ccb admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.066362 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 783/1567] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:25 2022] PUT /identity/v3/projects/93aa1a74c2fc48ce81fde5490e3604bf/users/6b10dd2bce99432abf55a8d348cf1ad9/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:25.070685 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 784/1567] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:25 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:25.070685 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93be67-d88a-4e2c-98ed-5898b5b97d4e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.071967 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acee007-e1c6-4c81-9d3a-abd562390ccb admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.129747 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93be67-d88a-4e2c-98ed-5898b5b97d4e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.132350 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acee007-e1c6-4c81-9d3a-abd562390ccb admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.134928 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d1945-d476-47cb-809c-bd58663d2276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.135591 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d1945-d476-47cb-809c-bd58663d2276 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.135916 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d1945-d476-47cb-809c-bd58663d2276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.136182 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d1945-d476-47cb-809c-bd58663d2276 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.136902 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d1945-d476-47cb-809c-bd58663d2276 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:55:25.137050 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc6d25-4145-4430-b7a0-f18edcb05b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.137206 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d1945-d476-47cb-809c-bd58663d2276 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.137710 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc6d25-4145-4430-b7a0-f18edcb05b37 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.137996 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc6d25-4145-4430-b7a0-f18edcb05b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.138279 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc6d25-4145-4430-b7a0-f18edcb05b37 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.138805 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d1945-d476-47cb-809c-bd58663d2276 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.139002 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc6d25-4145-4430-b7a0-f18edcb05b37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:55:25.139310 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc6d25-4145-4430-b7a0-f18edcb05b37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.140999 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc6d25-4145-4430-b7a0-f18edcb05b37 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.151038 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 785/1568] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:55:25.152487 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d1945-d476-47cb-809c-bd58663d2276 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.152970 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 784/1569] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:55:25.159207 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc6d25-4145-4430-b7a0-f18edcb05b37 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.167459 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d1945-d476-47cb-809c-bd58663d2276 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.168420 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc6d25-4145-4430-b7a0-f18edcb05b37 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.172814 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf86af5-3d88-474a-ae0b-897123b09354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.173301 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e014a-b239-4517-895d-4e052e523a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.173477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf86af5-3d88-474a-ae0b-897123b09354 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.173742 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf86af5-3d88-474a-ae0b-897123b09354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.173943 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e014a-b239-4517-895d-4e052e523a1c admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.174059 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf86af5-3d88-474a-ae0b-897123b09354 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.174229 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e014a-b239-4517-895d-4e052e523a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.174508 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e014a-b239-4517-895d-4e052e523a1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.174750 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf86af5-3d88-474a-ae0b-897123b09354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.175215 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e014a-b239-4517-895d-4e052e523a1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.176985 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf86af5-3d88-474a-ae0b-897123b09354 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.177438 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e014a-b239-4517-895d-4e052e523a1c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.203787 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 786/1570] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:25 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:25.207795 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 785/1571] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:25 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:25.207935 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf86af5-3d88-474a-ae0b-897123b09354 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.208019 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e014a-b239-4517-895d-4e052e523a1c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.264709 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e014a-b239-4517-895d-4e052e523a1c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.266978 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf86af5-3d88-474a-ae0b-897123b09354 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.269324 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a8e94-d396-470a-83fc-c3dc9d06981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.269986 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a8e94-d396-470a-83fc-c3dc9d06981c admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.270267 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a8e94-d396-470a-83fc-c3dc9d06981c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.270541 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a8e94-d396-470a-83fc-c3dc9d06981c admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.271231 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a8e94-d396-470a-83fc-c3dc9d06981c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.271652 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74750ea-8a61-47c5-a866-fce3545249c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.272905 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74750ea-8a61-47c5-a866-fce3545249c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.273320 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74750ea-8a61-47c5-a866-fce3545249c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.273586 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74750ea-8a61-47c5-a866-fce3545249c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.273754 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a8e94-d396-470a-83fc-c3dc9d06981c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.274264 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74750ea-8a61-47c5-a866-fce3545249c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.276170 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74750ea-8a61-47c5-a866-fce3545249c6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.298879 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 786/1572] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:25 2022] POST /identity/v3/projects => generated 391 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:25.299704 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a8e94-d396-470a-83fc-c3dc9d06981c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.305019 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 787/1573] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:25 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:25.306425 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5a51c-1970-4e50-8359-2c173e33edf2 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.306787 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5a51c-1970-4e50-8359-2c173e33edf2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.307127 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5a51c-1970-4e50-8359-2c173e33edf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.324796 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-53f5a51c-1970-4e50-8359-2c173e33edf2 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:25.325977 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-53f5a51c-1970-4e50-8359-2c173e33edf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:25.360100 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a8e94-d396-470a-83fc-c3dc9d06981c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.385829 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 788/1574] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:25.386840 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5a51c-1970-4e50-8359-2c173e33edf2 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.396624 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5a51c-1970-4e50-8359-2c173e33edf2 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.402006 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295e914-e4d7-4947-848a-e8d7cd8c0db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.402668 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295e914-e4d7-4947-848a-e8d7cd8c0db4 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.402959 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295e914-e4d7-4947-848a-e8d7cd8c0db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.403233 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295e914-e4d7-4947-848a-e8d7cd8c0db4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.403961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295e914-e4d7-4947-848a-e8d7cd8c0db4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.405886 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295e914-e4d7-4947-848a-e8d7cd8c0db4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.418785 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341c8cf-4f81-4998-8644-d732de63ae4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.419455 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341c8cf-4f81-4998-8644-d732de63ae4f admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.419768 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341c8cf-4f81-4998-8644-d732de63ae4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.420050 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341c8cf-4f81-4998-8644-d732de63ae4f admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.420730 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341c8cf-4f81-4998-8644-d732de63ae4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.422704 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341c8cf-4f81-4998-8644-d732de63ae4f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.431332 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 789/1575] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:25 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:25.433724 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295e914-e4d7-4947-848a-e8d7cd8c0db4 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.442768 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 787/1576] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:25 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:25.443555 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341c8cf-4f81-4998-8644-d732de63ae4f admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.452867 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341c8cf-4f81-4998-8644-d732de63ae4f admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.495989 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295e914-e4d7-4947-848a-e8d7cd8c0db4 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.500549 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d4a54-957b-45ae-a646-bd9f21fe6757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.501219 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d4a54-957b-45ae-a646-bd9f21fe6757 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.501500 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d4a54-957b-45ae-a646-bd9f21fe6757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.501777 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d4a54-957b-45ae-a646-bd9f21fe6757 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.502462 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d4a54-957b-45ae-a646-bd9f21fe6757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.504415 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d4a54-957b-45ae-a646-bd9f21fe6757 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.509827 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d5178-eedf-4214-88cf-4530f7b17632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.510494 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d5178-eedf-4214-88cf-4530f7b17632 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.510773 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d5178-eedf-4214-88cf-4530f7b17632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.511044 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d5178-eedf-4214-88cf-4530f7b17632 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.511761 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d5178-eedf-4214-88cf-4530f7b17632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.513691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d5178-eedf-4214-88cf-4530f7b17632 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.530844 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 790/1577] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:25 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:25.531667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d4a54-957b-45ae-a646-bd9f21fe6757 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.536428 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 788/1578] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:25 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:25.536428 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d5178-eedf-4214-88cf-4530f7b17632 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.543960 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d5178-eedf-4214-88cf-4530f7b17632 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.596292 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d4a54-957b-45ae-a646-bd9f21fe6757 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.597942 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bbd97-d6ad-4722-8d18-cdec419759a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.598614 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bbd97-d6ad-4722-8d18-cdec419759a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.598897 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bbd97-d6ad-4722-8d18-cdec419759a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.599170 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bbd97-d6ad-4722-8d18-cdec419759a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.599883 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bbd97-d6ad-4722-8d18-cdec419759a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.601046 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9caec7-d02a-4272-87f3-9a37b7951436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.601718 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9caec7-d02a-4272-87f3-9a37b7951436 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.601920 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bbd97-d6ad-4722-8d18-cdec419759a4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.602022 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9caec7-d02a-4272-87f3-9a37b7951436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.602269 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9caec7-d02a-4272-87f3-9a37b7951436 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.602957 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9caec7-d02a-4272-87f3-9a37b7951436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.604893 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9caec7-d02a-4272-87f3-9a37b7951436 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.626873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 789/1579] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:25 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:25.626873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bbd97-d6ad-4722-8d18-cdec419759a4 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.627685 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 791/1580] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:25 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:25.628621 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9caec7-d02a-4272-87f3-9a37b7951436 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.635097 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bbd97-d6ad-4722-8d18-cdec419759a4 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.639745 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc7d3b-1b22-4196-a88c-b923222c6e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.640394 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc7d3b-1b22-4196-a88c-b923222c6e03 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.640672 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc7d3b-1b22-4196-a88c-b923222c6e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.640943 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc7d3b-1b22-4196-a88c-b923222c6e03 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.641612 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc7d3b-1b22-4196-a88c-b923222c6e03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.643490 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc7d3b-1b22-4196-a88c-b923222c6e03 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.663952 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 790/1581] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:25 2022] POST /identity/v3/users => generated 283 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:25.664751 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc7d3b-1b22-4196-a88c-b923222c6e03 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.674082 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc7d3b-1b22-4196-a88c-b923222c6e03 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.678931 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb816ca-450e-4846-9a9f-3eff9b033b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.679693 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb816ca-450e-4846-9a9f-3eff9b033b52 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.679983 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb816ca-450e-4846-9a9f-3eff9b033b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.680404 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb816ca-450e-4846-9a9f-3eff9b033b52 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.681091 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb816ca-450e-4846-9a9f-3eff9b033b52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.682976 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9caec7-d02a-4272-87f3-9a37b7951436 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.683092 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb816ca-450e-4846-9a9f-3eff9b033b52 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.686462 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7150fd-5c97-443f-9fa7-fc3a98db6001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.687098 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7150fd-5c97-443f-9fa7-fc3a98db6001 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.687473 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7150fd-5c97-443f-9fa7-fc3a98db6001 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.687851 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7150fd-5c97-443f-9fa7-fc3a98db6001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.697542 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7150fd-5c97-443f-9fa7-fc3a98db6001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.699072 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7150fd-5c97-443f-9fa7-fc3a98db6001 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.702635 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 791/1582] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:25 2022] POST /identity/v3/users => generated 282 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:25.703435 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb816ca-450e-4846-9a9f-3eff9b033b52 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.712351 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 792/1583] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:25.713081 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb816ca-450e-4846-9a9f-3eff9b033b52 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.713229 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7150fd-5c97-443f-9fa7-fc3a98db6001 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.717853 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6939d5-e57e-4ab4-a055-70987a05b6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.718849 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6939d5-e57e-4ab4-a055-70987a05b6fd admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.718849 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6939d5-e57e-4ab4-a055-70987a05b6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.719040 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6939d5-e57e-4ab4-a055-70987a05b6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.719730 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6939d5-e57e-4ab4-a055-70987a05b6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.721356 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6939d5-e57e-4ab4-a055-70987a05b6fd admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.722529 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7150fd-5c97-443f-9fa7-fc3a98db6001 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.727735 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae130d-c9f8-4561-ba82-4ebc5aed374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.728396 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae130d-c9f8-4561-ba82-4ebc5aed374a admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.728673 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae130d-c9f8-4561-ba82-4ebc5aed374a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.729002 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae130d-c9f8-4561-ba82-4ebc5aed374a admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.729687 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae130d-c9f8-4561-ba82-4ebc5aed374a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.731595 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae130d-c9f8-4561-ba82-4ebc5aed374a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.732888 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 792/1584] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:25.733699 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6939d5-e57e-4ab4-a055-70987a05b6fd admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.744291 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6939d5-e57e-4ab4-a055-70987a05b6fd admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.749056 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9064dc-e640-442c-a831-41bc2f6540b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.749724 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9064dc-e640-442c-a831-41bc2f6540b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.750008 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9064dc-e640-442c-a831-41bc2f6540b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.750287 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9064dc-e640-442c-a831-41bc2f6540b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.751013 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9064dc-e640-442c-a831-41bc2f6540b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.752649 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9064dc-e640-442c-a831-41bc2f6540b7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.753342 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 793/1585] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:25 2022] POST /identity/v3/users => generated 289 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:25.754183 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae130d-c9f8-4561-ba82-4ebc5aed374a admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.763177 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 793/1586] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:25.764052 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9064dc-e640-442c-a831-41bc2f6540b7 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.764357 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae130d-c9f8-4561-ba82-4ebc5aed374a admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.769170 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e031808-45ff-4376-b10a-c97ec9b97e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.769839 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e031808-45ff-4376-b10a-c97ec9b97e45 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.770122 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e031808-45ff-4376-b10a-c97ec9b97e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.770402 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e031808-45ff-4376-b10a-c97ec9b97e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.771170 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e031808-45ff-4376-b10a-c97ec9b97e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.773158 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e031808-45ff-4376-b10a-c97ec9b97e45 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.776285 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9064dc-e640-442c-a831-41bc2f6540b7 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.782339 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b80ca-11e5-4319-96e2-ac79da85ce15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.783396 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 794/1587] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:25.784098 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e031808-45ff-4376-b10a-c97ec9b97e45 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.786561 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b80ca-11e5-4319-96e2-ac79da85ce15 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.786866 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b80ca-11e5-4319-96e2-ac79da85ce15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.787229 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b80ca-11e5-4319-96e2-ac79da85ce15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.788628 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b80ca-11e5-4319-96e2-ac79da85ce15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.790564 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b80ca-11e5-4319-96e2-ac79da85ce15 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.797419 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e031808-45ff-4376-b10a-c97ec9b97e45 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.806063 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 794/1588] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:25.806259 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9547c2-ffcf-42a0-91b6-c9fc1bd6bc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.806259 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9547c2-ffcf-42a0-91b6-c9fc1bd6bc63 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.806467 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b80ca-11e5-4319-96e2-ac79da85ce15 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.806568 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9547c2-ffcf-42a0-91b6-c9fc1bd6bc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.806568 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9547c2-ffcf-42a0-91b6-c9fc1bd6bc63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.806568 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9547c2-ffcf-42a0-91b6-c9fc1bd6bc63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.807499 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9547c2-ffcf-42a0-91b6-c9fc1bd6bc63 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.817970 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b80ca-11e5-4319-96e2-ac79da85ce15 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.819269 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 795/1589] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:25.820219 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9547c2-ffcf-42a0-91b6-c9fc1bd6bc63 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.824451 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8afcf-b184-4b13-98de-1fc4078715d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.825130 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8afcf-b184-4b13-98de-1fc4078715d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.825413 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8afcf-b184-4b13-98de-1fc4078715d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.825692 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8afcf-b184-4b13-98de-1fc4078715d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.826437 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8afcf-b184-4b13-98de-1fc4078715d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.828055 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8afcf-b184-4b13-98de-1fc4078715d9 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.830492 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9547c2-ffcf-42a0-91b6-c9fc1bd6bc63 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.836489 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009858f-7c35-4430-8a4e-24d088b3a4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.837482 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009858f-7c35-4430-8a4e-24d088b3a4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.837768 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009858f-7c35-4430-8a4e-24d088b3a4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.838030 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009858f-7c35-4430-8a4e-24d088b3a4c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.838850 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009858f-7c35-4430-8a4e-24d088b3a4c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.840462 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 795/1590] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:25.840584 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009858f-7c35-4430-8a4e-24d088b3a4c0 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.841318 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8afcf-b184-4b13-98de-1fc4078715d9 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.851333 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 796/1591] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:25.852156 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009858f-7c35-4430-8a4e-24d088b3a4c0 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.852540 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8afcf-b184-4b13-98de-1fc4078715d9 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.858873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a8e5c-4072-4241-a7d1-09f5f2f5beb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.859554 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a8e5c-4072-4241-a7d1-09f5f2f5beb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.859924 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a8e5c-4072-4241-a7d1-09f5f2f5beb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.860266 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a8e5c-4072-4241-a7d1-09f5f2f5beb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.860938 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a8e5c-4072-4241-a7d1-09f5f2f5beb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.862620 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a8e5c-4072-4241-a7d1-09f5f2f5beb4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.873931 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009858f-7c35-4430-8a4e-24d088b3a4c0 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.874782 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 796/1592] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:25.875854 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a8e5c-4072-4241-a7d1-09f5f2f5beb4 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.879812 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f8f08-81e1-471f-a913-e86e615fe521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.880513 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f8f08-81e1-471f-a913-e86e615fe521 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.880804 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f8f08-81e1-471f-a913-e86e615fe521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.881095 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f8f08-81e1-471f-a913-e86e615fe521 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.882702 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f8f08-81e1-471f-a913-e86e615fe521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.884366 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f8f08-81e1-471f-a913-e86e615fe521 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.886395 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a8e5c-4072-4241-a7d1-09f5f2f5beb4 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.891806 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623b14b-cba9-44c6-9b84-f59cb1f6131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.892811 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623b14b-cba9-44c6-9b84-f59cb1f6131a admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.892811 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623b14b-cba9-44c6-9b84-f59cb1f6131a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.893016 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623b14b-cba9-44c6-9b84-f59cb1f6131a admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.893725 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623b14b-cba9-44c6-9b84-f59cb1f6131a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.896096 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623b14b-cba9-44c6-9b84-f59cb1f6131a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.903665 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 797/1593] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:25.904639 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f8f08-81e1-471f-a913-e86e615fe521 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.914578 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 797/1594] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:25.914578 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623b14b-cba9-44c6-9b84-f59cb1f6131a admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.917128 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f8f08-81e1-471f-a913-e86e615fe521 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.921966 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa730f7-8b47-484d-abbb-a3e9990db767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.922847 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa730f7-8b47-484d-abbb-a3e9990db767 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.922929 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa730f7-8b47-484d-abbb-a3e9990db767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.923210 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa730f7-8b47-484d-abbb-a3e9990db767 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.923953 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa730f7-8b47-484d-abbb-a3e9990db767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.925138 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623b14b-cba9-44c6-9b84-f59cb1f6131a admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.925734 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa730f7-8b47-484d-abbb-a3e9990db767 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.936658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43753ef-9b43-4697-89f7-173c8843f018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.936761 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43753ef-9b43-4697-89f7-173c8843f018 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.937048 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43753ef-9b43-4697-89f7-173c8843f018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.937372 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43753ef-9b43-4697-89f7-173c8843f018 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.938006 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43753ef-9b43-4697-89f7-173c8843f018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.942131 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 798/1595] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:25.942131 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa730f7-8b47-484d-abbb-a3e9990db767 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.942799 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43753ef-9b43-4697-89f7-173c8843f018 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.952242 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 798/1596] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:25.953174 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43753ef-9b43-4697-89f7-173c8843f018 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.957676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa730f7-8b47-484d-abbb-a3e9990db767 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.963957 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb672f1-4ba3-4f52-aca9-8ff3314dfcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.964766 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb672f1-4ba3-4f52-aca9-8ff3314dfcda admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.964889 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43753ef-9b43-4697-89f7-173c8843f018 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.965054 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb672f1-4ba3-4f52-aca9-8ff3314dfcda admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.965328 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb672f1-4ba3-4f52-aca9-8ff3314dfcda admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.966057 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb672f1-4ba3-4f52-aca9-8ff3314dfcda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.967693 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb672f1-4ba3-4f52-aca9-8ff3314dfcda admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.970767 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059565b5-8b30-47c8-ac7e-44691c635244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.971871 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059565b5-8b30-47c8-ac7e-44691c635244 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.972255 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059565b5-8b30-47c8-ac7e-44691c635244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.972674 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059565b5-8b30-47c8-ac7e-44691c635244 admin admin] PATH_INFO: `/v3/projects/7473a11165a145c48ac9e804a006dcf9/users/74328ec164f74a48823fffc67918e640/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.978791 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 799/1597] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:25.979810 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb672f1-4ba3-4f52-aca9-8ff3314dfcda admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:25.989514 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb672f1-4ba3-4f52-aca9-8ff3314dfcda admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:25.990631 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059565b5-8b30-47c8-ac7e-44691c635244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7473a11165a145c48ac9e804a006dcf9, user_id=74328ec164f74a48823fffc67918e640, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.994217 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059565b5-8b30-47c8-ac7e-44691c635244 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:25.994986 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15ff22-8fb8-411d-9fdc-56b06bd738df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:25.995657 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15ff22-8fb8-411d-9fdc-56b06bd738df admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:25.995952 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15ff22-8fb8-411d-9fdc-56b06bd738df admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:25.996387 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15ff22-8fb8-411d-9fdc-56b06bd738df admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:25.996939 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15ff22-8fb8-411d-9fdc-56b06bd738df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:25.998623 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15ff22-8fb8-411d-9fdc-56b06bd738df admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:26.009940 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 799/1598] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:25 2022] PUT /identity/v3/projects/7473a11165a145c48ac9e804a006dcf9/users/74328ec164f74a48823fffc67918e640/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:26.011241 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059565b5-8b30-47c8-ac7e-44691c635244 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:26.011927 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 800/1599] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:26.014601 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15ff22-8fb8-411d-9fdc-56b06bd738df admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:26.027500 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15ff22-8fb8-411d-9fdc-56b06bd738df admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:26.073765 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059565b5-8b30-47c8-ac7e-44691c635244 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:26.078522 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68929367-becd-4f61-b6fa-7bcc73d5cf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:26.079409 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68929367-becd-4f61-b6fa-7bcc73d5cf52 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:26.079719 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68929367-becd-4f61-b6fa-7bcc73d5cf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:26.080306 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68929367-becd-4f61-b6fa-7bcc73d5cf52 admin admin] PATH_INFO: `/v3/projects/a8a28d94e79a4972b0f8f61ab1cb1490/users/539174103f414528829d033481b83b0d/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:26.092546 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56035049-80bc-4e9d-a55f-746fd7dd191c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:26.093541 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56035049-80bc-4e9d-a55f-746fd7dd191c admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:26.093825 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56035049-80bc-4e9d-a55f-746fd7dd191c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:26.094100 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56035049-80bc-4e9d-a55f-746fd7dd191c admin admin] PATH_INFO: `/v3/projects/7e9487af89de4df6b7592a993fc4827e/users/cfe3f01cd2f742f4903ed97da6b6923c/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:26.098278 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68929367-becd-4f61-b6fa-7bcc73d5cf52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a28d94e79a4972b0f8f61ab1cb1490, user_id=539174103f414528829d033481b83b0d, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:26.101343 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68929367-becd-4f61-b6fa-7bcc73d5cf52 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:26.111711 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56035049-80bc-4e9d-a55f-746fd7dd191c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e9487af89de4df6b7592a993fc4827e, user_id=cfe3f01cd2f742f4903ed97da6b6923c, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:26.113166 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING py.warnings [None req-56035049-80bc-4e9d-a55f-746fd7dd191c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:55:26.113166 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: warnings.warn(msg) Apr 11 13:55:26.113166 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: Apr 11 13:55:26.115218 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56035049-80bc-4e9d-a55f-746fd7dd191c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:26.121129 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 800/1600] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:26 2022] PUT /identity/v3/projects/a8a28d94e79a4972b0f8f61ab1cb1490/users/539174103f414528829d033481b83b0d/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:26.121129 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68929367-becd-4f61-b6fa-7bcc73d5cf52 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:26.135951 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 801/1601] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:26 2022] PUT /identity/v3/projects/7e9487af89de4df6b7592a993fc4827e/users/cfe3f01cd2f742f4903ed97da6b6923c/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:26.137008 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56035049-80bc-4e9d-a55f-746fd7dd191c admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:26.192075 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68929367-becd-4f61-b6fa-7bcc73d5cf52 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:26.223154 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56035049-80bc-4e9d-a55f-746fd7dd191c admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:26.230561 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451b4cf-0cc0-48bb-abb1-dfc1c4d0c07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:26.232249 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451b4cf-0cc0-48bb-abb1-dfc1c4d0c07f admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:26.232584 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451b4cf-0cc0-48bb-abb1-dfc1c4d0c07f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:26.232934 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451b4cf-0cc0-48bb-abb1-dfc1c4d0c07f admin admin] PATH_INFO: `/v3/projects/f995f7a5d74e45a59f46cb7a336038fc/users/e93f5090792048fab7769a8025252213/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:26.252911 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451b4cf-0cc0-48bb-abb1-dfc1c4d0c07f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f995f7a5d74e45a59f46cb7a336038fc, user_id=e93f5090792048fab7769a8025252213, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:26.260325 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451b4cf-0cc0-48bb-abb1-dfc1c4d0c07f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:26.260514 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3c2b5-872f-475e-bbc2-d79bdf6c9221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:26.261366 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3c2b5-872f-475e-bbc2-d79bdf6c9221 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:26.261645 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3c2b5-872f-475e-bbc2-d79bdf6c9221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:26.261923 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3c2b5-872f-475e-bbc2-d79bdf6c9221 admin admin] PATH_INFO: `/v3/projects/f0be84cb2f1b4877beee599373f62238/users/4f7f814c77bc4732a640176a903c03f3/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:26.280562 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3c2b5-872f-475e-bbc2-d79bdf6c9221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0be84cb2f1b4877beee599373f62238, user_id=4f7f814c77bc4732a640176a903c03f3, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:26.283210 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3c2b5-872f-475e-bbc2-d79bdf6c9221 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:26.283714 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 802/1602] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:26 2022] PUT /identity/v3/projects/f995f7a5d74e45a59f46cb7a336038fc/users/e93f5090792048fab7769a8025252213/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:26.284903 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451b4cf-0cc0-48bb-abb1-dfc1c4d0c07f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:26.297386 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 801/1603] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:26 2022] PUT /identity/v3/projects/f0be84cb2f1b4877beee599373f62238/users/4f7f814c77bc4732a640176a903c03f3/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:26.307046 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3c2b5-872f-475e-bbc2-d79bdf6c9221 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:26.361096 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451b4cf-0cc0-48bb-abb1-dfc1c4d0c07f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:26.370857 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3c2b5-872f-475e-bbc2-d79bdf6c9221 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:26.375922 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f2a1d-ac1f-4c04-8413-a26786eed907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:26.376817 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f2a1d-ac1f-4c04-8413-a26786eed907 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:26.377096 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f2a1d-ac1f-4c04-8413-a26786eed907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:26.377370 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f2a1d-ac1f-4c04-8413-a26786eed907 admin admin] PATH_INFO: `/v3/projects/f07afe226a894200a0fc9eec473b0614/users/6d6152812eee46e09bda7c57d4d08cc7/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:26.402096 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f2a1d-ac1f-4c04-8413-a26786eed907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07afe226a894200a0fc9eec473b0614, user_id=6d6152812eee46e09bda7c57d4d08cc7, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:26.405033 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f2a1d-ac1f-4c04-8413-a26786eed907 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:26.426740 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 802/1604] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:26 2022] PUT /identity/v3/projects/f07afe226a894200a0fc9eec473b0614/users/6d6152812eee46e09bda7c57d4d08cc7/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:26.428962 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0f694-19cf-4add-ace1-a06a5dec4d7a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:26.429469 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0f694-19cf-4add-ace1-a06a5dec4d7a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:26.430235 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0f694-19cf-4add-ace1-a06a5dec4d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:26.446378 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3b267-bd4f-4427-a19d-f059bdd4d4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:26.447307 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3b267-bd4f-4427-a19d-f059bdd4d4e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:26.449770 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3b267-bd4f-4427-a19d-f059bdd4d4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:26.450071 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3b267-bd4f-4427-a19d-f059bdd4d4e6 admin admin] PATH_INFO: `/v3/projects/d8585c76733f46379846920c36347915/users/6c218c05cbe44c7eacee509490d7875c/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:26.465721 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c2e0f694-19cf-4add-ace1-a06a5dec4d7a None None] MFA Rules not processed for user `74328ec164f74a48823fffc67918e640`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:26.467193 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c2e0f694-19cf-4add-ace1-a06a5dec4d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:26.473651 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3b267-bd4f-4427-a19d-f059bdd4d4e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8585c76733f46379846920c36347915, user_id=6c218c05cbe44c7eacee509490d7875c, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:26.476769 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3b267-bd4f-4427-a19d-f059bdd4d4e6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:26.497472 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 803/1605] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:26 2022] PUT /identity/v3/projects/d8585c76733f46379846920c36347915/users/6c218c05cbe44c7eacee509490d7875c/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:26.499098 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e608abf-a9a3-4bf1-af1f-52583ab67c03 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:26.499329 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e608abf-a9a3-4bf1-af1f-52583ab67c03 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:26.499611 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e608abf-a9a3-4bf1-af1f-52583ab67c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:26.519352 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-6e608abf-a9a3-4bf1-af1f-52583ab67c03 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:26.520892 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6e608abf-a9a3-4bf1-af1f-52583ab67c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:26.559331 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 803/1606] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:26.566057 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fe37d-d9b9-411d-bd1b-39c4619b8053 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:26.566367 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fe37d-d9b9-411d-bd1b-39c4619b8053 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:26.566665 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fe37d-d9b9-411d-bd1b-39c4619b8053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:26.585792 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-631fe37d-d9b9-411d-bd1b-39c4619b8053 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:26.587016 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-631fe37d-d9b9-411d-bd1b-39c4619b8053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:26.602604 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 804/1607] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:26.605809 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57790c-8e3d-485a-a640-f69e6f3bf0e8 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:26.605809 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57790c-8e3d-485a-a640-f69e6f3bf0e8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:26.605809 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57790c-8e3d-485a-a640-f69e6f3bf0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:26.636759 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0c57790c-8e3d-485a-a640-f69e6f3bf0e8 None None] MFA Rules not processed for user `e93f5090792048fab7769a8025252213`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:26.638012 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0c57790c-8e3d-485a-a640-f69e6f3bf0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:26.657908 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 804/1608] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:26.659919 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a2963-6fed-4437-b955-ed373ea065ca None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:26.660238 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a2963-6fed-4437-b955-ed373ea065ca None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:26.660565 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a2963-6fed-4437-b955-ed373ea065ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:26.699833 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-851a2963-6fed-4437-b955-ed373ea065ca None None] MFA Rules not processed for user `4f7f814c77bc4732a640176a903c03f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:26.701534 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-851a2963-6fed-4437-b955-ed373ea065ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:26.716377 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 805/1609] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:26.717503 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52c819-13ac-417c-8c36-925346662acb None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:26.717863 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52c819-13ac-417c-8c36-925346662acb None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:26.718568 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52c819-13ac-417c-8c36-925346662acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:26.744208 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-fe52c819-13ac-417c-8c36-925346662acb None None] MFA Rules not processed for user `6d6152812eee46e09bda7c57d4d08cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:26.745414 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fe52c819-13ac-417c-8c36-925346662acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:26.765233 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 805/1610] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:26.766536 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438f576-fb82-4cbb-a08d-7b2dbb9071cc None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:26.766823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438f576-fb82-4cbb-a08d-7b2dbb9071cc None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:26.767098 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438f576-fb82-4cbb-a08d-7b2dbb9071cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:26.792570 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-1438f576-fb82-4cbb-a08d-7b2dbb9071cc None None] MFA Rules not processed for user `6b10dd2bce99432abf55a8d348cf1ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:26.793976 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1438f576-fb82-4cbb-a08d-7b2dbb9071cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:26.809827 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 806/1611] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:26.813354 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96942f-4ba9-4f16-8c2c-25fb6dff9ae5 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:26.813354 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96942f-4ba9-4f16-8c2c-25fb6dff9ae5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:26.813354 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96942f-4ba9-4f16-8c2c-25fb6dff9ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:26.837668 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ff96942f-4ba9-4f16-8c2c-25fb6dff9ae5 None None] MFA Rules not processed for user `6c218c05cbe44c7eacee509490d7875c`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:26.838881 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ff96942f-4ba9-4f16-8c2c-25fb6dff9ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:26.857108 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 806/1612] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:26.858513 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f873e2-1f04-41a4-a691-611439b442d2 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:26.858800 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f873e2-1f04-41a4-a691-611439b442d2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:26.859078 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f873e2-1f04-41a4-a691-611439b442d2 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:26.860668 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 807/1613] 10.222.0.67 () {54 vars in 960 bytes} [Mon Apr 11 13:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:55:26.861391 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f873e2-1f04-41a4-a691-611439b442d2 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:26.868669 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d8f873e2-1f04-41a4-a691-611439b442d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:26.902134 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 807/1614] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:26 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:26.903032 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96942f-4ba9-4f16-8c2c-25fb6dff9ae5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:26.904335 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ff96942f-4ba9-4f16-8c2c-25fb6dff9ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:26.930633 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f873e2-1f04-41a4-a691-611439b442d2 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:26.934188 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b75ded-e3df-4f92-87ac-f46869b377a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:26.934832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b75ded-e3df-4f92-87ac-f46869b377a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:26.935116 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b75ded-e3df-4f92-87ac-f46869b377a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:26.935392 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b75ded-e3df-4f92-87ac-f46869b377a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:26.944822 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b75ded-e3df-4f92-87ac-f46869b377a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:26.946251 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b75ded-e3df-4f92-87ac-f46869b377a9 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:26.955502 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 808/1615] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:26.956373 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b75ded-e3df-4f92-87ac-f46869b377a9 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:26.960061 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96942f-4ba9-4f16-8c2c-25fb6dff9ae5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:26.963952 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf092cb-fd8a-4256-bf1d-6c9c830cee5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:26.964622 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf092cb-fd8a-4256-bf1d-6c9c830cee5b service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:26.964911 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf092cb-fd8a-4256-bf1d-6c9c830cee5b service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:26.965192 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf092cb-fd8a-4256-bf1d-6c9c830cee5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:26.966279 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b75ded-e3df-4f92-87ac-f46869b377a9 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:26.971147 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c4c43-c6cf-42da-b207-9daf80849ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:26.971846 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c4c43-c6cf-42da-b207-9daf80849ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:26.972132 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c4c43-c6cf-42da-b207-9daf80849ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:26.972407 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c4c43-c6cf-42da-b207-9daf80849ec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:26.973110 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c4c43-c6cf-42da-b207-9daf80849ec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:26.975064 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c4c43-c6cf-42da-b207-9daf80849ec1 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:26.976364 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf092cb-fd8a-4256-bf1d-6c9c830cee5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:26.978323 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf092cb-fd8a-4256-bf1d-6c9c830cee5b service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:26.989079 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 808/1616] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:26.989851 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf092cb-fd8a-4256-bf1d-6c9c830cee5b service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:27.000636 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf092cb-fd8a-4256-bf1d-6c9c830cee5b service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:27.005502 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a2011-bba9-45bb-a04f-64ff64db815a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:27.007787 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a2011-bba9-45bb-a04f-64ff64db815a admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:27.008034 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a2011-bba9-45bb-a04f-64ff64db815a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:27.008316 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a2011-bba9-45bb-a04f-64ff64db815a admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:27.009034 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a2011-bba9-45bb-a04f-64ff64db815a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:27.010307 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 809/1617] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:26 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:27.011062 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a2011-bba9-45bb-a04f-64ff64db815a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:27.011534 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c4c43-c6cf-42da-b207-9daf80849ec1 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:27.051895 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 809/1618] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:26 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:27.054433 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7da86-7dc9-4196-845e-30eb3370d0ad None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:27.054968 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7da86-7dc9-4196-845e-30eb3370d0ad None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:27.055567 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7da86-7dc9-4196-845e-30eb3370d0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:27.076259 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-15f7da86-7dc9-4196-845e-30eb3370d0ad None None] MFA Rules not processed for user `fedd2314dc594bcba749bf7b0d1e50fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:27.077480 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-15f7da86-7dc9-4196-845e-30eb3370d0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:27.087266 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c4c43-c6cf-42da-b207-9daf80849ec1 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:27.157075 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 810/1619] 10.222.0.67 () {58 vars in 1057 bytes} [Mon Apr 11 13:55:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:27.158846 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f474ba-7930-4ab6-9173-8214962ad3fe None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:27.159350 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f474ba-7930-4ab6-9173-8214962ad3fe None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:27.159864 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f474ba-7930-4ab6-9173-8214962ad3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:27.160192 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b39938-0c3c-4b54-addb-50c8518e89ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:27.160972 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b39938-0c3c-4b54-addb-50c8518e89ef admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:27.161260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b39938-0c3c-4b54-addb-50c8518e89ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:27.161538 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b39938-0c3c-4b54-addb-50c8518e89ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:27.162232 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b39938-0c3c-4b54-addb-50c8518e89ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:27.164728 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b39938-0c3c-4b54-addb-50c8518e89ef admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:27.180028 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-86f474ba-7930-4ab6-9173-8214962ad3fe None None] MFA Rules not processed for user `6b10dd2bce99432abf55a8d348cf1ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:27.181237 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-86f474ba-7930-4ab6-9173-8214962ad3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:27.195265 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 810/1620] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:27 2022] POST /identity/v3/projects => generated 381 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:27.196581 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b39938-0c3c-4b54-addb-50c8518e89ef admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:27.251025 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 811/1621] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:27.251978 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f474ba-7930-4ab6-9173-8214962ad3fe None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:27.267916 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f474ba-7930-4ab6-9173-8214962ad3fe None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:27.274260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b39938-0c3c-4b54-addb-50c8518e89ef admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:27.279305 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cc0ba-f4ac-4a01-b0b4-4c4215c4f530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:27.280210 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cc0ba-f4ac-4a01-b0b4-4c4215c4f530 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:27.280554 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cc0ba-f4ac-4a01-b0b4-4c4215c4f530 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:27.281023 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cc0ba-f4ac-4a01-b0b4-4c4215c4f530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:27.340294 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9e780-d9fe-419e-b249-b2660960e574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:27.340989 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9e780-d9fe-419e-b249-b2660960e574 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:27.341275 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9e780-d9fe-419e-b249-b2660960e574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:27.341552 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9e780-d9fe-419e-b249-b2660960e574 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:27.342386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9e780-d9fe-419e-b249-b2660960e574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:27.344376 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9e780-d9fe-419e-b249-b2660960e574 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:27.356757 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cc0ba-f4ac-4a01-b0b4-4c4215c4f530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:27.358369 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cc0ba-f4ac-4a01-b0b4-4c4215c4f530 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:27.371902 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 812/1622] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:27 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:27.372423 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 811/1623] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:27 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:27.372524 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9e780-d9fe-419e-b249-b2660960e574 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:27.372617 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cc0ba-f4ac-4a01-b0b4-4c4215c4f530 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:27.391439 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9e780-d9fe-419e-b249-b2660960e574 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:27.409391 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89a503-187e-4cb2-8daa-4433d96a4ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:27.410295 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89a503-187e-4cb2-8daa-4433d96a4ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:27.410663 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89a503-187e-4cb2-8daa-4433d96a4ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:27.413087 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89a503-187e-4cb2-8daa-4433d96a4ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:27.414221 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89a503-187e-4cb2-8daa-4433d96a4ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:27.420382 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89a503-187e-4cb2-8daa-4433d96a4ad3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:27.467557 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 813/1624] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:27 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:27.469619 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89a503-187e-4cb2-8daa-4433d96a4ad3 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:27.485677 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89a503-187e-4cb2-8daa-4433d96a4ad3 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:27.494725 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dac9c-a9e2-495e-ada3-2b05d9d10468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:27.496455 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dac9c-a9e2-495e-ada3-2b05d9d10468 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:27.497502 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dac9c-a9e2-495e-ada3-2b05d9d10468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:27.498267 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dac9c-a9e2-495e-ada3-2b05d9d10468 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:27.499202 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9dac9c-a9e2-495e-ada3-2b05d9d10468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:27.502223 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9dac9c-a9e2-495e-ada3-2b05d9d10468 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:27.527462 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cc0ba-f4ac-4a01-b0b4-4c4215c4f530 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:27.539172 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe679be-985d-4598-9d4a-b960c150770e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:27.539832 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 814/1625] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:27 2022] POST /identity/v3/users => generated 297 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:27.541725 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe679be-985d-4598-9d4a-b960c150770e service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:27.541725 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe679be-985d-4598-9d4a-b960c150770e service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:27.541725 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe679be-985d-4598-9d4a-b960c150770e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:27.541985 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc174ee-7b23-435f-a370-15c5bb216c3d None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:27.542542 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc174ee-7b23-435f-a370-15c5bb216c3d None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:27.542982 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc174ee-7b23-435f-a370-15c5bb216c3d None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:27.545316 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 815/1626] 10.222.0.67 () {54 vars in 960 bytes} [Mon Apr 11 13:55:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:55:27.546210 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc174ee-7b23-435f-a370-15c5bb216c3d None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:27.567125 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc174ee-7b23-435f-a370-15c5bb216c3d None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:27.587251 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50af742-8bfe-4375-9cf2-a2674db820cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:27.590184 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50af742-8bfe-4375-9cf2-a2674db820cb admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:27.590184 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50af742-8bfe-4375-9cf2-a2674db820cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:27.590184 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50af742-8bfe-4375-9cf2-a2674db820cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:27.590943 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50af742-8bfe-4375-9cf2-a2674db820cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:27.592658 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50af742-8bfe-4375-9cf2-a2674db820cb admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:27.626934 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 816/1627] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:27.626934 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50af742-8bfe-4375-9cf2-a2674db820cb admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:27.651370 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50af742-8bfe-4375-9cf2-a2674db820cb admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:27.658754 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1de471-e63a-4ebc-b765-8b52251d53e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:27.659612 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1de471-e63a-4ebc-b765-8b52251d53e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:27.659999 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1de471-e63a-4ebc-b765-8b52251d53e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:27.660348 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1de471-e63a-4ebc-b765-8b52251d53e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:27.661179 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1de471-e63a-4ebc-b765-8b52251d53e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:27.663183 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1de471-e63a-4ebc-b765-8b52251d53e9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:27.689027 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe679be-985d-4598-9d4a-b960c150770e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:27.690663 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe679be-985d-4598-9d4a-b960c150770e service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:27.695532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 817/1628] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:27.695532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1de471-e63a-4ebc-b765-8b52251d53e9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:27.713523 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1de471-e63a-4ebc-b765-8b52251d53e9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:27.714751 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 812/1629] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:27.719060 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beda637-db20-406a-9fab-98a38d647b0d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:27.719350 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beda637-db20-406a-9fab-98a38d647b0d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:27.719636 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beda637-db20-406a-9fab-98a38d647b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:27.744410 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f77cf0-d9d6-4c1b-a615-27170990a39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:27.745105 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f77cf0-d9d6-4c1b-a615-27170990a39a admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:27.746982 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f77cf0-d9d6-4c1b-a615-27170990a39a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:27.747276 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f77cf0-d9d6-4c1b-a615-27170990a39a admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:27.749217 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f77cf0-d9d6-4c1b-a615-27170990a39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:27.753035 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f77cf0-d9d6-4c1b-a615-27170990a39a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:27.762342 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4beda637-db20-406a-9fab-98a38d647b0d None None] MFA Rules not processed for user `fedd2314dc594bcba749bf7b0d1e50fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:27.765754 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4beda637-db20-406a-9fab-98a38d647b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:27.779194 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 818/1630] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:27.780179 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f77cf0-d9d6-4c1b-a615-27170990a39a admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:27.789209 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 813/1631] 10.222.0.67 () {58 vars in 1057 bytes} [Mon Apr 11 13:55:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:27.790647 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beda637-db20-406a-9fab-98a38d647b0d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:27.799866 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f77cf0-d9d6-4c1b-a615-27170990a39a admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:27.813373 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195603d6-0661-4a59-a2d8-3e4c7d175e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:27.814582 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195603d6-0661-4a59-a2d8-3e4c7d175e5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:27.814829 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beda637-db20-406a-9fab-98a38d647b0d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:27.814967 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195603d6-0661-4a59-a2d8-3e4c7d175e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:27.815128 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195603d6-0661-4a59-a2d8-3e4c7d175e5d admin admin] PATH_INFO: `/v3/projects/da052f62569c42fdb4522ade468b297c/users/b4614ef1432e419eb08955e5c77f3fe9/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:27.829530 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffe3fe-4ba8-4978-bdce-244dcbe31403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:27.832815 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffe3fe-4ba8-4978-bdce-244dcbe31403 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:27.833112 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffe3fe-4ba8-4978-bdce-244dcbe31403 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:27.833478 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffe3fe-4ba8-4978-bdce-244dcbe31403 admin admin] PATH_INFO: `/v3/projects/dc15b08801ad4113979fdf15cdf41a89/users/8087f47514fa4b43aa9e0e47e888996d/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:27.851078 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195603d6-0661-4a59-a2d8-3e4c7d175e5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=da052f62569c42fdb4522ade468b297c, user_id=b4614ef1432e419eb08955e5c77f3fe9, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:27.856790 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffe3fe-4ba8-4978-bdce-244dcbe31403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc15b08801ad4113979fdf15cdf41a89, user_id=8087f47514fa4b43aa9e0e47e888996d, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:27.858908 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195603d6-0661-4a59-a2d8-3e4c7d175e5d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:27.873938 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffe3fe-4ba8-4978-bdce-244dcbe31403 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:27.895912 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 819/1632] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:27 2022] PUT /identity/v3/projects/da052f62569c42fdb4522ade468b297c/users/b4614ef1432e419eb08955e5c77f3fe9/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:27.900382 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195603d6-0661-4a59-a2d8-3e4c7d175e5d admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:27.913405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 814/1633] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:27 2022] PUT /identity/v3/projects/dc15b08801ad4113979fdf15cdf41a89/users/8087f47514fa4b43aa9e0e47e888996d/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:27.913405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffe3fe-4ba8-4978-bdce-244dcbe31403 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:28.020066 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195603d6-0661-4a59-a2d8-3e4c7d175e5d admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:28.085912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffe3fe-4ba8-4978-bdce-244dcbe31403 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:28.096201 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561981e-23ff-4b57-abc4-dcb899a5a06d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:28.097516 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561981e-23ff-4b57-abc4-dcb899a5a06d service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:28.098005 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561981e-23ff-4b57-abc4-dcb899a5a06d service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:28.098479 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561981e-23ff-4b57-abc4-dcb899a5a06d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:28.152071 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7fc45-a3f7-4b86-91e5-da95a8e8f217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:28.153063 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7fc45-a3f7-4b86-91e5-da95a8e8f217 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:28.153430 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7fc45-a3f7-4b86-91e5-da95a8e8f217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:28.153802 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7fc45-a3f7-4b86-91e5-da95a8e8f217 admin admin] PATH_INFO: `/v3/projects/e7e24a80962b42f98bde6c7689d57a4e/users/6005fa248a99487680981626d1a05b84/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:28.192345 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7fc45-a3f7-4b86-91e5-da95a8e8f217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e24a80962b42f98bde6c7689d57a4e, user_id=6005fa248a99487680981626d1a05b84, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:28.194157 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7fc45-a3f7-4b86-91e5-da95a8e8f217 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:28.237819 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 820/1634] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:27 2022] PUT /identity/v3/projects/e7e24a80962b42f98bde6c7689d57a4e/users/6005fa248a99487680981626d1a05b84/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:28.238822 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7fc45-a3f7-4b86-91e5-da95a8e8f217 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:28.254885 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561981e-23ff-4b57-abc4-dcb899a5a06d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:28.257192 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561981e-23ff-4b57-abc4-dcb899a5a06d service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:28.312243 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 815/1635] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:28.313405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561981e-23ff-4b57-abc4-dcb899a5a06d service nova] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:28.346942 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561981e-23ff-4b57-abc4-dcb899a5a06d service nova] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:28.409208 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7fc45-a3f7-4b86-91e5-da95a8e8f217 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:28.421834 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a135217-e445-4706-a530-46aefd3b1fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:28.422839 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a135217-e445-4706-a530-46aefd3b1fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:28.423482 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a135217-e445-4706-a530-46aefd3b1fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:28.424267 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a135217-e445-4706-a530-46aefd3b1fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:28.425415 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a135217-e445-4706-a530-46aefd3b1fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:28.427847 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a135217-e445-4706-a530-46aefd3b1fb8 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:28.444863 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 821/1636] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:28.448413 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c4171-3d66-4a31-9d74-4ce49f47a7a9 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:28.448713 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c4171-3d66-4a31-9d74-4ce49f47a7a9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:28.448994 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c4171-3d66-4a31-9d74-4ce49f47a7a9 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:28.453894 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 822/1637] 10.222.0.67 () {54 vars in 912 bytes} [Mon Apr 11 13:55:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:55:28.456949 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c4171-3d66-4a31-9d74-4ce49f47a7a9 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:28.495381 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c4171-3d66-4a31-9d74-4ce49f47a7a9 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:28.508385 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f79611-f81b-4714-8821-143b53fdc863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:28.509075 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f79611-f81b-4714-8821-143b53fdc863 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:28.509361 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f79611-f81b-4714-8821-143b53fdc863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:28.509646 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f79611-f81b-4714-8821-143b53fdc863 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:28.512216 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f79611-f81b-4714-8821-143b53fdc863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:28.514037 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f79611-f81b-4714-8821-143b53fdc863 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:28.538764 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 823/1638] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:28.539388 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f79611-f81b-4714-8821-143b53fdc863 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:28.542848 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fac3b-e89b-4132-b038-aa1f0530e506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:28.543547 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fac3b-e89b-4132-b038-aa1f0530e506 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:28.543866 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fac3b-e89b-4132-b038-aa1f0530e506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:28.544148 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fac3b-e89b-4132-b038-aa1f0530e506 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:28.544894 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fac3b-e89b-4132-b038-aa1f0530e506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:28.546533 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fac3b-e89b-4132-b038-aa1f0530e506 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:28.561272 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f79611-f81b-4714-8821-143b53fdc863 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:28.569473 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 816/1639] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:28.571043 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e8da5-d881-43ae-99df-ded35d24dc44 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:28.571324 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e8da5-d881-43ae-99df-ded35d24dc44 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:28.571609 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e8da5-d881-43ae-99df-ded35d24dc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:28.576978 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ef2a3-ddab-4bc6-97f6-2b682c6da5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:28.577813 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ef2a3-ddab-4bc6-97f6-2b682c6da5b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:28.578099 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ef2a3-ddab-4bc6-97f6-2b682c6da5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:28.580421 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ef2a3-ddab-4bc6-97f6-2b682c6da5b4 admin admin] PATH_INFO: `/v3/projects/da052f62569c42fdb4522ade468b297c/users/b4614ef1432e419eb08955e5c77f3fe9/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:28.586021 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ef2a3-ddab-4bc6-97f6-2b682c6da5b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da052f62569c42fdb4522ade468b297c, user_id=b4614ef1432e419eb08955e5c77f3fe9, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:28.591307 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ef2a3-ddab-4bc6-97f6-2b682c6da5b4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:28.619590 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 824/1640] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:28 2022] PUT /identity/v3/projects/da052f62569c42fdb4522ade468b297c/users/b4614ef1432e419eb08955e5c77f3fe9/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:28.620609 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ef2a3-ddab-4bc6-97f6-2b682c6da5b4 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:28.622326 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a81e8da5-d881-43ae-99df-ded35d24dc44 None None] MFA Rules not processed for user `fedd2314dc594bcba749bf7b0d1e50fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:28.633014 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a81e8da5-d881-43ae-99df-ded35d24dc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:28.754765 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ef2a3-ddab-4bc6-97f6-2b682c6da5b4 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:28.763132 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47eebc5-c97c-4460-b323-ce16c9ceff4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:28.764316 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47eebc5-c97c-4460-b323-ce16c9ceff4d admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:28.764668 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47eebc5-c97c-4460-b323-ce16c9ceff4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:28.765080 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47eebc5-c97c-4460-b323-ce16c9ceff4d admin admin] PATH_INFO: `/v3/projects/e7e24a80962b42f98bde6c7689d57a4e/users/6005fa248a99487680981626d1a05b84/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:28.773265 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47eebc5-c97c-4460-b323-ce16c9ceff4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e24a80962b42f98bde6c7689d57a4e, user_id=6005fa248a99487680981626d1a05b84, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:28.776111 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47eebc5-c97c-4460-b323-ce16c9ceff4d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:28.792432 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 817/1641] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Apr 11 13:55:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:28.793371 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e8da5-d881-43ae-99df-ded35d24dc44 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:28.817117 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 825/1642] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:28 2022] PUT /identity/v3/projects/e7e24a80962b42f98bde6c7689d57a4e/users/6005fa248a99487680981626d1a05b84/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:28.817117 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ff8c7-44d5-4e91-9868-1f8846e58f85 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:28.817117 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ff8c7-44d5-4e91-9868-1f8846e58f85 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:28.817117 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ff8c7-44d5-4e91-9868-1f8846e58f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:28.821184 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e8da5-d881-43ae-99df-ded35d24dc44 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:28.863303 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-db5ff8c7-44d5-4e91-9868-1f8846e58f85 None None] MFA Rules not processed for user `b4614ef1432e419eb08955e5c77f3fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:28.864699 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-db5ff8c7-44d5-4e91-9868-1f8846e58f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:28.940528 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f174d-43db-4b6f-ad54-895be7a92f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:28.941688 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f174d-43db-4b6f-ad54-895be7a92f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:28.942406 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f174d-43db-4b6f-ad54-895be7a92f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:28.942691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f174d-43db-4b6f-ad54-895be7a92f08 admin admin] PATH_INFO: `/v3/projects/dc15b08801ad4113979fdf15cdf41a89/users/8087f47514fa4b43aa9e0e47e888996d/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:28.945887 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f174d-43db-4b6f-ad54-895be7a92f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc15b08801ad4113979fdf15cdf41a89, user_id=8087f47514fa4b43aa9e0e47e888996d, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:28.951280 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f174d-43db-4b6f-ad54-895be7a92f08 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:28.965594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 826/1643] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:28.968102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ff8c7-44d5-4e91-9868-1f8846e58f85 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:28.984311 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 818/1644] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:28 2022] PUT /identity/v3/projects/dc15b08801ad4113979fdf15cdf41a89/users/8087f47514fa4b43aa9e0e47e888996d/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:28.987321 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b622ad-b644-47c8-96bc-c12b791af0d1 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:28.988585 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b622ad-b644-47c8-96bc-c12b791af0d1 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:28.988879 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b622ad-b644-47c8-96bc-c12b791af0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:29.025116 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-18b622ad-b644-47c8-96bc-c12b791af0d1 None None] MFA Rules not processed for user `6005fa248a99487680981626d1a05b84`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:29.026391 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-18b622ad-b644-47c8-96bc-c12b791af0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:29.045606 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ff8c7-44d5-4e91-9868-1f8846e58f85 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:29.112923 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a3cff-04e3-4d80-bec2-ecf6fcabdd3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:29.113974 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a3cff-04e3-4d80-bec2-ecf6fcabdd3f service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:29.113974 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a3cff-04e3-4d80-bec2-ecf6fcabdd3f service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:29.114210 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a3cff-04e3-4d80-bec2-ecf6fcabdd3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:29.145410 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 819/1645] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:29.145410 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f90c9-28eb-4063-8a07-0e481a492e5f None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:29.145410 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f90c9-28eb-4063-8a07-0e481a492e5f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:29.145410 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f90c9-28eb-4063-8a07-0e481a492e5f None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:29.146134 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 820/1646] 10.222.0.67 () {54 vars in 912 bytes} [Mon Apr 11 13:55:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:55:29.147046 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f90c9-28eb-4063-8a07-0e481a492e5f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:29.180915 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f90c9-28eb-4063-8a07-0e481a492e5f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:29.186273 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51cb34-0f1c-43c7-8107-01a217c0bf53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:29.187241 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51cb34-0f1c-43c7-8107-01a217c0bf53 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:29.187496 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51cb34-0f1c-43c7-8107-01a217c0bf53 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:29.187992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51cb34-0f1c-43c7-8107-01a217c0bf53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:29.212721 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a3cff-04e3-4d80-bec2-ecf6fcabdd3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:29.214596 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a3cff-04e3-4d80-bec2-ecf6fcabdd3f service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:29.230066 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 827/1647] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:29.231499 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ef1bd-538b-453e-90b5-5855794392ae None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:29.231802 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ef1bd-538b-453e-90b5-5855794392ae None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:29.232510 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ef1bd-538b-453e-90b5-5855794392ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:29.264458 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ed4ef1bd-538b-453e-90b5-5855794392ae None None] MFA Rules not processed for user `8087f47514fa4b43aa9e0e47e888996d`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:29.266477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ed4ef1bd-538b-453e-90b5-5855794392ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:29.269126 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51cb34-0f1c-43c7-8107-01a217c0bf53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:29.270902 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51cb34-0f1c-43c7-8107-01a217c0bf53 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:29.289649 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 821/1648] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:29 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:29.291160 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccca53-e8f7-4844-a27b-728608f27049 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:29.291527 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccca53-e8f7-4844-a27b-728608f27049 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:29.292195 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccca53-e8f7-4844-a27b-728608f27049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:29.320039 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-65ccca53-e8f7-4844-a27b-728608f27049 None None] MFA Rules not processed for user `fedd2314dc594bcba749bf7b0d1e50fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:29.321543 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-65ccca53-e8f7-4844-a27b-728608f27049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:29.339369 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 822/1649] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Apr 11 13:55:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:29.340334 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccca53-e8f7-4844-a27b-728608f27049 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:29.361958 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccca53-e8f7-4844-a27b-728608f27049 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:29.372530 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a501792-6755-4e89-8511-efe8fc7b66f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:29.373165 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a501792-6755-4e89-8511-efe8fc7b66f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:29.374422 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a501792-6755-4e89-8511-efe8fc7b66f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:29.384528 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a501792-6755-4e89-8511-efe8fc7b66f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:29.417185 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a501792-6755-4e89-8511-efe8fc7b66f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:29.419587 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a501792-6755-4e89-8511-efe8fc7b66f9 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:29.426147 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 828/1650] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:29 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:29.426147 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ef1bd-538b-453e-90b5-5855794392ae None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:29.428014 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ed4ef1bd-538b-453e-90b5-5855794392ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:29.450197 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 823/1651] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:29.525506 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a501792-6755-4e89-8511-efe8fc7b66f9 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:29.602738 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ef1bd-538b-453e-90b5-5855794392ae None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:29.613532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c045658-56cd-4416-8467-e988139f364e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cbf69574af4e25b940ec038f9e1bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:29.614542 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c045658-56cd-4416-8467-e988139f364e service glance] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:29.615048 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c045658-56cd-4416-8467-e988139f364e service glance] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:29.615711 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c045658-56cd-4416-8467-e988139f364e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:29.626386 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a501792-6755-4e89-8511-efe8fc7b66f9 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:29.635148 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7068109-f73e-435d-9360-84f415885214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:29.636095 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7068109-f73e-435d-9360-84f415885214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:29.636705 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7068109-f73e-435d-9360-84f415885214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:29.636823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7068109-f73e-435d-9360-84f415885214 admin admin] PATH_INFO: `/v3/users/74328ec164f74a48823fffc67918e640` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:29.638666 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7068109-f73e-435d-9360-84f415885214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74328ec164f74a48823fffc67918e640)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:29.641560 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7068109-f73e-435d-9360-84f415885214 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:29.646197 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c045658-56cd-4416-8467-e988139f364e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:29.648296 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c045658-56cd-4416-8467-e988139f364e service glance] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:29.680416 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 829/1652] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:29.682457 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c045658-56cd-4416-8467-e988139f364e service glance] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:29.692221 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c045658-56cd-4416-8467-e988139f364e service glance] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:29.699349 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce07a7f-be31-4e9a-b409-3b642333b36a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:29.700112 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce07a7f-be31-4e9a-b409-3b642333b36a service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:29.701646 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce07a7f-be31-4e9a-b409-3b642333b36a service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:29.701646 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce07a7f-be31-4e9a-b409-3b642333b36a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:29.714994 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce07a7f-be31-4e9a-b409-3b642333b36a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:29.717134 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce07a7f-be31-4e9a-b409-3b642333b36a service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:29.736982 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 830/1653] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:29 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:29.749081 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce07a7f-be31-4e9a-b409-3b642333b36a service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:29.752130 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a7068109-f73e-435d-9360-84f415885214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74328ec164f74a48823fffc67918e640'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:29.752873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a7068109-f73e-435d-9360-84f415885214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74328ec164f74a48823fffc67918e640'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:29.764644 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a7068109-f73e-435d-9360-84f415885214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74328ec164f74a48823fffc67918e640'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:29.773453 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce07a7f-be31-4e9a-b409-3b642333b36a service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:29.774999 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a7068109-f73e-435d-9360-84f415885214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74328ec164f74a48823fffc67918e640'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:29.775871 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a7068109-f73e-435d-9360-84f415885214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74328ec164f74a48823fffc67918e640'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:29.784718 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca59122-4df6-4cf3-9bc2-1c03a8926139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:29.785676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca59122-4df6-4cf3-9bc2-1c03a8926139 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:29.785936 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca59122-4df6-4cf3-9bc2-1c03a8926139 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:29.786221 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca59122-4df6-4cf3-9bc2-1c03a8926139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:29.791893 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-bca59122-4df6-4cf3-9bc2-1c03a8926139 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:29.800115 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 824/1654] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:55:29 2022] DELETE /identity/v3/users/74328ec164f74a48823fffc67918e640 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:55:29.802285 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f326e-7711-44c6-ac1c-fe918050ee73 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:29.802574 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f326e-7711-44c6-ac1c-fe918050ee73 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:29.808131 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f326e-7711-44c6-ac1c-fe918050ee73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:29.857203 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c24f326e-7711-44c6-ac1c-fe918050ee73 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:29.858458 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c24f326e-7711-44c6-ac1c-fe918050ee73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:29.922735 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca59122-4df6-4cf3-9bc2-1c03a8926139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:29.924546 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca59122-4df6-4cf3-9bc2-1c03a8926139 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:29.953199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 831/1655] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:29.995456 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 825/1656] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:30.025337 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca59122-4df6-4cf3-9bc2-1c03a8926139 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:30.026451 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-bca59122-4df6-4cf3-9bc2-1c03a8926139 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:30.042996 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca59122-4df6-4cf3-9bc2-1c03a8926139 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:30.073108 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f326e-7711-44c6-ac1c-fe918050ee73 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:30.074941 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c24f326e-7711-44c6-ac1c-fe918050ee73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:30.169120 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc11a98-a397-4ccb-836c-490fadaf19bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:30.170280 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc11a98-a397-4ccb-836c-490fadaf19bb service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:30.170805 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc11a98-a397-4ccb-836c-490fadaf19bb service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:30.171300 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc11a98-a397-4ccb-836c-490fadaf19bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:30.187368 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3dc11a98-a397-4ccb-836c-490fadaf19bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:30.207193 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f326e-7711-44c6-ac1c-fe918050ee73 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:30.226893 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24e74c-49cd-4fb5-b175-74952f795867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:30.227584 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24e74c-49cd-4fb5-b175-74952f795867 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:30.227885 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24e74c-49cd-4fb5-b175-74952f795867 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:30.228167 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24e74c-49cd-4fb5-b175-74952f795867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:30.260585 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24e74c-49cd-4fb5-b175-74952f795867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:30.262064 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24e74c-49cd-4fb5-b175-74952f795867 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:30.299784 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 826/1657] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:55:30.343363 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc11a98-a397-4ccb-836c-490fadaf19bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:30.345198 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc11a98-a397-4ccb-836c-490fadaf19bb service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:30.371242 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 832/1658] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:30.971984 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732ab9d-f9ac-4f7f-aac5-338686e6e497 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:30.972581 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732ab9d-f9ac-4f7f-aac5-338686e6e497 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:30.972817 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732ab9d-f9ac-4f7f-aac5-338686e6e497 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:30.974330 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 827/1659] 10.222.0.67 () {54 vars in 912 bytes} [Mon Apr 11 13:55:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:55:30.981444 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42ea08-41dd-4e42-856b-dac6370ff4e7 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:30.981962 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42ea08-41dd-4e42-856b-dac6370ff4e7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:30.982074 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42ea08-41dd-4e42-856b-dac6370ff4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:31.125726 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ad42ea08-41dd-4e42-856b-dac6370ff4e7 None None] MFA Rules not processed for user `c084d218ea414d638ef2dc45364a492c`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:31.127465 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ad42ea08-41dd-4e42-856b-dac6370ff4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:31.164027 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 833/1660] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Apr 11 13:55:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:55:31.272855 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732ab9d-f9ac-4f7f-aac5-338686e6e497 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:31.292178 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732ab9d-f9ac-4f7f-aac5-338686e6e497 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:31.306382 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66f026-5803-43bf-b0d7-f4dfed88849f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:31.307161 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66f026-5803-43bf-b0d7-f4dfed88849f service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:31.307450 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66f026-5803-43bf-b0d7-f4dfed88849f service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:31.307758 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66f026-5803-43bf-b0d7-f4dfed88849f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:31.328598 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66f026-5803-43bf-b0d7-f4dfed88849f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:31.330974 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66f026-5803-43bf-b0d7-f4dfed88849f service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:31.359263 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 828/1661] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:31.718900 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42ea08-41dd-4e42-856b-dac6370ff4e7 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:31.720406 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ad42ea08-41dd-4e42-856b-dac6370ff4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:31.743682 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66f026-5803-43bf-b0d7-f4dfed88849f service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:31.745537 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42ea08-41dd-4e42-856b-dac6370ff4e7 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:31.746092 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ee66f026-5803-43bf-b0d7-f4dfed88849f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:31.767972 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde23bb0-5699-4de9-876d-d3682c59df27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:31.767972 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde23bb0-5699-4de9-876d-d3682c59df27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:31.767972 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde23bb0-5699-4de9-876d-d3682c59df27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:31.768514 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde23bb0-5699-4de9-876d-d3682c59df27 admin admin] PATH_INFO: `/v3/projects/7473a11165a145c48ac9e804a006dcf9` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:31.771267 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde23bb0-5699-4de9-876d-d3682c59df27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7473a11165a145c48ac9e804a006dcf9)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:31.773333 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66f026-5803-43bf-b0d7-f4dfed88849f service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:31.777728 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde23bb0-5699-4de9-876d-d3682c59df27 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:31.783274 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802993c-4916-4827-a745-f63e7b930d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:31.784323 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802993c-4916-4827-a745-f63e7b930d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:31.784714 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802993c-4916-4827-a745-f63e7b930d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:31.785096 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802993c-4916-4827-a745-f63e7b930d3e admin admin] PATH_INFO: `/v3/users/4f7f814c77bc4732a640176a903c03f3` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:31.790545 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802993c-4916-4827-a745-f63e7b930d3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f7f814c77bc4732a640176a903c03f3)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:31.793147 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802993c-4916-4827-a745-f63e7b930d3e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:31.877683 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bde23bb0-5699-4de9-876d-d3682c59df27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7473a11165a145c48ac9e804a006dcf9', 'request_id': 'req-bde23bb0-5699-4de9-876d-d3682c59df27'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:31.895552 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bde23bb0-5699-4de9-876d-d3682c59df27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7473a11165a145c48ac9e804a006dcf9', 'request_id': 'req-bde23bb0-5699-4de9-876d-d3682c59df27'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:31.907884 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bde23bb0-5699-4de9-876d-d3682c59df27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7473a11165a145c48ac9e804a006dcf9', 'request_id': 'req-bde23bb0-5699-4de9-876d-d3682c59df27'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:31.929228 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bde23bb0-5699-4de9-876d-d3682c59df27 admin admin] The token cache is being invalidate because project 7473a11165a145c48ac9e804a006dcf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:55:31.929745 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bde23bb0-5699-4de9-876d-d3682c59df27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:31.931300 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9802993c-4916-4827-a745-f63e7b930d3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f7f814c77bc4732a640176a903c03f3'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:31.931442 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bde23bb0-5699-4de9-876d-d3682c59df27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:31.932383 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9802993c-4916-4827-a745-f63e7b930d3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f7f814c77bc4732a640176a903c03f3'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:31.933775 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 834/1662] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:55:31 2022] DELETE /identity/v3/projects/7473a11165a145c48ac9e804a006dcf9 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:31.940496 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314e55a-c06d-447e-908e-09d666967186 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:31.941030 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314e55a-c06d-447e-908e-09d666967186 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:31.941468 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314e55a-c06d-447e-908e-09d666967186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:31.949627 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9802993c-4916-4827-a745-f63e7b930d3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f7f814c77bc4732a640176a903c03f3'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:31.967829 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9802993c-4916-4827-a745-f63e7b930d3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f7f814c77bc4732a640176a903c03f3'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:31.969458 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9802993c-4916-4827-a745-f63e7b930d3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f7f814c77bc4732a640176a903c03f3'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:31.969903 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-1314e55a-c06d-447e-908e-09d666967186 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:31.971763 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1314e55a-c06d-447e-908e-09d666967186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:32.005204 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 829/1663] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:55:31 2022] DELETE /identity/v3/users/4f7f814c77bc4732a640176a903c03f3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:32.010742 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ae12c-53f7-402b-8459-2ba9f925788d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:32.013057 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ae12c-53f7-402b-8459-2ba9f925788d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:32.014777 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ae12c-53f7-402b-8459-2ba9f925788d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:32.043600 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-5b5ae12c-53f7-402b-8459-2ba9f925788d None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:32.045860 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5b5ae12c-53f7-402b-8459-2ba9f925788d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:32.190226 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 830/1664] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:32.206846 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ae12c-53f7-402b-8459-2ba9f925788d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:32.208842 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5b5ae12c-53f7-402b-8459-2ba9f925788d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:32.219931 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 835/1665] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:32.227238 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4db117-3962-4877-8f1d-be9e2eda9838 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:32.229096 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4db117-3962-4877-8f1d-be9e2eda9838 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:32.229527 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4db117-3962-4877-8f1d-be9e2eda9838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:32.330857 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-dd4db117-3962-4877-8f1d-be9e2eda9838 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:32.338477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-dd4db117-3962-4877-8f1d-be9e2eda9838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:32.347129 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ae12c-53f7-402b-8459-2ba9f925788d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:32.351785 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f276fc2-f8a0-4414-a3f3-e2ed5c7578b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:32.352622 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f276fc2-f8a0-4414-a3f3-e2ed5c7578b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:32.353077 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f276fc2-f8a0-4414-a3f3-e2ed5c7578b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:32.353517 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f276fc2-f8a0-4414-a3f3-e2ed5c7578b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:32.373276 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 836/1666] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:32.383772 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4db117-3962-4877-8f1d-be9e2eda9838 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:32.407083 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f276fc2-f8a0-4414-a3f3-e2ed5c7578b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:32.410319 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f276fc2-f8a0-4414-a3f3-e2ed5c7578b9 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:32.427221 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4db117-3962-4877-8f1d-be9e2eda9838 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:32.444680 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f3663-073e-4604-b15b-8f24fe08297e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:32.445490 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f3663-073e-4604-b15b-8f24fe08297e admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:32.445887 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f3663-073e-4604-b15b-8f24fe08297e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:32.446272 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f3663-073e-4604-b15b-8f24fe08297e admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:32.447144 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f3663-073e-4604-b15b-8f24fe08297e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:55:32.447564 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f3663-073e-4604-b15b-8f24fe08297e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:32.449831 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 831/1667] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:32.451754 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f3663-073e-4604-b15b-8f24fe08297e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:32.491379 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 837/1668] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:55:32.496370 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f276fc2-f8a0-4414-a3f3-e2ed5c7578b9 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:32.509433 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f276fc2-f8a0-4414-a3f3-e2ed5c7578b9 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:32.536384 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8af9e6-5d94-495f-97de-75ee9d6b2408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:32.537551 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8af9e6-5d94-495f-97de-75ee9d6b2408 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:32.537845 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8af9e6-5d94-495f-97de-75ee9d6b2408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:32.538123 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8af9e6-5d94-495f-97de-75ee9d6b2408 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:32.538833 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8af9e6-5d94-495f-97de-75ee9d6b2408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:32.542792 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8af9e6-5d94-495f-97de-75ee9d6b2408 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:32.604388 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 832/1669] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:32 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:32.605569 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f3663-073e-4604-b15b-8f24fe08297e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:32.619798 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f3663-073e-4604-b15b-8f24fe08297e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:32.729477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bfeed-66be-4279-b286-26febad6ba5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:32.730209 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bfeed-66be-4279-b286-26febad6ba5e admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:32.730494 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bfeed-66be-4279-b286-26febad6ba5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:32.730764 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6bfeed-66be-4279-b286-26febad6ba5e admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:32.731560 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6bfeed-66be-4279-b286-26febad6ba5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:32.733862 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6bfeed-66be-4279-b286-26febad6ba5e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:32.773264 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc96418-45e2-4979-aa11-a6370bfb6442 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:32.773549 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc96418-45e2-4979-aa11-a6370bfb6442 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:32.773833 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc96418-45e2-4979-aa11-a6370bfb6442 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:32.776041 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 838/1670] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:32 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:55:32.778939 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 833/1671] 10.222.0.67 () {54 vars in 960 bytes} [Mon Apr 11 13:55:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:55:32.780216 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bfeed-66be-4279-b286-26febad6ba5e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:32.782285 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d660e-5457-4e4b-b81b-c669d4601304 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:32.782564 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d660e-5457-4e4b-b81b-c669d4601304 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:32.782829 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d660e-5457-4e4b-b81b-c669d4601304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:32.817451 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6bfeed-66be-4279-b286-26febad6ba5e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:32.833154 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795fb19-4a01-4dd6-bdff-6e84c6d3218a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:32.833696 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-171d660e-5457-4e4b-b81b-c669d4601304 None None] MFA Rules not processed for user `1885d4d35b6743299a73b3c12b1793b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:32.836342 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795fb19-4a01-4dd6-bdff-6e84c6d3218a admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:32.837249 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-171d660e-5457-4e4b-b81b-c669d4601304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:32.837622 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795fb19-4a01-4dd6-bdff-6e84c6d3218a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:32.839013 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795fb19-4a01-4dd6-bdff-6e84c6d3218a admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:32.839967 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795fb19-4a01-4dd6-bdff-6e84c6d3218a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:32.845363 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795fb19-4a01-4dd6-bdff-6e84c6d3218a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:32.889419 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 839/1672] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:32.893418 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795fb19-4a01-4dd6-bdff-6e84c6d3218a admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:32.941110 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795fb19-4a01-4dd6-bdff-6e84c6d3218a admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:32.972783 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d60b6-5388-4158-87f9-49f2ef647fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:32.973635 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d60b6-5388-4158-87f9-49f2ef647fea admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:32.974072 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d60b6-5388-4158-87f9-49f2ef647fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:32.974459 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d60b6-5388-4158-87f9-49f2ef647fea admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:32.976079 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d60b6-5388-4158-87f9-49f2ef647fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:32.982643 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d60b6-5388-4158-87f9-49f2ef647fea admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:33.021023 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 840/1673] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:33.024283 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d60b6-5388-4158-87f9-49f2ef647fea admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:33.040972 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 834/1674] 10.222.0.67 () {58 vars in 1057 bytes} [Mon Apr 11 13:55:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:55:33.042648 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d660e-5457-4e4b-b81b-c669d4601304 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:33.064875 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d660e-5457-4e4b-b81b-c669d4601304 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:33.072271 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d60b6-5388-4158-87f9-49f2ef647fea admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:33.088292 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a13b3-48d6-4f6a-835c-1ea6f58c4030 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1885d4d35b6743299a73b3c12b1793b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:33.089368 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a13b3-48d6-4f6a-835c-1ea6f58c4030 service placement] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:33.089822 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a13b3-48d6-4f6a-835c-1ea6f58c4030 service placement] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:33.090260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a13b3-48d6-4f6a-835c-1ea6f58c4030 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:33.093486 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d24bac-bfd6-4274-8367-0d6f18eaa862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:33.094684 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-857a13b3-48d6-4f6a-835c-1ea6f58c4030 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:33.097399 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d24bac-bfd6-4274-8367-0d6f18eaa862 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:33.100555 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d24bac-bfd6-4274-8367-0d6f18eaa862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:33.101965 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d24bac-bfd6-4274-8367-0d6f18eaa862 admin admin] PATH_INFO: `/v3/projects/00a1f98456884313b707a656188dc782/users/310d46264fcd44ea9c9dcea7a35be975/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:33.119959 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a13b3-48d6-4f6a-835c-1ea6f58c4030 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:33.121773 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a13b3-48d6-4f6a-835c-1ea6f58c4030 service placement] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:33.158005 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 835/1675] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:33.159621 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d24bac-bfd6-4274-8367-0d6f18eaa862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a1f98456884313b707a656188dc782, user_id=310d46264fcd44ea9c9dcea7a35be975, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:33.167684 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d24bac-bfd6-4274-8367-0d6f18eaa862 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:33.210580 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 841/1676] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:33 2022] PUT /identity/v3/projects/00a1f98456884313b707a656188dc782/users/310d46264fcd44ea9c9dcea7a35be975/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:33.214236 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9a4a0-d096-487f-8e94-3a98500b654d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:33.214635 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9a4a0-d096-487f-8e94-3a98500b654d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:33.215405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9a4a0-d096-487f-8e94-3a98500b654d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:33.290803 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d8d9a4a0-d096-487f-8e94-3a98500b654d None None] MFA Rules not processed for user `310d46264fcd44ea9c9dcea7a35be975`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:33.294810 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d8d9a4a0-d096-487f-8e94-3a98500b654d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:33.474295 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 836/1677] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:55:33.477389 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d24bac-bfd6-4274-8367-0d6f18eaa862 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:33.645020 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d24bac-bfd6-4274-8367-0d6f18eaa862 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:33.658897 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b0b7a-87c1-4caa-8d97-8ce61f88e6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:33.659873 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b0b7a-87c1-4caa-8d97-8ce61f88e6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:33.660309 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b0b7a-87c1-4caa-8d97-8ce61f88e6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:33.660765 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b0b7a-87c1-4caa-8d97-8ce61f88e6c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:33.664724 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b0b7a-87c1-4caa-8d97-8ce61f88e6c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:33.668930 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b0b7a-87c1-4caa-8d97-8ce61f88e6c6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:33.840426 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9a4a0-d096-487f-8e94-3a98500b654d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:33.841803 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 842/1678] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:33 2022] POST /identity/v3/projects => generated 371 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:33.841942 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9a4a0-d096-487f-8e94-3a98500b654d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:33.845799 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b0b7a-87c1-4caa-8d97-8ce61f88e6c6 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:33.847894 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-077b0b7a-87c1-4caa-8d97-8ce61f88e6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:34.036600 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0891b-befe-4f1f-b639-620d0aa2d21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:34.039271 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0891b-befe-4f1f-b639-620d0aa2d21d admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:34.042670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0891b-befe-4f1f-b639-620d0aa2d21d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:34.044896 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0891b-befe-4f1f-b639-620d0aa2d21d admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:34.045965 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0891b-befe-4f1f-b639-620d0aa2d21d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:34.053625 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0891b-befe-4f1f-b639-620d0aa2d21d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:34.061736 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b0b7a-87c1-4caa-8d97-8ce61f88e6c6 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:34.079201 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd88753-639d-45c1-8fc5-a6c26c2ea687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:34.084774 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd88753-639d-45c1-8fc5-a6c26c2ea687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:34.086725 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd88753-639d-45c1-8fc5-a6c26c2ea687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:34.087021 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd88753-639d-45c1-8fc5-a6c26c2ea687 admin admin] PATH_INFO: `/v3/projects/f0be84cb2f1b4877beee599373f62238` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:34.090366 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd88753-639d-45c1-8fc5-a6c26c2ea687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0be84cb2f1b4877beee599373f62238)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:34.096593 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd88753-639d-45c1-8fc5-a6c26c2ea687 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:34.106092 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 837/1679] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:33 2022] POST /identity/v3/users => generated 292 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:34.108301 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0891b-befe-4f1f-b639-620d0aa2d21d admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:34.154834 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0891b-befe-4f1f-b639-620d0aa2d21d admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:34.197334 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8742d-f66c-42ab-80fa-513e4fd45968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:34.198050 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8742d-f66c-42ab-80fa-513e4fd45968 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:34.198341 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8742d-f66c-42ab-80fa-513e4fd45968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:34.198651 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8742d-f66c-42ab-80fa-513e4fd45968 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:34.199405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8742d-f66c-42ab-80fa-513e4fd45968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:34.201118 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8742d-f66c-42ab-80fa-513e4fd45968 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:34.238190 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 838/1680] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:34.243094 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8742d-f66c-42ab-80fa-513e4fd45968 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:34.255202 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8742d-f66c-42ab-80fa-513e4fd45968 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:34.290987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ecd88753-639d-45c1-8fc5-a6c26c2ea687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0be84cb2f1b4877beee599373f62238', 'request_id': 'req-ecd88753-639d-45c1-8fc5-a6c26c2ea687'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:34.321766 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ecd88753-639d-45c1-8fc5-a6c26c2ea687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0be84cb2f1b4877beee599373f62238', 'request_id': 'req-ecd88753-639d-45c1-8fc5-a6c26c2ea687'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:34.334243 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ecd88753-639d-45c1-8fc5-a6c26c2ea687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0be84cb2f1b4877beee599373f62238', 'request_id': 'req-ecd88753-639d-45c1-8fc5-a6c26c2ea687'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:34.372764 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ecd88753-639d-45c1-8fc5-a6c26c2ea687 admin admin] The token cache is being invalidate because project f0be84cb2f1b4877beee599373f62238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:55:34.374640 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ecd88753-639d-45c1-8fc5-a6c26c2ea687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:34.376092 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ecd88753-639d-45c1-8fc5-a6c26c2ea687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:34.388137 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 843/1681] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:55:33 2022] DELETE /identity/v3/projects/f0be84cb2f1b4877beee599373f62238 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:34.397975 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd88753-639d-45c1-8fc5-a6c26c2ea687 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:34.402005 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ecd88753-639d-45c1-8fc5-a6c26c2ea687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:34.451541 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08d111-8330-4936-b0e8-9d848e3cfc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:34.452724 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08d111-8330-4936-b0e8-9d848e3cfc46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:34.453129 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08d111-8330-4936-b0e8-9d848e3cfc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:34.453626 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08d111-8330-4936-b0e8-9d848e3cfc46 admin admin] PATH_INFO: `/v3/projects/528a305d0dae426d8723835a49ac5923/users/5abd29551f1642c9aff64fdef0592fa4/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:34.481293 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08d111-8330-4936-b0e8-9d848e3cfc46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=528a305d0dae426d8723835a49ac5923, user_id=5abd29551f1642c9aff64fdef0592fa4, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:34.492105 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08d111-8330-4936-b0e8-9d848e3cfc46 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:34.520374 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 839/1682] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:34 2022] PUT /identity/v3/projects/528a305d0dae426d8723835a49ac5923/users/5abd29551f1642c9aff64fdef0592fa4/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:34.524857 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08d111-8330-4936-b0e8-9d848e3cfc46 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:34.527033 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-fb08d111-8330-4936-b0e8-9d848e3cfc46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:34.640028 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd88753-639d-45c1-8fc5-a6c26c2ea687 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:34.747695 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08d111-8330-4936-b0e8-9d848e3cfc46 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:34.762913 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a59ba1-f66d-4b60-92d9-c21dca99784b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:34.764398 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a59ba1-f66d-4b60-92d9-c21dca99784b admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:34.766627 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a59ba1-f66d-4b60-92d9-c21dca99784b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:34.766872 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a59ba1-f66d-4b60-92d9-c21dca99784b admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:34.767676 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a59ba1-f66d-4b60-92d9-c21dca99784b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:34.782342 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a59ba1-f66d-4b60-92d9-c21dca99784b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:34.808422 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 840/1683] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:34.814579 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a59ba1-f66d-4b60-92d9-c21dca99784b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:34.840409 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63a5fd-f31f-4cb3-aa79-d6cdfd04fb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:34.841145 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63a5fd-f31f-4cb3-aa79-d6cdfd04fb12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:34.849243 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a59ba1-f66d-4b60-92d9-c21dca99784b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:34.850776 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63a5fd-f31f-4cb3-aa79-d6cdfd04fb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:34.851074 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63a5fd-f31f-4cb3-aa79-d6cdfd04fb12 admin admin] PATH_INFO: `/v3/users/8087f47514fa4b43aa9e0e47e888996d` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:34.853743 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63a5fd-f31f-4cb3-aa79-d6cdfd04fb12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8087f47514fa4b43aa9e0e47e888996d)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:34.855909 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: WARNING py.warnings [None req-7d63a5fd-f31f-4cb3-aa79-d6cdfd04fb12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:55:34.855909 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: warnings.warn(msg) Apr 11 13:55:34.855909 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: Apr 11 13:55:34.860205 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63a5fd-f31f-4cb3-aa79-d6cdfd04fb12 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:34.869317 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de291346-4cb3-476e-b9fc-fcfa958e92a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:34.870251 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de291346-4cb3-476e-b9fc-fcfa958e92a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:34.871011 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de291346-4cb3-476e-b9fc-fcfa958e92a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:34.871534 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de291346-4cb3-476e-b9fc-fcfa958e92a3 admin admin] PATH_INFO: `/v3/projects/528a305d0dae426d8723835a49ac5923/users/5abd29551f1642c9aff64fdef0592fa4/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:34.882089 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de291346-4cb3-476e-b9fc-fcfa958e92a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=528a305d0dae426d8723835a49ac5923, user_id=5abd29551f1642c9aff64fdef0592fa4, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:34.884297 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de291346-4cb3-476e-b9fc-fcfa958e92a3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:34.951343 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 841/1684] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:34 2022] PUT /identity/v3/projects/528a305d0dae426d8723835a49ac5923/users/5abd29551f1642c9aff64fdef0592fa4/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:34.961894 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec6172-d741-4aae-bb15-cd9761af39fc None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:34.962361 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec6172-d741-4aae-bb15-cd9761af39fc None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:34.962809 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec6172-d741-4aae-bb15-cd9761af39fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:35.034840 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d9ec6172-d741-4aae-bb15-cd9761af39fc None None] MFA Rules not processed for user `5abd29551f1642c9aff64fdef0592fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:35.036476 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d9ec6172-d741-4aae-bb15-cd9761af39fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:35.065290 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7d63a5fd-f31f-4cb3-aa79-d6cdfd04fb12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8087f47514fa4b43aa9e0e47e888996d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:35.109969 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7d63a5fd-f31f-4cb3-aa79-d6cdfd04fb12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8087f47514fa4b43aa9e0e47e888996d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:35.139800 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7d63a5fd-f31f-4cb3-aa79-d6cdfd04fb12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8087f47514fa4b43aa9e0e47e888996d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:35.143254 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7d63a5fd-f31f-4cb3-aa79-d6cdfd04fb12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8087f47514fa4b43aa9e0e47e888996d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:35.144382 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7d63a5fd-f31f-4cb3-aa79-d6cdfd04fb12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8087f47514fa4b43aa9e0e47e888996d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:35.211022 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 842/1685] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:34 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:35.217530 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 844/1686] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:55:34 2022] DELETE /identity/v3/users/8087f47514fa4b43aa9e0e47e888996d => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:35.299402 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec6172-d741-4aae-bb15-cd9761af39fc None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:35.301232 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d9ec6172-d741-4aae-bb15-cd9761af39fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:35.475310 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec6172-d741-4aae-bb15-cd9761af39fc None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:35.615934 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b3101-974a-4c3a-ad80-52fc777712c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:35.616631 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b3101-974a-4c3a-ad80-52fc777712c8 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:35.616918 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b3101-974a-4c3a-ad80-52fc777712c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:35.617202 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b3101-974a-4c3a-ad80-52fc777712c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:35.760206 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b3101-974a-4c3a-ad80-52fc777712c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:35.762646 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b3101-974a-4c3a-ad80-52fc777712c8 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:35.791124 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 843/1687] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:35 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:35.940861 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63a5fd-f31f-4cb3-aa79-d6cdfd04fb12 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:35.956239 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63a5fd-f31f-4cb3-aa79-d6cdfd04fb12 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:35.956601 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b3101-974a-4c3a-ad80-52fc777712c8 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:35.958182 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5b4b3101-974a-4c3a-ad80-52fc777712c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:35.963623 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174b8a5-fc5b-4aea-8547-3581295a4e25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:35.964529 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174b8a5-fc5b-4aea-8547-3581295a4e25 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:35.965175 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174b8a5-fc5b-4aea-8547-3581295a4e25 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:35.965587 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174b8a5-fc5b-4aea-8547-3581295a4e25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:35.971537 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b174b8a5-fc5b-4aea-8547-3581295a4e25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:36.080928 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b3101-974a-4c3a-ad80-52fc777712c8 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:36.087366 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e44c3f-92f7-4dfd-82d9-662bb2e65cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:36.088298 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e44c3f-92f7-4dfd-82d9-662bb2e65cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:36.089594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e44c3f-92f7-4dfd-82d9-662bb2e65cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:36.090072 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e44c3f-92f7-4dfd-82d9-662bb2e65cb9 admin admin] PATH_INFO: `/v3/projects/dc15b08801ad4113979fdf15cdf41a89` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:36.091814 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e44c3f-92f7-4dfd-82d9-662bb2e65cb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc15b08801ad4113979fdf15cdf41a89)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:36.093400 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: WARNING py.warnings [None req-a8e44c3f-92f7-4dfd-82d9-662bb2e65cb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 13:55:36.093400 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: warnings.warn(msg) Apr 11 13:55:36.093400 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: Apr 11 13:55:36.095610 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e44c3f-92f7-4dfd-82d9-662bb2e65cb9 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:36.104097 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174b8a5-fc5b-4aea-8547-3581295a4e25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:36.105645 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174b8a5-fc5b-4aea-8547-3581295a4e25 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:36.116676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 845/1688] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:36.205983 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a8e44c3f-92f7-4dfd-82d9-662bb2e65cb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc15b08801ad4113979fdf15cdf41a89', 'request_id': 'req-a8e44c3f-92f7-4dfd-82d9-662bb2e65cb9'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:36.224192 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a8e44c3f-92f7-4dfd-82d9-662bb2e65cb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc15b08801ad4113979fdf15cdf41a89', 'request_id': 'req-a8e44c3f-92f7-4dfd-82d9-662bb2e65cb9'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:36.232703 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a8e44c3f-92f7-4dfd-82d9-662bb2e65cb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc15b08801ad4113979fdf15cdf41a89', 'request_id': 'req-a8e44c3f-92f7-4dfd-82d9-662bb2e65cb9'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:36.262154 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a8e44c3f-92f7-4dfd-82d9-662bb2e65cb9 admin admin] The token cache is being invalidate because project dc15b08801ad4113979fdf15cdf41a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:55:36.262782 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a8e44c3f-92f7-4dfd-82d9-662bb2e65cb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:36.263791 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a8e44c3f-92f7-4dfd-82d9-662bb2e65cb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:36.266582 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 844/1689] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:55:35 2022] DELETE /identity/v3/projects/dc15b08801ad4113979fdf15cdf41a89 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:55:36.276624 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491f705-11cc-40a7-9529-7bdab86f52eb None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:36.277401 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491f705-11cc-40a7-9529-7bdab86f52eb None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:36.277864 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491f705-11cc-40a7-9529-7bdab86f52eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:36.333119 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b491f705-11cc-40a7-9529-7bdab86f52eb None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:36.340456 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b491f705-11cc-40a7-9529-7bdab86f52eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:36.503503 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0e8c0-5513-495b-9aea-b0deac9c4a31 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:36.503839 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0e8c0-5513-495b-9aea-b0deac9c4a31 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:36.504151 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 846/1690] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:36.504279 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0e8c0-5513-495b-9aea-b0deac9c4a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:36.554123 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-9ca0e8c0-5513-495b-9aea-b0deac9c4a31 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:36.556458 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9ca0e8c0-5513-495b-9aea-b0deac9c4a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:36.585529 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491f705-11cc-40a7-9529-7bdab86f52eb None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:36.595927 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 845/1691] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:36.617899 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491f705-11cc-40a7-9529-7bdab86f52eb None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:36.625638 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b30b40-255d-4275-951a-1f27a928b2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:36.626588 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b30b40-255d-4275-951a-1f27a928b2ce admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:36.626923 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b30b40-255d-4275-951a-1f27a928b2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:36.627202 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b30b40-255d-4275-951a-1f27a928b2ce admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:36.627976 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b30b40-255d-4275-951a-1f27a928b2ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:55:36.628281 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b30b40-255d-4275-951a-1f27a928b2ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:36.630770 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b30b40-255d-4275-951a-1f27a928b2ce admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:36.655241 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 847/1692] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:55:36.656949 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0e8c0-5513-495b-9aea-b0deac9c4a31 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:36.706951 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0e8c0-5513-495b-9aea-b0deac9c4a31 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:36.729765 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145e73c-0599-4781-b6f3-215574e4a82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:36.730976 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145e73c-0599-4781-b6f3-215574e4a82d admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:36.732765 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145e73c-0599-4781-b6f3-215574e4a82d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:36.733865 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145e73c-0599-4781-b6f3-215574e4a82d admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:36.737135 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145e73c-0599-4781-b6f3-215574e4a82d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:36.741224 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145e73c-0599-4781-b6f3-215574e4a82d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:36.799089 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 846/1693] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:36 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:36.800062 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b30b40-255d-4275-951a-1f27a928b2ce admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:36.815527 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b30b40-255d-4275-951a-1f27a928b2ce admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:36.922121 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223dc3f-a223-43e5-9a3b-98b8553d8bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:36.922820 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223dc3f-a223-43e5-9a3b-98b8553d8bab admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:36.923173 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223dc3f-a223-43e5-9a3b-98b8553d8bab admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:36.923420 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223dc3f-a223-43e5-9a3b-98b8553d8bab admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:36.924349 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223dc3f-a223-43e5-9a3b-98b8553d8bab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:36.926681 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223dc3f-a223-43e5-9a3b-98b8553d8bab admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:36.966389 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145e73c-0599-4781-b6f3-215574e4a82d admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:36.967760 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 848/1694] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:36 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:36.984401 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145e73c-0599-4781-b6f3-215574e4a82d admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:37.015410 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1c439-7c20-416f-80d8-51349b759c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:37.017041 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1c439-7c20-416f-80d8-51349b759c41 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:37.017481 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1c439-7c20-416f-80d8-51349b759c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:37.018261 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1c439-7c20-416f-80d8-51349b759c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:37.019125 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1c439-7c20-416f-80d8-51349b759c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:37.023250 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1c439-7c20-416f-80d8-51349b759c41 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:37.048580 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 847/1695] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:37.053622 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223dc3f-a223-43e5-9a3b-98b8553d8bab admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:37.064382 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223dc3f-a223-43e5-9a3b-98b8553d8bab admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:37.075225 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a824211-722c-4084-bb27-b390c75f0bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:37.076030 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a824211-722c-4084-bb27-b390c75f0bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:37.076379 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a824211-722c-4084-bb27-b390c75f0bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:37.076736 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a824211-722c-4084-bb27-b390c75f0bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:37.077542 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a824211-722c-4084-bb27-b390c75f0bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:37.079297 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a824211-722c-4084-bb27-b390c75f0bb4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:37.104610 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1c439-7c20-416f-80d8-51349b759c41 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:37.105762 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 849/1696] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:37.119727 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1c439-7c20-416f-80d8-51349b759c41 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:37.125350 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb862c-bb3b-4253-9bf5-492090592789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:37.126465 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb862c-bb3b-4253-9bf5-492090592789 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:37.126755 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb862c-bb3b-4253-9bf5-492090592789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:37.127037 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb862c-bb3b-4253-9bf5-492090592789 admin admin] PATH_INFO: `/v3/projects/e3a8a03f0c22460bae45ee6ea84bc6dd/users/2efb22d0b8be414e82984fc929942de5/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:37.143658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb862c-bb3b-4253-9bf5-492090592789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a8a03f0c22460bae45ee6ea84bc6dd, user_id=2efb22d0b8be414e82984fc929942de5, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:37.147266 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb862c-bb3b-4253-9bf5-492090592789 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:37.165585 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 848/1697] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:37 2022] PUT /identity/v3/projects/e3a8a03f0c22460bae45ee6ea84bc6dd/users/2efb22d0b8be414e82984fc929942de5/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:55:37.176750 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ffc50-db0c-4870-9c6a-15aca6b8d638 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:37.177041 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ffc50-db0c-4870-9c6a-15aca6b8d638 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:37.177329 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ffc50-db0c-4870-9c6a-15aca6b8d638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:37.206216 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-dc7ffc50-db0c-4870-9c6a-15aca6b8d638 None None] MFA Rules not processed for user `2efb22d0b8be414e82984fc929942de5`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:37.207458 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-dc7ffc50-db0c-4870-9c6a-15aca6b8d638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:37.272171 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0963d1-ca77-41c0-bbb9-262c56a182aa None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:37.272582 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0963d1-ca77-41c0-bbb9-262c56a182aa None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:37.273140 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0963d1-ca77-41c0-bbb9-262c56a182aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:37.311554 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4d0963d1-ca77-41c0-bbb9-262c56a182aa None None] MFA Rules not processed for user `cfe3f01cd2f742f4903ed97da6b6923c`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:37.312703 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 850/1698] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:37.319864 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4d0963d1-ca77-41c0-bbb9-262c56a182aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:37.320502 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ffc50-db0c-4870-9c6a-15aca6b8d638 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:37.445807 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 849/1699] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:37.458069 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b94cfa-90dd-4e91-9e8a-d776284cb2af None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:37.458381 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b94cfa-90dd-4e91-9e8a-d776284cb2af None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:37.458631 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b94cfa-90dd-4e91-9e8a-d776284cb2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:37.487049 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ffc50-db0c-4870-9c6a-15aca6b8d638 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:37.505514 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-87b94cfa-90dd-4e91-9e8a-d776284cb2af None None] MFA Rules not processed for user `cfe3f01cd2f742f4903ed97da6b6923c`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:37.507553 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417348f9-db1f-46fc-ba60-280568fd2d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:37.507955 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-87b94cfa-90dd-4e91-9e8a-d776284cb2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:37.508301 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417348f9-db1f-46fc-ba60-280568fd2d20 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:37.508589 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417348f9-db1f-46fc-ba60-280568fd2d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:37.508867 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417348f9-db1f-46fc-ba60-280568fd2d20 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:37.509576 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417348f9-db1f-46fc-ba60-280568fd2d20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:37.511720 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417348f9-db1f-46fc-ba60-280568fd2d20 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:37.520335 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 850/1700] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:55:37.527472 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b94cfa-90dd-4e91-9e8a-d776284cb2af None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:37.530066 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-87b94cfa-90dd-4e91-9e8a-d776284cb2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:37.580836 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 851/1701] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:37 2022] POST /identity/v3/projects => generated 383 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:37.582214 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417348f9-db1f-46fc-ba60-280568fd2d20 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:37.730069 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417348f9-db1f-46fc-ba60-280568fd2d20 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:37.744882 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a11d8-9aca-4e4c-94dd-7991812dfb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:37.745769 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a11d8-9aca-4e4c-94dd-7991812dfb9a admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:37.746054 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a11d8-9aca-4e4c-94dd-7991812dfb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:37.746336 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a11d8-9aca-4e4c-94dd-7991812dfb9a admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:37.747188 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a11d8-9aca-4e4c-94dd-7991812dfb9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:37.749399 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a11d8-9aca-4e4c-94dd-7991812dfb9a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:37.753108 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b94cfa-90dd-4e91-9e8a-d776284cb2af None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:37.807545 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 852/1702] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:37 2022] POST /identity/v3/users => generated 298 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:37.808539 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a11d8-9aca-4e4c-94dd-7991812dfb9a admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:37.823197 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a11d8-9aca-4e4c-94dd-7991812dfb9a admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:37.829031 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5da2c-4fda-4889-bca5-d93d8aa10ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:37.829714 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5da2c-4fda-4889-bca5-d93d8aa10ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:37.829992 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5da2c-4fda-4889-bca5-d93d8aa10ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:37.830264 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5da2c-4fda-4889-bca5-d93d8aa10ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:37.831058 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5da2c-4fda-4889-bca5-d93d8aa10ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:37.833428 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5da2c-4fda-4889-bca5-d93d8aa10ba2 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:37.845550 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 853/1703] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:37.849125 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5da2c-4fda-4889-bca5-d93d8aa10ba2 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:37.868622 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5da2c-4fda-4889-bca5-d93d8aa10ba2 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:37.874825 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7dce0-01a9-43e5-b082-953da20797b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:37.876392 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7dce0-01a9-43e5-b082-953da20797b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:37.876392 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7dce0-01a9-43e5-b082-953da20797b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:37.876707 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7dce0-01a9-43e5-b082-953da20797b9 admin admin] PATH_INFO: `/v3/projects/1e69ffabedd64ef79b45660a0d81a8c7/users/543ffd7d4ede4a6b9bdd003f48c2d727/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:37.895503 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4cfda-2d4f-4aa5-bc21-c125cce4f47d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:37.896506 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4cfda-2d4f-4aa5-bc21-c125cce4f47d service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:37.896713 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4cfda-2d4f-4aa5-bc21-c125cce4f47d service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:37.896995 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4cfda-2d4f-4aa5-bc21-c125cce4f47d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:37.916750 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7dce0-01a9-43e5-b082-953da20797b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e69ffabedd64ef79b45660a0d81a8c7, user_id=543ffd7d4ede4a6b9bdd003f48c2d727, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:37.925162 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7dce0-01a9-43e5-b082-953da20797b9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:37.956176 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 854/1704] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:37 2022] PUT /identity/v3/projects/1e69ffabedd64ef79b45660a0d81a8c7/users/543ffd7d4ede4a6b9bdd003f48c2d727/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:37.957676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7dce0-01a9-43e5-b082-953da20797b9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:37.999225 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4cfda-2d4f-4aa5-bc21-c125cce4f47d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:38.005377 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4cfda-2d4f-4aa5-bc21-c125cce4f47d service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:38.020546 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 851/1705] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:38.085348 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7dce0-01a9-43e5-b082-953da20797b9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:38.091723 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a85483-f895-4a54-8745-5e6bea443085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:38.092654 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a85483-f895-4a54-8745-5e6bea443085 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:38.093133 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a85483-f895-4a54-8745-5e6bea443085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:38.093551 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a85483-f895-4a54-8745-5e6bea443085 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:38.094443 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a85483-f895-4a54-8745-5e6bea443085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:38.096432 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a85483-f895-4a54-8745-5e6bea443085 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:38.114644 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 855/1706] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:55:38.115700 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4cfda-2d4f-4aa5-bc21-c125cce4f47d service nova] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:38.132772 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4cfda-2d4f-4aa5-bc21-c125cce4f47d service nova] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:38.142168 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf39e70-e265-4c7a-b85b-98e034d1797b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:38.143093 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf39e70-e265-4c7a-b85b-98e034d1797b admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:38.147457 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf39e70-e265-4c7a-b85b-98e034d1797b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:38.148042 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf39e70-e265-4c7a-b85b-98e034d1797b admin admin] PATH_INFO: `/v3/projects/1e69ffabedd64ef79b45660a0d81a8c7/users/543ffd7d4ede4a6b9bdd003f48c2d727/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:38.158469 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf39e70-e265-4c7a-b85b-98e034d1797b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e69ffabedd64ef79b45660a0d81a8c7, user_id=543ffd7d4ede4a6b9bdd003f48c2d727, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:38.162130 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf39e70-e265-4c7a-b85b-98e034d1797b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:38.244211 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 852/1707] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:38 2022] PUT /identity/v3/projects/1e69ffabedd64ef79b45660a0d81a8c7/users/543ffd7d4ede4a6b9bdd003f48c2d727/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:55:38.248830 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986f358-23cd-4ce1-aa99-1d62f947d7c4 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:38.249192 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986f358-23cd-4ce1-aa99-1d62f947d7c4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:38.249475 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986f358-23cd-4ce1-aa99-1d62f947d7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:38.319233 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0986f358-23cd-4ce1-aa99-1d62f947d7c4 None None] MFA Rules not processed for user `543ffd7d4ede4a6b9bdd003f48c2d727`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:38.320646 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0986f358-23cd-4ce1-aa99-1d62f947d7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:38.462455 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 856/1708] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:38.475554 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf39e70-e265-4c7a-b85b-98e034d1797b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:38.477906 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1cf39e70-e265-4c7a-b85b-98e034d1797b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:38.574301 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf39e70-e265-4c7a-b85b-98e034d1797b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:38.595011 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba3492-fff9-4561-92de-cd4e502a9608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:38.595647 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba3492-fff9-4561-92de-cd4e502a9608 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:38.595935 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba3492-fff9-4561-92de-cd4e502a9608 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:38.596673 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba3492-fff9-4561-92de-cd4e502a9608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:38.633948 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba3492-fff9-4561-92de-cd4e502a9608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:38.635649 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba3492-fff9-4561-92de-cd4e502a9608 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:38.658329 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 853/1709] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:55:38.847499 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986f358-23cd-4ce1-aa99-1d62f947d7c4 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:39.009093 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986f358-23cd-4ce1-aa99-1d62f947d7c4 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:39.014987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdeea97-93e4-4801-8c72-9e3323d508a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:39.015989 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeea97-93e4-4801-8c72-9e3323d508a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:39.016275 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeea97-93e4-4801-8c72-9e3323d508a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:39.016551 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdeea97-93e4-4801-8c72-9e3323d508a3 admin admin] PATH_INFO: `/v3/users/2efb22d0b8be414e82984fc929942de5` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:39.017784 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdeea97-93e4-4801-8c72-9e3323d508a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2efb22d0b8be414e82984fc929942de5)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:39.038606 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdeea97-93e4-4801-8c72-9e3323d508a3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:39.141455 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dcdeea97-93e4-4801-8c72-9e3323d508a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2efb22d0b8be414e82984fc929942de5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:39.151827 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dcdeea97-93e4-4801-8c72-9e3323d508a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2efb22d0b8be414e82984fc929942de5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:39.153378 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a91f2-6f75-457c-bc17-e974667da848 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:39.153673 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a91f2-6f75-457c-bc17-e974667da848 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:39.153953 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a91f2-6f75-457c-bc17-e974667da848 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:39.155500 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 854/1710] 10.222.0.67 () {54 vars in 912 bytes} [Mon Apr 11 13:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:55:39.164392 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b670405-21c4-4919-9c79-13a38741b7e9 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:39.164824 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b670405-21c4-4919-9c79-13a38741b7e9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:39.165104 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b670405-21c4-4919-9c79-13a38741b7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:39.165887 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dcdeea97-93e4-4801-8c72-9e3323d508a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2efb22d0b8be414e82984fc929942de5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:39.167257 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dcdeea97-93e4-4801-8c72-9e3323d508a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2efb22d0b8be414e82984fc929942de5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:39.168067 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dcdeea97-93e4-4801-8c72-9e3323d508a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2efb22d0b8be414e82984fc929942de5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:39.204426 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 857/1711] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:55:38 2022] DELETE /identity/v3/users/2efb22d0b8be414e82984fc929942de5 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:39.206638 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea427e3-e09e-4635-ba19-7ca7df57c252 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:39.207005 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea427e3-e09e-4635-ba19-7ca7df57c252 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:39.207351 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea427e3-e09e-4635-ba19-7ca7df57c252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:39.207569 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4b670405-21c4-4919-9c79-13a38741b7e9 None None] MFA Rules not processed for user `c084d218ea414d638ef2dc45364a492c`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:39.209368 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4b670405-21c4-4919-9c79-13a38741b7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:39.243008 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-aea427e3-e09e-4635-ba19-7ca7df57c252 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:39.244938 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-aea427e3-e09e-4635-ba19-7ca7df57c252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:39.344465 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 858/1712] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:55:39.351930 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 855/1713] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Apr 11 13:55:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:39.356371 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea427e3-e09e-4635-ba19-7ca7df57c252 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:39.358041 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-aea427e3-e09e-4635-ba19-7ca7df57c252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:39.375457 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b670405-21c4-4919-9c79-13a38741b7e9 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:39.376901 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4b670405-21c4-4919-9c79-13a38741b7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:39.393734 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea427e3-e09e-4635-ba19-7ca7df57c252 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:39.401275 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b670405-21c4-4919-9c79-13a38741b7e9 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:39.407890 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e43e27-c967-4134-b9a9-1e2290859451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:39.409165 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e43e27-c967-4134-b9a9-1e2290859451 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:39.409773 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e43e27-c967-4134-b9a9-1e2290859451 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:39.410857 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e43e27-c967-4134-b9a9-1e2290859451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:39.410961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c6e6f-b7f7-4ff7-a92f-e65984ab0f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:39.411794 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c6e6f-b7f7-4ff7-a92f-e65984ab0f40 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:39.412136 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c6e6f-b7f7-4ff7-a92f-e65984ab0f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:39.412689 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c6e6f-b7f7-4ff7-a92f-e65984ab0f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:39.429513 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e43e27-c967-4134-b9a9-1e2290859451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:39.431330 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e43e27-c967-4134-b9a9-1e2290859451 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:39.432742 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c6e6f-b7f7-4ff7-a92f-e65984ab0f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:39.437999 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c6e6f-b7f7-4ff7-a92f-e65984ab0f40 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:39.441435 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 856/1714] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:39.443262 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b100ae-8d5c-48a9-8814-5db5210c754a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:39.444610 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b100ae-8d5c-48a9-8814-5db5210c754a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:39.445089 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b100ae-8d5c-48a9-8814-5db5210c754a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:39.471441 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 859/1715] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:39.483883 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-41b100ae-8d5c-48a9-8814-5db5210c754a None None] MFA Rules not processed for user `539174103f414528829d033481b83b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:39.486082 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-41b100ae-8d5c-48a9-8814-5db5210c754a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:39.628426 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 857/1716] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:39.646044 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c6e6f-b7f7-4ff7-a92f-e65984ab0f40 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:39.647568 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-bb2c6e6f-b7f7-4ff7-a92f-e65984ab0f40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:39.767456 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c6e6f-b7f7-4ff7-a92f-e65984ab0f40 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:39.774923 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a2bab-883c-451f-bed1-03d2d88888e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:39.775959 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a2bab-883c-451f-bed1-03d2d88888e6 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:39.776352 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a2bab-883c-451f-bed1-03d2d88888e6 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:39.776583 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a2bab-883c-451f-bed1-03d2d88888e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:39.799646 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a2bab-883c-451f-bed1-03d2d88888e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:39.802878 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a2bab-883c-451f-bed1-03d2d88888e6 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:39.823685 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 860/1717] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:55:40.189306 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b100ae-8d5c-48a9-8814-5db5210c754a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:40.193938 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-41b100ae-8d5c-48a9-8814-5db5210c754a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:40.218548 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b100ae-8d5c-48a9-8814-5db5210c754a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:40.223174 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e964efc-fef3-4e17-a43d-8c3fa7004412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:40.224604 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e964efc-fef3-4e17-a43d-8c3fa7004412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:40.225177 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e964efc-fef3-4e17-a43d-8c3fa7004412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:40.225756 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e964efc-fef3-4e17-a43d-8c3fa7004412 admin admin] PATH_INFO: `/v3/projects/e3a8a03f0c22460bae45ee6ea84bc6dd` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:40.227326 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e964efc-fef3-4e17-a43d-8c3fa7004412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3a8a03f0c22460bae45ee6ea84bc6dd)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:40.229994 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e964efc-fef3-4e17-a43d-8c3fa7004412 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:40.314546 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3e964efc-fef3-4e17-a43d-8c3fa7004412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a8a03f0c22460bae45ee6ea84bc6dd', 'request_id': 'req-3e964efc-fef3-4e17-a43d-8c3fa7004412'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:40.326221 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3e964efc-fef3-4e17-a43d-8c3fa7004412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a8a03f0c22460bae45ee6ea84bc6dd', 'request_id': 'req-3e964efc-fef3-4e17-a43d-8c3fa7004412'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:40.341121 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3e964efc-fef3-4e17-a43d-8c3fa7004412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a8a03f0c22460bae45ee6ea84bc6dd', 'request_id': 'req-3e964efc-fef3-4e17-a43d-8c3fa7004412'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:40.356386 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3e964efc-fef3-4e17-a43d-8c3fa7004412 admin admin] The token cache is being invalidate because project e3a8a03f0c22460bae45ee6ea84bc6dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:55:40.356886 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3e964efc-fef3-4e17-a43d-8c3fa7004412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:40.357752 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3e964efc-fef3-4e17-a43d-8c3fa7004412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:40.359620 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 858/1718] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:55:40 2022] DELETE /identity/v3/projects/e3a8a03f0c22460bae45ee6ea84bc6dd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:40.363584 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a2bab-883c-451f-bed1-03d2d88888e6 service nova] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:40.386220 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a2bab-883c-451f-bed1-03d2d88888e6 service nova] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:40.540644 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcc400-676d-41e3-92e9-956aff4fe8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:40.541446 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcc400-676d-41e3-92e9-956aff4fe8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:40.541761 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcc400-676d-41e3-92e9-956aff4fe8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:40.541988 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcc400-676d-41e3-92e9-956aff4fe8d8 admin admin] PATH_INFO: `/v3/users/543ffd7d4ede4a6b9bdd003f48c2d727` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:40.545283 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcc400-676d-41e3-92e9-956aff4fe8d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=543ffd7d4ede4a6b9bdd003f48c2d727)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:40.547224 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcc400-676d-41e3-92e9-956aff4fe8d8 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:40.610147 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4adcfb-2908-4e90-a0e9-8e9a1390e251 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:40.610614 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4adcfb-2908-4e90-a0e9-8e9a1390e251 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:40.610915 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4adcfb-2908-4e90-a0e9-8e9a1390e251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:40.654468 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4e4adcfb-2908-4e90-a0e9-8e9a1390e251 None None] MFA Rules not processed for user `cfe3f01cd2f742f4903ed97da6b6923c`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:40.655759 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4e4adcfb-2908-4e90-a0e9-8e9a1390e251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:40.679225 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7bdcc400-676d-41e3-92e9-956aff4fe8d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '543ffd7d4ede4a6b9bdd003f48c2d727'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:40.698366 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7bdcc400-676d-41e3-92e9-956aff4fe8d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '543ffd7d4ede4a6b9bdd003f48c2d727'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:40.725740 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7bdcc400-676d-41e3-92e9-956aff4fe8d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '543ffd7d4ede4a6b9bdd003f48c2d727'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:40.731931 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7bdcc400-676d-41e3-92e9-956aff4fe8d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '543ffd7d4ede4a6b9bdd003f48c2d727'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:40.732893 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7bdcc400-676d-41e3-92e9-956aff4fe8d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '543ffd7d4ede4a6b9bdd003f48c2d727'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:40.783994 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 861/1719] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:55:40 2022] DELETE /identity/v3/users/543ffd7d4ede4a6b9bdd003f48c2d727 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:40.819907 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 859/1720] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:41.525428 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ccbe8-e2f0-4459-81d8-e5635834098d None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:41.526600 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ccbe8-e2f0-4459-81d8-e5635834098d None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:41.527084 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ccbe8-e2f0-4459-81d8-e5635834098d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:41.573163 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-9f0ccbe8-e2f0-4459-81d8-e5635834098d None None] MFA Rules not processed for user `920ed843195243f8abd6dfb2ebb3a549`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:41.575947 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9f0ccbe8-e2f0-4459-81d8-e5635834098d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:41.861780 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 862/1721] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Apr 11 13:55:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:42.262023 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4adcfb-2908-4e90-a0e9-8e9a1390e251 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:42.264057 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4e4adcfb-2908-4e90-a0e9-8e9a1390e251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:42.468237 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4adcfb-2908-4e90-a0e9-8e9a1390e251 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:42.680189 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ccbe8-e2f0-4459-81d8-e5635834098d None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:42.681935 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9f0ccbe8-e2f0-4459-81d8-e5635834098d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:42.708131 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb57480-7468-4430-b387-7a94079eb371 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6660794b27ff4a7bbe9b6b043593598c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:42.711760 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb57480-7468-4430-b387-7a94079eb371 service swift] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:42.714532 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb57480-7468-4430-b387-7a94079eb371 service swift] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:42.716775 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb57480-7468-4430-b387-7a94079eb371 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:42.747999 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb57480-7468-4430-b387-7a94079eb371 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:42.754507 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb57480-7468-4430-b387-7a94079eb371 service swift] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:42.810014 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 860/1722] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Apr 11 13:55:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:55:42.973027 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ccbe8-e2f0-4459-81d8-e5635834098d None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:42.984114 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e76fd-0dbf-4006-ab0d-0c2f97d75898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:42.986859 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e76fd-0dbf-4006-ab0d-0c2f97d75898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:42.987355 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e76fd-0dbf-4006-ab0d-0c2f97d75898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:42.988491 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e76fd-0dbf-4006-ab0d-0c2f97d75898 admin admin] PATH_INFO: `/v3/projects/1e69ffabedd64ef79b45660a0d81a8c7` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:42.992630 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e76fd-0dbf-4006-ab0d-0c2f97d75898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e69ffabedd64ef79b45660a0d81a8c7)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:42.997624 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e76fd-0dbf-4006-ab0d-0c2f97d75898 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:43.183702 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-489e76fd-0dbf-4006-ab0d-0c2f97d75898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e69ffabedd64ef79b45660a0d81a8c7', 'request_id': 'req-489e76fd-0dbf-4006-ab0d-0c2f97d75898'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:43.218266 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-489e76fd-0dbf-4006-ab0d-0c2f97d75898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e69ffabedd64ef79b45660a0d81a8c7', 'request_id': 'req-489e76fd-0dbf-4006-ab0d-0c2f97d75898'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:43.234769 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-489e76fd-0dbf-4006-ab0d-0c2f97d75898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e69ffabedd64ef79b45660a0d81a8c7', 'request_id': 'req-489e76fd-0dbf-4006-ab0d-0c2f97d75898'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:43.269139 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-489e76fd-0dbf-4006-ab0d-0c2f97d75898 admin admin] The token cache is being invalidate because project 1e69ffabedd64ef79b45660a0d81a8c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:55:43.269440 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-489e76fd-0dbf-4006-ab0d-0c2f97d75898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:43.283048 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-489e76fd-0dbf-4006-ab0d-0c2f97d75898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:43.284215 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 863/1723] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:55:42 2022] DELETE /identity/v3/projects/1e69ffabedd64ef79b45660a0d81a8c7 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:43.286209 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ee397-068e-40e7-8b88-ee9c1a022de0 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:43.286801 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ee397-068e-40e7-8b88-ee9c1a022de0 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:43.286896 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ee397-068e-40e7-8b88-ee9c1a022de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:43.338751 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d03ee397-068e-40e7-8b88-ee9c1a022de0 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:43.342537 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d03ee397-068e-40e7-8b88-ee9c1a022de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:43.560514 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db1dec-50ad-4ee3-b55c-e29624cddb59 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:43.561041 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db1dec-50ad-4ee3-b55c-e29624cddb59 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:43.561478 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db1dec-50ad-4ee3-b55c-e29624cddb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:43.563241 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 861/1724] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:55:43.605166 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-23db1dec-50ad-4ee3-b55c-e29624cddb59 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:43.606648 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-23db1dec-50ad-4ee3-b55c-e29624cddb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:43.655049 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 864/1725] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:43.659483 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ee397-068e-40e7-8b88-ee9c1a022de0 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:43.676442 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ee397-068e-40e7-8b88-ee9c1a022de0 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:43.699127 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8362380-364d-465e-99f1-e6893116f21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:43.699889 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8362380-364d-465e-99f1-e6893116f21b admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:43.700242 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8362380-364d-465e-99f1-e6893116f21b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:43.701570 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8362380-364d-465e-99f1-e6893116f21b admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:43.702277 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8362380-364d-465e-99f1-e6893116f21b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:55:43.704534 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8362380-364d-465e-99f1-e6893116f21b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:43.706272 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8362380-364d-465e-99f1-e6893116f21b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:43.755740 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 862/1726] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:55:43.760222 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db1dec-50ad-4ee3-b55c-e29624cddb59 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:43.770623 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db1dec-50ad-4ee3-b55c-e29624cddb59 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:43.776505 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a95a9-e27f-4820-9e8d-6d9f9bdfa0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:43.777454 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a95a9-e27f-4820-9e8d-6d9f9bdfa0af admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:43.777988 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a95a9-e27f-4820-9e8d-6d9f9bdfa0af admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:43.778459 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a95a9-e27f-4820-9e8d-6d9f9bdfa0af admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:43.779374 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a95a9-e27f-4820-9e8d-6d9f9bdfa0af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:43.782637 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a95a9-e27f-4820-9e8d-6d9f9bdfa0af admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:43.860701 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8362380-364d-465e-99f1-e6893116f21b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:43.866741 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 865/1727] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:43 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:43.873022 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8362380-364d-465e-99f1-e6893116f21b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:44.058580 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247489a9-e2dc-408a-b5b7-4df607f2a4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:44.059359 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247489a9-e2dc-408a-b5b7-4df607f2a4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:44.059734 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247489a9-e2dc-408a-b5b7-4df607f2a4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:44.059952 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247489a9-e2dc-408a-b5b7-4df607f2a4c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:44.060716 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247489a9-e2dc-408a-b5b7-4df607f2a4c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:44.062768 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247489a9-e2dc-408a-b5b7-4df607f2a4c3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:44.126197 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 863/1728] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:43 2022] POST /identity/v3/users => generated 289 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:44.127591 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a95a9-e27f-4820-9e8d-6d9f9bdfa0af admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:44.144778 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a95a9-e27f-4820-9e8d-6d9f9bdfa0af admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:44.150923 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666e9fc-2d06-4a84-83c5-081dca544dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:44.151617 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666e9fc-2d06-4a84-83c5-081dca544dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:44.151999 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666e9fc-2d06-4a84-83c5-081dca544dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:44.152442 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666e9fc-2d06-4a84-83c5-081dca544dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:44.154041 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666e9fc-2d06-4a84-83c5-081dca544dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:44.159458 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666e9fc-2d06-4a84-83c5-081dca544dd9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:44.180550 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 866/1729] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:44.181144 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247489a9-e2dc-408a-b5b7-4df607f2a4c3 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:44.197649 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247489a9-e2dc-408a-b5b7-4df607f2a4c3 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:44.208114 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc55f6d-432a-41b5-bf03-2c3524ae20b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:44.210536 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc55f6d-432a-41b5-bf03-2c3524ae20b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:44.212264 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc55f6d-432a-41b5-bf03-2c3524ae20b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:44.213567 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc55f6d-432a-41b5-bf03-2c3524ae20b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:44.214494 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc55f6d-432a-41b5-bf03-2c3524ae20b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:44.220797 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc55f6d-432a-41b5-bf03-2c3524ae20b3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:44.250406 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 864/1730] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:55:44.254451 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666e9fc-2d06-4a84-83c5-081dca544dd9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:44.268738 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666e9fc-2d06-4a84-83c5-081dca544dd9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:44.274676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e577c38-bb86-4cee-837e-c8a3af168101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:44.276889 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e577c38-bb86-4cee-837e-c8a3af168101 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:44.277378 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e577c38-bb86-4cee-837e-c8a3af168101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:44.277924 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e577c38-bb86-4cee-837e-c8a3af168101 admin admin] PATH_INFO: `/v3/projects/2dda66f2ef0f4016bdbb44593919f6ad/users/4e579687437c4126b8e8ea654b8770f7/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:44.305539 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e577c38-bb86-4cee-837e-c8a3af168101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dda66f2ef0f4016bdbb44593919f6ad, user_id=4e579687437c4126b8e8ea654b8770f7, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:44.309377 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e577c38-bb86-4cee-837e-c8a3af168101 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:44.336208 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 867/1731] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:44 2022] PUT /identity/v3/projects/2dda66f2ef0f4016bdbb44593919f6ad/users/4e579687437c4126b8e8ea654b8770f7/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:44.347163 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49e2f7-6d11-4f54-b540-2b42046f15b7 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:44.348550 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49e2f7-6d11-4f54-b540-2b42046f15b7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:44.349757 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49e2f7-6d11-4f54-b540-2b42046f15b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:44.386216 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-8d49e2f7-6d11-4f54-b540-2b42046f15b7 None None] MFA Rules not processed for user `4e579687437c4126b8e8ea654b8770f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:44.387551 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8d49e2f7-6d11-4f54-b540-2b42046f15b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:44.477133 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 865/1732] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:44.481223 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e577c38-bb86-4cee-837e-c8a3af168101 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:44.565333 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e577c38-bb86-4cee-837e-c8a3af168101 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:44.571129 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e63ba-c78b-418f-b4a4-16446207078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:44.572384 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e63ba-c78b-418f-b4a4-16446207078b admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:44.572458 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e63ba-c78b-418f-b4a4-16446207078b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:44.572896 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e63ba-c78b-418f-b4a4-16446207078b admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:44.573995 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e63ba-c78b-418f-b4a4-16446207078b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:44.576849 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e63ba-c78b-418f-b4a4-16446207078b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:44.613675 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49e2f7-6d11-4f54-b540-2b42046f15b7 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:44.615992 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 868/1733] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:44 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:44.626863 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49e2f7-6d11-4f54-b540-2b42046f15b7 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:44.707008 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cec2b-ba75-444d-bb4f-4ea974f89c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:44.708780 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cec2b-ba75-444d-bb4f-4ea974f89c52 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:44.709089 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cec2b-ba75-444d-bb4f-4ea974f89c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:44.709525 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cec2b-ba75-444d-bb4f-4ea974f89c52 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:44.710575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cec2b-ba75-444d-bb4f-4ea974f89c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:44.715091 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cec2b-ba75-444d-bb4f-4ea974f89c52 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:44.744783 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 866/1734] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:44 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:44.748913 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e63ba-c78b-418f-b4a4-16446207078b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:44.760781 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e63ba-c78b-418f-b4a4-16446207078b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:44.766993 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9c871-ff34-445a-9bb3-b7a63f9047c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:44.767843 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9c871-ff34-445a-9bb3-b7a63f9047c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:44.768195 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9c871-ff34-445a-9bb3-b7a63f9047c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:44.768686 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9c871-ff34-445a-9bb3-b7a63f9047c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:44.769495 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9c871-ff34-445a-9bb3-b7a63f9047c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:44.771648 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9c871-ff34-445a-9bb3-b7a63f9047c4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:44.783293 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 869/1735] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:55:44.787290 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cec2b-ba75-444d-bb4f-4ea974f89c52 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:44.798068 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cec2b-ba75-444d-bb4f-4ea974f89c52 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:44.805239 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d8ac4-533e-45e6-83d9-4bf64568487c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:44.805997 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d8ac4-533e-45e6-83d9-4bf64568487c admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:44.806359 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d8ac4-533e-45e6-83d9-4bf64568487c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:44.806702 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d8ac4-533e-45e6-83d9-4bf64568487c admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:44.807505 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d8ac4-533e-45e6-83d9-4bf64568487c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:44.809266 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d8ac4-533e-45e6-83d9-4bf64568487c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:44.825992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 867/1736] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:44.835026 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9c871-ff34-445a-9bb3-b7a63f9047c4 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:44.846375 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9c871-ff34-445a-9bb3-b7a63f9047c4 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:44.852453 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2e015-2c41-4acc-94ef-9e6656e9f31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:44.853801 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2e015-2c41-4acc-94ef-9e6656e9f31f admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:44.854157 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2e015-2c41-4acc-94ef-9e6656e9f31f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:44.854656 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2e015-2c41-4acc-94ef-9e6656e9f31f admin admin] PATH_INFO: `/v3/projects/baae874d23bd46799d7bf80cb62a11fa/users/3c0d39ee71b041779226bf17376d4b60/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:44.888869 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2e015-2c41-4acc-94ef-9e6656e9f31f admin admin] RBAC: Authorizing `identity:create_grant(project_id=baae874d23bd46799d7bf80cb62a11fa, user_id=3c0d39ee71b041779226bf17376d4b60, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:44.900975 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2e015-2c41-4acc-94ef-9e6656e9f31f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:44.927802 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 870/1737] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:44 2022] PUT /identity/v3/projects/baae874d23bd46799d7bf80cb62a11fa/users/3c0d39ee71b041779226bf17376d4b60/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:44.938491 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e981ce-1b4e-4182-b0fc-8a99ff86666a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:44.938808 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e981ce-1b4e-4182-b0fc-8a99ff86666a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:44.939090 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e981ce-1b4e-4182-b0fc-8a99ff86666a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:44.982777 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-01e981ce-1b4e-4182-b0fc-8a99ff86666a None None] MFA Rules not processed for user `3c0d39ee71b041779226bf17376d4b60`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:44.982777 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-01e981ce-1b4e-4182-b0fc-8a99ff86666a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:45.094542 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 868/1738] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:45.095940 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2e015-2c41-4acc-94ef-9e6656e9f31f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:45.160872 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2e015-2c41-4acc-94ef-9e6656e9f31f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:45.167406 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c6251-adc0-4dff-8bfe-a06323fdc043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:45.168192 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c6251-adc0-4dff-8bfe-a06323fdc043 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:45.168552 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c6251-adc0-4dff-8bfe-a06323fdc043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:45.168957 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c6251-adc0-4dff-8bfe-a06323fdc043 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:45.169694 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c6251-adc0-4dff-8bfe-a06323fdc043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:45.171733 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c6251-adc0-4dff-8bfe-a06323fdc043 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:45.201742 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 871/1739] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:45 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:45.205774 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e981ce-1b4e-4182-b0fc-8a99ff86666a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:45.221837 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e981ce-1b4e-4182-b0fc-8a99ff86666a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:45.240908 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82c1c1-0db3-47f3-8f95-25248eb792c0 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:45.241196 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82c1c1-0db3-47f3-8f95-25248eb792c0 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:45.241475 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82c1c1-0db3-47f3-8f95-25248eb792c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:45.262140 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-af82c1c1-0db3-47f3-8f95-25248eb792c0 None None] MFA Rules not processed for user `539174103f414528829d033481b83b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:45.263519 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-af82c1c1-0db3-47f3-8f95-25248eb792c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:45.292460 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638becb8-50bd-4378-980b-26344595e41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:45.293078 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638becb8-50bd-4378-980b-26344595e41f admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:45.293362 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638becb8-50bd-4378-980b-26344595e41f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:45.293640 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638becb8-50bd-4378-980b-26344595e41f admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:45.294334 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638becb8-50bd-4378-980b-26344595e41f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:45.296320 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638becb8-50bd-4378-980b-26344595e41f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:45.318877 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 869/1740] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:45 2022] POST /identity/v3/users => generated 296 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:55:45.323187 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638becb8-50bd-4378-980b-26344595e41f admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:45.334550 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 872/1741] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:55:45.335266 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638becb8-50bd-4378-980b-26344595e41f admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:45.339591 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849759b3-84fa-44c8-9dec-5666176c4cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:45.340289 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849759b3-84fa-44c8-9dec-5666176c4cde admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:45.340573 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849759b3-84fa-44c8-9dec-5666176c4cde admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:45.340878 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849759b3-84fa-44c8-9dec-5666176c4cde admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:45.341604 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849759b3-84fa-44c8-9dec-5666176c4cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:45.343180 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849759b3-84fa-44c8-9dec-5666176c4cde admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:45.353841 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 870/1742] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:45.358850 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82c1c1-0db3-47f3-8f95-25248eb792c0 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:45.373821 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82c1c1-0db3-47f3-8f95-25248eb792c0 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:45.378841 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb820a2-9364-4433-99b8-58948edfd68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:45.379939 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb820a2-9364-4433-99b8-58948edfd68d admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:45.380837 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb820a2-9364-4433-99b8-58948edfd68d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:45.381142 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb820a2-9364-4433-99b8-58948edfd68d admin admin] PATH_INFO: `/v3/projects/dcec9f9d91fe49209f27d4150e6732b5/users/d0f52b5bb4f24e87afdd44c0ec30f904/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:45.425620 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb820a2-9364-4433-99b8-58948edfd68d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcec9f9d91fe49209f27d4150e6732b5, user_id=d0f52b5bb4f24e87afdd44c0ec30f904, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:45.437477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb820a2-9364-4433-99b8-58948edfd68d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:45.471826 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 873/1743] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:45 2022] PUT /identity/v3/projects/dcec9f9d91fe49209f27d4150e6732b5/users/d0f52b5bb4f24e87afdd44c0ec30f904/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:45.473117 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849759b3-84fa-44c8-9dec-5666176c4cde admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:45.531677 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849759b3-84fa-44c8-9dec-5666176c4cde admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:45.705042 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e2113-adee-4bd7-9c5a-d07fa7c4c4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:45.705885 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e2113-adee-4bd7-9c5a-d07fa7c4c4ad admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:45.708880 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e2113-adee-4bd7-9c5a-d07fa7c4c4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:45.709390 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e2113-adee-4bd7-9c5a-d07fa7c4c4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:45.710196 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e2113-adee-4bd7-9c5a-d07fa7c4c4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:45.712017 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e2113-adee-4bd7-9c5a-d07fa7c4c4ad admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:45.754352 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 871/1744] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:45.756917 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb820a2-9364-4433-99b8-58948edfd68d admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:45.783373 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb820a2-9364-4433-99b8-58948edfd68d admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:45.793826 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae7e78-2b92-4c1b-a239-e0b04d2a9b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:45.794789 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae7e78-2b92-4c1b-a239-e0b04d2a9b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:45.795054 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae7e78-2b92-4c1b-a239-e0b04d2a9b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:45.795339 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae7e78-2b92-4c1b-a239-e0b04d2a9b4b admin admin] PATH_INFO: `/v3/projects/dcec9f9d91fe49209f27d4150e6732b5/users/d0f52b5bb4f24e87afdd44c0ec30f904/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:45.797915 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae7e78-2b92-4c1b-a239-e0b04d2a9b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcec9f9d91fe49209f27d4150e6732b5, user_id=d0f52b5bb4f24e87afdd44c0ec30f904, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:45.806578 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae7e78-2b92-4c1b-a239-e0b04d2a9b4b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:45.829807 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 874/1745] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:45 2022] PUT /identity/v3/projects/dcec9f9d91fe49209f27d4150e6732b5/users/d0f52b5bb4f24e87afdd44c0ec30f904/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:45.833572 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff364e-8198-4cb6-9241-f66dc7afcd58 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:45.835553 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff364e-8198-4cb6-9241-f66dc7afcd58 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:45.836312 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff364e-8198-4cb6-9241-f66dc7afcd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:45.903161 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-30ff364e-8198-4cb6-9241-f66dc7afcd58 None None] MFA Rules not processed for user `d0f52b5bb4f24e87afdd44c0ec30f904`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:45.904693 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-30ff364e-8198-4cb6-9241-f66dc7afcd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:46.094936 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 872/1746] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:46.134016 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae7e78-2b92-4c1b-a239-e0b04d2a9b4b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:46.135856 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5eae7e78-2b92-4c1b-a239-e0b04d2a9b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:46.262540 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae7e78-2b92-4c1b-a239-e0b04d2a9b4b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:46.272475 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ad22b-f1fb-4055-b807-f5e113fa1582 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:46.273151 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ad22b-f1fb-4055-b807-f5e113fa1582 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:46.273437 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ad22b-f1fb-4055-b807-f5e113fa1582 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:46.273718 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ad22b-f1fb-4055-b807-f5e113fa1582 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:46.303731 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ad22b-f1fb-4055-b807-f5e113fa1582 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:46.306436 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ad22b-f1fb-4055-b807-f5e113fa1582 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:46.340719 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 875/1747] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:46.594029 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff364e-8198-4cb6-9241-f66dc7afcd58 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:46.594029 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-30ff364e-8198-4cb6-9241-f66dc7afcd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:46.609820 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff364e-8198-4cb6-9241-f66dc7afcd58 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:46.622478 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb2c43-77aa-47ee-892c-d83a8c146a74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:46.625178 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb2c43-77aa-47ee-892c-d83a8c146a74 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:46.625598 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb2c43-77aa-47ee-892c-d83a8c146a74 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:46.627789 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb2c43-77aa-47ee-892c-d83a8c146a74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:46.865050 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb2c43-77aa-47ee-892c-d83a8c146a74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:46.869912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb2c43-77aa-47ee-892c-d83a8c146a74 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:46.899676 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 873/1748] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:46.976360 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ad22b-f1fb-4055-b807-f5e113fa1582 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:46.978338 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-469ad22b-f1fb-4055-b807-f5e113fa1582 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:47.243591 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ad22b-f1fb-4055-b807-f5e113fa1582 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:47.257508 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cb4ab-972e-43f4-86de-2c4e3f979138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:47.260625 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cb4ab-972e-43f4-86de-2c4e3f979138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:47.261875 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85013643-17fb-4de2-bee5-f80ac67e9aa5 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:47.262205 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85013643-17fb-4de2-bee5-f80ac67e9aa5 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:47.262533 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85013643-17fb-4de2-bee5-f80ac67e9aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:47.264243 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cb4ab-972e-43f4-86de-2c4e3f979138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:47.264677 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cb4ab-972e-43f4-86de-2c4e3f979138 admin admin] PATH_INFO: `/v3/users/6c218c05cbe44c7eacee509490d7875c` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:47.274168 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cb4ab-972e-43f4-86de-2c4e3f979138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c218c05cbe44c7eacee509490d7875c)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:47.280857 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cb4ab-972e-43f4-86de-2c4e3f979138 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:47.318863 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-85013643-17fb-4de2-bee5-f80ac67e9aa5 None None] MFA Rules not processed for user `c084d218ea414d638ef2dc45364a492c`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:47.326996 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-85013643-17fb-4de2-bee5-f80ac67e9aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:47.402264 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ca4cb4ab-972e-43f4-86de-2c4e3f979138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c218c05cbe44c7eacee509490d7875c'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:47.423581 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ca4cb4ab-972e-43f4-86de-2c4e3f979138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c218c05cbe44c7eacee509490d7875c'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:47.446195 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ca4cb4ab-972e-43f4-86de-2c4e3f979138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c218c05cbe44c7eacee509490d7875c'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:47.447592 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ca4cb4ab-972e-43f4-86de-2c4e3f979138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c218c05cbe44c7eacee509490d7875c'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:47.448675 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ca4cb4ab-972e-43f4-86de-2c4e3f979138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c218c05cbe44c7eacee509490d7875c'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:47.498198 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 876/1749] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:55:46 2022] DELETE /identity/v3/users/6c218c05cbe44c7eacee509490d7875c => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:47.502686 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c029c3-f864-4616-856b-1e0b390a5eeb None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:47.503332 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c029c3-f864-4616-856b-1e0b390a5eeb None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:47.503933 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c029c3-f864-4616-856b-1e0b390a5eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:47.587762 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-42c029c3-f864-4616-856b-1e0b390a5eeb None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:47.590099 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-42c029c3-f864-4616-856b-1e0b390a5eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:47.620275 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 874/1750] 10.222.0.75 () {58 vars in 1015 bytes} [Mon Apr 11 13:55:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:55:47.701556 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85013643-17fb-4de2-bee5-f80ac67e9aa5 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:47.702984 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-85013643-17fb-4de2-bee5-f80ac67e9aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:47.734499 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85013643-17fb-4de2-bee5-f80ac67e9aa5 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:47.769509 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 877/1751] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:47.780051 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c029c3-f864-4616-856b-1e0b390a5eeb None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:47.781875 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-42c029c3-f864-4616-856b-1e0b390a5eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:47.883916 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c029c3-f864-4616-856b-1e0b390a5eeb None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:47.898072 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac3de3-699f-49fe-aa7e-fc1579194a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:47.899189 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac3de3-699f-49fe-aa7e-fc1579194a66 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:47.901077 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac3de3-699f-49fe-aa7e-fc1579194a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:47.901459 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac3de3-699f-49fe-aa7e-fc1579194a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:47.925004 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac3de3-699f-49fe-aa7e-fc1579194a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:47.926027 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76d03b-b456-4264-88f1-aad29b749341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:47.929610 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac3de3-699f-49fe-aa7e-fc1579194a66 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:47.929746 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76d03b-b456-4264-88f1-aad29b749341 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:47.929847 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76d03b-b456-4264-88f1-aad29b749341 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:47.930099 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76d03b-b456-4264-88f1-aad29b749341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:47.954824 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 878/1752] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:55:47.958644 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac3de3-699f-49fe-aa7e-fc1579194a66 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:47.972672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-02ac3de3-699f-49fe-aa7e-fc1579194a66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:47.976627 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76d03b-b456-4264-88f1-aad29b749341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:47.980771 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76d03b-b456-4264-88f1-aad29b749341 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:48.028081 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 875/1753] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:48.037801 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac3de3-699f-49fe-aa7e-fc1579194a66 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:48.047331 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1ccff-9520-42fe-9377-03e23cba822a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:48.048678 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1ccff-9520-42fe-9377-03e23cba822a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:48.049352 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1ccff-9520-42fe-9377-03e23cba822a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:48.049988 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1ccff-9520-42fe-9377-03e23cba822a admin admin] PATH_INFO: `/v3/users/6d6152812eee46e09bda7c57d4d08cc7` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:48.051411 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1ccff-9520-42fe-9377-03e23cba822a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d6152812eee46e09bda7c57d4d08cc7)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:48.054299 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1ccff-9520-42fe-9377-03e23cba822a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:48.157340 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f0d1ccff-9520-42fe-9377-03e23cba822a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d6152812eee46e09bda7c57d4d08cc7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:48.181082 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f0d1ccff-9520-42fe-9377-03e23cba822a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d6152812eee46e09bda7c57d4d08cc7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:48.205589 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f0d1ccff-9520-42fe-9377-03e23cba822a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d6152812eee46e09bda7c57d4d08cc7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:48.206461 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f0d1ccff-9520-42fe-9377-03e23cba822a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d6152812eee46e09bda7c57d4d08cc7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:48.207278 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f0d1ccff-9520-42fe-9377-03e23cba822a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d6152812eee46e09bda7c57d4d08cc7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:48.264741 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 879/1754] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:55:47 2022] DELETE /identity/v3/users/6d6152812eee46e09bda7c57d4d08cc7 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:48.269769 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba2650-7e07-4059-ba36-b6beebefe46b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:48.270098 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba2650-7e07-4059-ba36-b6beebefe46b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:48.270409 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba2650-7e07-4059-ba36-b6beebefe46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:48.314874 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1ccff-9520-42fe-9377-03e23cba822a admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:48.316736 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f0d1ccff-9520-42fe-9377-03e23cba822a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:48.341685 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a6ba2650-7e07-4059-ba36-b6beebefe46b None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:48.349708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a6ba2650-7e07-4059-ba36-b6beebefe46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:48.556807 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1ccff-9520-42fe-9377-03e23cba822a admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:48.570514 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94889c-20f9-4c26-8aac-5c1ba6194dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:48.572127 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94889c-20f9-4c26-8aac-5c1ba6194dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:48.572127 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94889c-20f9-4c26-8aac-5c1ba6194dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:48.572620 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94889c-20f9-4c26-8aac-5c1ba6194dd4 admin admin] PATH_INFO: `/v3/users/e93f5090792048fab7769a8025252213` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:48.574282 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94889c-20f9-4c26-8aac-5c1ba6194dd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e93f5090792048fab7769a8025252213)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:48.576394 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94889c-20f9-4c26-8aac-5c1ba6194dd4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:48.581643 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 876/1755] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:48.600522 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba2650-7e07-4059-ba36-b6beebefe46b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:48.604014 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a6ba2650-7e07-4059-ba36-b6beebefe46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:48.679892 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba2650-7e07-4059-ba36-b6beebefe46b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:48.692258 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399afaf-2c55-4a28-9fca-d5f3820f2902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:48.693912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399afaf-2c55-4a28-9fca-d5f3820f2902 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:48.694292 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399afaf-2c55-4a28-9fca-d5f3820f2902 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:48.695738 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399afaf-2c55-4a28-9fca-d5f3820f2902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:48.725262 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-9e94889c-20f9-4c26-8aac-5c1ba6194dd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e93f5090792048fab7769a8025252213'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:48.741949 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-9e94889c-20f9-4c26-8aac-5c1ba6194dd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e93f5090792048fab7769a8025252213'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:48.754064 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-9e94889c-20f9-4c26-8aac-5c1ba6194dd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e93f5090792048fab7769a8025252213'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:48.754817 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-9e94889c-20f9-4c26-8aac-5c1ba6194dd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e93f5090792048fab7769a8025252213'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:48.756314 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-9e94889c-20f9-4c26-8aac-5c1ba6194dd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e93f5090792048fab7769a8025252213'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:48.765674 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399afaf-2c55-4a28-9fca-d5f3820f2902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:48.767854 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399afaf-2c55-4a28-9fca-d5f3820f2902 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:48.798452 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 880/1756] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:55:48 2022] DELETE /identity/v3/users/e93f5090792048fab7769a8025252213 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:48.802778 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 877/1757] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:48.845917 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10450e-e9cd-452c-9eb3-8af31f77edba None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:48.845917 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10450e-e9cd-452c-9eb3-8af31f77edba None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:48.845917 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10450e-e9cd-452c-9eb3-8af31f77edba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:48.880640 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-db10450e-e9cd-452c-9eb3-8af31f77edba None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:48.882057 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-db10450e-e9cd-452c-9eb3-8af31f77edba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:49.062095 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 881/1758] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:49.074485 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399afaf-2c55-4a28-9fca-d5f3820f2902 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:49.086063 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399afaf-2c55-4a28-9fca-d5f3820f2902 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:49.212578 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e544605-e22c-4013-b3c3-befa810decb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:49.213560 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e544605-e22c-4013-b3c3-befa810decb9 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:49.214025 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e544605-e22c-4013-b3c3-befa810decb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:49.215034 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e544605-e22c-4013-b3c3-befa810decb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:49.245257 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e544605-e22c-4013-b3c3-befa810decb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:49.246732 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e544605-e22c-4013-b3c3-befa810decb9 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:49.279066 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 878/1759] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:49.559289 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10450e-e9cd-452c-9eb3-8af31f77edba None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:49.566483 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-db10450e-e9cd-452c-9eb3-8af31f77edba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:49.582920 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10450e-e9cd-452c-9eb3-8af31f77edba None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:49.596553 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338f601-e149-408b-b220-86681a2eb0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:49.597784 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338f601-e149-408b-b220-86681a2eb0fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:49.598254 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338f601-e149-408b-b220-86681a2eb0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:49.598764 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338f601-e149-408b-b220-86681a2eb0fb admin admin] PATH_INFO: `/v3/projects/f07afe226a894200a0fc9eec473b0614` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:49.600560 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338f601-e149-408b-b220-86681a2eb0fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f07afe226a894200a0fc9eec473b0614)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:49.610100 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338f601-e149-408b-b220-86681a2eb0fb admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:49.764067 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-9338f601-e149-408b-b220-86681a2eb0fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f07afe226a894200a0fc9eec473b0614', 'request_id': 'req-9338f601-e149-408b-b220-86681a2eb0fb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:49.779985 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-9338f601-e149-408b-b220-86681a2eb0fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f07afe226a894200a0fc9eec473b0614', 'request_id': 'req-9338f601-e149-408b-b220-86681a2eb0fb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:49.792309 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-9338f601-e149-408b-b220-86681a2eb0fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f07afe226a894200a0fc9eec473b0614', 'request_id': 'req-9338f601-e149-408b-b220-86681a2eb0fb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:49.823361 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-9338f601-e149-408b-b220-86681a2eb0fb admin admin] The token cache is being invalidate because project f07afe226a894200a0fc9eec473b0614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:55:49.823361 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-9338f601-e149-408b-b220-86681a2eb0fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:49.827002 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-9338f601-e149-408b-b220-86681a2eb0fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:49.831040 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 882/1760] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:55:49 2022] DELETE /identity/v3/projects/f07afe226a894200a0fc9eec473b0614 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:49.834137 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e544605-e22c-4013-b3c3-befa810decb9 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:49.845086 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e544605-e22c-4013-b3c3-befa810decb9 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:49.999233 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f98f3-2ced-40c5-93b2-d648679d66d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:50.000320 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f98f3-2ced-40c5-93b2-d648679d66d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:50.001327 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f98f3-2ced-40c5-93b2-d648679d66d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:50.001720 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f98f3-2ced-40c5-93b2-d648679d66d6 admin admin] PATH_INFO: `/v3/users/6005fa248a99487680981626d1a05b84` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:50.014719 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f98f3-2ced-40c5-93b2-d648679d66d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6005fa248a99487680981626d1a05b84)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:50.019355 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f98f3-2ced-40c5-93b2-d648679d66d6 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:50.160738 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-7a0f98f3-2ced-40c5-93b2-d648679d66d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6005fa248a99487680981626d1a05b84'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:50.161819 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-7a0f98f3-2ced-40c5-93b2-d648679d66d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6005fa248a99487680981626d1a05b84'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:50.180561 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-7a0f98f3-2ced-40c5-93b2-d648679d66d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6005fa248a99487680981626d1a05b84'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:50.206126 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-7a0f98f3-2ced-40c5-93b2-d648679d66d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6005fa248a99487680981626d1a05b84'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:50.207613 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-7a0f98f3-2ced-40c5-93b2-d648679d66d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6005fa248a99487680981626d1a05b84'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:50.268026 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 879/1761] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:55:49 2022] DELETE /identity/v3/users/6005fa248a99487680981626d1a05b84 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:50.443177 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338f601-e149-408b-b220-86681a2eb0fb admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:50.444760 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9338f601-e149-408b-b220-86681a2eb0fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:50.477138 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338f601-e149-408b-b220-86681a2eb0fb admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:50.740381 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f98f3-2ced-40c5-93b2-d648679d66d6 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:50.742011 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7a0f98f3-2ced-40c5-93b2-d648679d66d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:50.782159 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c73bc-a953-4db8-826e-fa5085ff6175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:50.785733 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c73bc-a953-4db8-826e-fa5085ff6175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:50.787766 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c73bc-a953-4db8-826e-fa5085ff6175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:50.788343 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c73bc-a953-4db8-826e-fa5085ff6175 admin admin] PATH_INFO: `/v3/projects/f995f7a5d74e45a59f46cb7a336038fc` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:50.792831 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c73bc-a953-4db8-826e-fa5085ff6175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f995f7a5d74e45a59f46cb7a336038fc)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:50.802506 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c73bc-a953-4db8-826e-fa5085ff6175 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:50.917601 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ad8c73bc-a953-4db8-826e-fa5085ff6175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f995f7a5d74e45a59f46cb7a336038fc', 'request_id': 'req-ad8c73bc-a953-4db8-826e-fa5085ff6175'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:50.932892 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ad8c73bc-a953-4db8-826e-fa5085ff6175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f995f7a5d74e45a59f46cb7a336038fc', 'request_id': 'req-ad8c73bc-a953-4db8-826e-fa5085ff6175'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:50.933200 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f98f3-2ced-40c5-93b2-d648679d66d6 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:50.954412 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ad8c73bc-a953-4db8-826e-fa5085ff6175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f995f7a5d74e45a59f46cb7a336038fc', 'request_id': 'req-ad8c73bc-a953-4db8-826e-fa5085ff6175'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:50.986023 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ad8c73bc-a953-4db8-826e-fa5085ff6175 admin admin] The token cache is being invalidate because project f995f7a5d74e45a59f46cb7a336038fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:55:50.986230 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ad8c73bc-a953-4db8-826e-fa5085ff6175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:50.987994 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ad8c73bc-a953-4db8-826e-fa5085ff6175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:50.990894 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 883/1762] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:55:50 2022] DELETE /identity/v3/projects/f995f7a5d74e45a59f46cb7a336038fc => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:50.995422 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c73bc-a953-4db8-826e-fa5085ff6175 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:51.010670 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ad8c73bc-a953-4db8-826e-fa5085ff6175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:51.121055 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1f0e8-6a0d-41e4-8c6d-7441a4bde1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:51.122187 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1f0e8-6a0d-41e4-8c6d-7441a4bde1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:51.124050 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1f0e8-6a0d-41e4-8c6d-7441a4bde1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:51.124496 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1f0e8-6a0d-41e4-8c6d-7441a4bde1e6 admin admin] PATH_INFO: `/v3/projects/d8585c76733f46379846920c36347915` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:51.126748 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1f0e8-6a0d-41e4-8c6d-7441a4bde1e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8585c76733f46379846920c36347915)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:51.134224 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1f0e8-6a0d-41e4-8c6d-7441a4bde1e6 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:51.229252 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6dc1f0e8-6a0d-41e4-8c6d-7441a4bde1e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8585c76733f46379846920c36347915', 'request_id': 'req-6dc1f0e8-6a0d-41e4-8c6d-7441a4bde1e6'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:51.232561 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c73bc-a953-4db8-826e-fa5085ff6175 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:51.237437 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6dc1f0e8-6a0d-41e4-8c6d-7441a4bde1e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8585c76733f46379846920c36347915', 'request_id': 'req-6dc1f0e8-6a0d-41e4-8c6d-7441a4bde1e6'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:51.257300 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6dc1f0e8-6a0d-41e4-8c6d-7441a4bde1e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8585c76733f46379846920c36347915', 'request_id': 'req-6dc1f0e8-6a0d-41e4-8c6d-7441a4bde1e6'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:51.282413 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6dc1f0e8-6a0d-41e4-8c6d-7441a4bde1e6 admin admin] The token cache is being invalidate because project d8585c76733f46379846920c36347915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:55:51.283467 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6dc1f0e8-6a0d-41e4-8c6d-7441a4bde1e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:51.286925 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6dc1f0e8-6a0d-41e4-8c6d-7441a4bde1e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:51.323875 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 880/1763] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:55:50 2022] DELETE /identity/v3/projects/d8585c76733f46379846920c36347915 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:55:51.332124 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c6038-2c26-4450-835e-a39016731874 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:51.332653 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c6038-2c26-4450-835e-a39016731874 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:51.333470 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c6038-2c26-4450-835e-a39016731874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:51.367113 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928626d-4a17-4b0a-b1b3-4e227dd9bf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:51.369643 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928626d-4a17-4b0a-b1b3-4e227dd9bf43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:51.371406 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928626d-4a17-4b0a-b1b3-4e227dd9bf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:51.372195 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928626d-4a17-4b0a-b1b3-4e227dd9bf43 admin admin] PATH_INFO: `/v3/users/b4614ef1432e419eb08955e5c77f3fe9` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:51.376600 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928626d-4a17-4b0a-b1b3-4e227dd9bf43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4614ef1432e419eb08955e5c77f3fe9)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:51.384235 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c15c6038-2c26-4450-835e-a39016731874 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:51.386011 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c15c6038-2c26-4450-835e-a39016731874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:51.387815 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928626d-4a17-4b0a-b1b3-4e227dd9bf43 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:51.441956 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 881/1764] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:51.446012 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193629f-5055-4fdd-8082-5ee690fb32df None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:51.450074 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193629f-5055-4fdd-8082-5ee690fb32df None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:51.459873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193629f-5055-4fdd-8082-5ee690fb32df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:51.531138 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a193629f-5055-4fdd-8082-5ee690fb32df None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:51.536533 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a193629f-5055-4fdd-8082-5ee690fb32df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:51.541769 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3928626d-4a17-4b0a-b1b3-4e227dd9bf43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4614ef1432e419eb08955e5c77f3fe9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:51.584762 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3928626d-4a17-4b0a-b1b3-4e227dd9bf43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4614ef1432e419eb08955e5c77f3fe9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:51.586697 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 882/1765] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:51.587873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193629f-5055-4fdd-8082-5ee690fb32df None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:51.592163 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a193629f-5055-4fdd-8082-5ee690fb32df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:51.610974 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3928626d-4a17-4b0a-b1b3-4e227dd9bf43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4614ef1432e419eb08955e5c77f3fe9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:51.611809 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3928626d-4a17-4b0a-b1b3-4e227dd9bf43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4614ef1432e419eb08955e5c77f3fe9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:51.612803 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3928626d-4a17-4b0a-b1b3-4e227dd9bf43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4614ef1432e419eb08955e5c77f3fe9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:51.625694 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193629f-5055-4fdd-8082-5ee690fb32df None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:51.633742 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9a699-acc1-46f8-a26c-cc07e35de45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:51.634652 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9a699-acc1-46f8-a26c-cc07e35de45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:51.635208 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9a699-acc1-46f8-a26c-cc07e35de45e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:51.635208 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9a699-acc1-46f8-a26c-cc07e35de45e admin admin] PATH_INFO: `/v3/users/4e579687437c4126b8e8ea654b8770f7` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:51.636460 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9a699-acc1-46f8-a26c-cc07e35de45e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e579687437c4126b8e8ea654b8770f7)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:51.638388 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9a699-acc1-46f8-a26c-cc07e35de45e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:51.649662 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 884/1766] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:55:50 2022] DELETE /identity/v3/users/b4614ef1432e419eb08955e5c77f3fe9 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:51.650772 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928626d-4a17-4b0a-b1b3-4e227dd9bf43 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:51.652907 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3928626d-4a17-4b0a-b1b3-4e227dd9bf43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:51.723255 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-7fa9a699-acc1-46f8-a26c-cc07e35de45e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e579687437c4126b8e8ea654b8770f7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:51.731289 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-7fa9a699-acc1-46f8-a26c-cc07e35de45e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e579687437c4126b8e8ea654b8770f7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:51.743693 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928626d-4a17-4b0a-b1b3-4e227dd9bf43 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:51.749132 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5d6ad-2d11-4df2-917c-2e03a1bdf50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:51.750058 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5d6ad-2d11-4df2-917c-2e03a1bdf50c admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:51.750494 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5d6ad-2d11-4df2-917c-2e03a1bdf50c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:51.750919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5d6ad-2d11-4df2-917c-2e03a1bdf50c admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:51.751937 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5d6ad-2d11-4df2-917c-2e03a1bdf50c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:55:51.752380 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-7fa9a699-acc1-46f8-a26c-cc07e35de45e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e579687437c4126b8e8ea654b8770f7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:51.752541 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5d6ad-2d11-4df2-917c-2e03a1bdf50c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:51.754348 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5d6ad-2d11-4df2-917c-2e03a1bdf50c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:51.765871 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-7fa9a699-acc1-46f8-a26c-cc07e35de45e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e579687437c4126b8e8ea654b8770f7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:51.766845 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-7fa9a699-acc1-46f8-a26c-cc07e35de45e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e579687437c4126b8e8ea654b8770f7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:51.773854 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 885/1767] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:55:51.776127 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5d6ad-2d11-4df2-917c-2e03a1bdf50c admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:51.785219 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fca5d6ad-2d11-4df2-917c-2e03a1bdf50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:51.804810 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 883/1768] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:55:51 2022] DELETE /identity/v3/users/4e579687437c4126b8e8ea654b8770f7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:51.806092 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9a699-acc1-46f8-a26c-cc07e35de45e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:51.808192 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7fa9a699-acc1-46f8-a26c-cc07e35de45e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:51.813619 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5d6ad-2d11-4df2-917c-2e03a1bdf50c admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:51.988236 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54330a-0b6d-4e70-b106-5b180cf46d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:51.991248 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54330a-0b6d-4e70-b106-5b180cf46d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:51.992484 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54330a-0b6d-4e70-b106-5b180cf46d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:51.992908 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54330a-0b6d-4e70-b106-5b180cf46d7b admin admin] PATH_INFO: `/v3/projects/e7e24a80962b42f98bde6c7689d57a4e` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:51.994796 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9a699-acc1-46f8-a26c-cc07e35de45e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:51.996943 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54330a-0b6d-4e70-b106-5b180cf46d7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e24a80962b42f98bde6c7689d57a4e)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:52.002572 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54330a-0b6d-4e70-b106-5b180cf46d7b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:52.006874 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f7919-5795-4f61-a9ab-dd9e5e95165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:52.009485 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f7919-5795-4f61-a9ab-dd9e5e95165a admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:52.009485 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f7919-5795-4f61-a9ab-dd9e5e95165a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:52.010273 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f7919-5795-4f61-a9ab-dd9e5e95165a admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:52.013188 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f7919-5795-4f61-a9ab-dd9e5e95165a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:52.017311 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f7919-5795-4f61-a9ab-dd9e5e95165a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:52.096517 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 884/1769] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:51 2022] POST /identity/v3/projects => generated 355 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:52.096517 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce022bb8-c394-47be-87e5-f09229d57ebc None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:52.096517 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce022bb8-c394-47be-87e5-f09229d57ebc None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:52.096517 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce022bb8-c394-47be-87e5-f09229d57ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:52.110222 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5a54330a-0b6d-4e70-b106-5b180cf46d7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e24a80962b42f98bde6c7689d57a4e', 'request_id': 'req-5a54330a-0b6d-4e70-b106-5b180cf46d7b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:52.149669 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-ce022bb8-c394-47be-87e5-f09229d57ebc None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:52.151135 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5a54330a-0b6d-4e70-b106-5b180cf46d7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e24a80962b42f98bde6c7689d57a4e', 'request_id': 'req-5a54330a-0b6d-4e70-b106-5b180cf46d7b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:52.163403 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ce022bb8-c394-47be-87e5-f09229d57ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:52.186809 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5a54330a-0b6d-4e70-b106-5b180cf46d7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e24a80962b42f98bde6c7689d57a4e', 'request_id': 'req-5a54330a-0b6d-4e70-b106-5b180cf46d7b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:52.219347 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5a54330a-0b6d-4e70-b106-5b180cf46d7b admin admin] The token cache is being invalidate because project e7e24a80962b42f98bde6c7689d57a4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:55:52.219865 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5a54330a-0b6d-4e70-b106-5b180cf46d7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:52.220575 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5a54330a-0b6d-4e70-b106-5b180cf46d7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:52.222867 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 886/1770] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:55:51 2022] DELETE /identity/v3/projects/e7e24a80962b42f98bde6c7689d57a4e => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:52.223796 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54330a-0b6d-4e70-b106-5b180cf46d7b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:52.225487 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5a54330a-0b6d-4e70-b106-5b180cf46d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:52.355197 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 885/1771] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:52.359660 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703db18-4293-4b9b-8bf8-7d817c8c504c None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:52.360291 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703db18-4293-4b9b-8bf8-7d817c8c504c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:52.360648 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703db18-4293-4b9b-8bf8-7d817c8c504c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:52.426354 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54330a-0b6d-4e70-b106-5b180cf46d7b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:52.440646 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af1476-e3fb-41e8-b2d3-55caed085010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:52.441520 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af1476-e3fb-41e8-b2d3-55caed085010 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:52.441968 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af1476-e3fb-41e8-b2d3-55caed085010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:52.442444 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af1476-e3fb-41e8-b2d3-55caed085010 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:52.443291 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af1476-e3fb-41e8-b2d3-55caed085010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:52.448194 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af1476-e3fb-41e8-b2d3-55caed085010 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:52.448747 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a703db18-4293-4b9b-8bf8-7d817c8c504c None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:52.449982 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a703db18-4293-4b9b-8bf8-7d817c8c504c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:52.466202 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 886/1772] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:52.467749 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b47101-0b57-4dd0-89a1-7524bc543298 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:52.468050 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b47101-0b57-4dd0-89a1-7524bc543298 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:52.468333 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b47101-0b57-4dd0-89a1-7524bc543298 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:52.472186 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 887/1773] 10.222.0.67 () {54 vars in 921 bytes} [Mon Apr 11 13:55:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:55:52.473062 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b47101-0b57-4dd0-89a1-7524bc543298 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:52.479783 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-29b47101-0b57-4dd0-89a1-7524bc543298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:52.504320 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 887/1774] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:52 2022] POST /identity/v3/users => generated 278 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:52.510785 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51245a27-54f6-46e5-bc4e-f99bd37cc844 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:52.511298 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51245a27-54f6-46e5-bc4e-f99bd37cc844 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:52.512527 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51245a27-54f6-46e5-bc4e-f99bd37cc844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:52.594443 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-51245a27-54f6-46e5-bc4e-f99bd37cc844 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:52.596402 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-51245a27-54f6-46e5-bc4e-f99bd37cc844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:52.616118 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 888/1775] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:52.623103 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51245a27-54f6-46e5-bc4e-f99bd37cc844 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:52.670025 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51245a27-54f6-46e5-bc4e-f99bd37cc844 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:52.671552 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b47101-0b57-4dd0-89a1-7524bc543298 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:52.681426 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab439a-36be-4ce9-8f72-9bd608de7659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:52.682151 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab439a-36be-4ce9-8f72-9bd608de7659 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:52.682511 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab439a-36be-4ce9-8f72-9bd608de7659 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:52.682718 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab439a-36be-4ce9-8f72-9bd608de7659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:52.689197 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783a615-4421-4655-a541-b9913c4c601e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:52.689892 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783a615-4421-4655-a541-b9913c4c601e admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:52.690178 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783a615-4421-4655-a541-b9913c4c601e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:52.690458 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783a615-4421-4655-a541-b9913c4c601e admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:52.698003 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783a615-4421-4655-a541-b9913c4c601e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:52.698003 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783a615-4421-4655-a541-b9913c4c601e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:52.704842 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab439a-36be-4ce9-8f72-9bd608de7659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:52.711902 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab439a-36be-4ce9-8f72-9bd608de7659 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:52.757886 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 889/1776] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:52.759433 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba524fd-6c4b-455f-b630-94f7a644582a None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:52.759764 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba524fd-6c4b-455f-b630-94f7a644582a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:52.760062 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba524fd-6c4b-455f-b630-94f7a644582a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:52.780040 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 888/1777] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:52.780960 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab439a-36be-4ce9-8f72-9bd608de7659 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:52.825392 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-3ba524fd-6c4b-455f-b630-94f7a644582a None None] MFA Rules not processed for user `fedd2314dc594bcba749bf7b0d1e50fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:52.825622 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab439a-36be-4ce9-8f72-9bd608de7659 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:52.826546 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3ba524fd-6c4b-455f-b630-94f7a644582a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:52.844805 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671f0a3-5759-462a-b66a-d117ef3263e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:52.848136 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671f0a3-5759-462a-b66a-d117ef3263e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:52.849276 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671f0a3-5759-462a-b66a-d117ef3263e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:52.849568 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671f0a3-5759-462a-b66a-d117ef3263e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:52.854130 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671f0a3-5759-462a-b66a-d117ef3263e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:55:52.854493 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671f0a3-5759-462a-b66a-d117ef3263e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:52.860729 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671f0a3-5759-462a-b66a-d117ef3263e5 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:52.897336 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 889/1778] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:55:52.899677 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671f0a3-5759-462a-b66a-d117ef3263e5 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:52.914951 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671f0a3-5759-462a-b66a-d117ef3263e5 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:52.922792 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07c6cb-4f43-4f78-91ae-cfe061996cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:52.927277 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07c6cb-4f43-4f78-91ae-cfe061996cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:52.928180 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07c6cb-4f43-4f78-91ae-cfe061996cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:52.928708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07c6cb-4f43-4f78-91ae-cfe061996cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:52.929773 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07c6cb-4f43-4f78-91ae-cfe061996cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:52.932104 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07c6cb-4f43-4f78-91ae-cfe061996cf4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:52.950329 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 890/1779] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:52.952349 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07c6cb-4f43-4f78-91ae-cfe061996cf4 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:52.969652 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07c6cb-4f43-4f78-91ae-cfe061996cf4 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:52.982566 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4962682-0619-4a2b-9930-ce1d1b82f9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:52.986199 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4962682-0619-4a2b-9930-ce1d1b82f9dd admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:52.996657 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 890/1780] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Apr 11 13:55:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:52.996813 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4962682-0619-4a2b-9930-ce1d1b82f9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:52.997267 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba524fd-6c4b-455f-b630-94f7a644582a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:52.997351 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4962682-0619-4a2b-9930-ce1d1b82f9dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:52.997351 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4962682-0619-4a2b-9930-ce1d1b82f9dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:52.999113 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4962682-0619-4a2b-9930-ce1d1b82f9dd admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:53.080867 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba524fd-6c4b-455f-b630-94f7a644582a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:53.116391 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b762dd1-3697-4408-9608-200da70124ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:53.117985 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b762dd1-3697-4408-9608-200da70124ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:53.124426 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 891/1781] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:52 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:53.126047 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b762dd1-3697-4408-9608-200da70124ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:53.128584 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4962682-0619-4a2b-9930-ce1d1b82f9dd admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:53.128738 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b762dd1-3697-4408-9608-200da70124ae admin admin] PATH_INFO: `/v3/projects/2760b63d11c945d1985f445230666de7/users/4b685afcb41145bba5d39234c7d968ff/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:53.176953 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b762dd1-3697-4408-9608-200da70124ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2760b63d11c945d1985f445230666de7, user_id=4b685afcb41145bba5d39234c7d968ff, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:53.180966 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b762dd1-3697-4408-9608-200da70124ae admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:53.215784 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 891/1782] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:52 2022] PUT /identity/v3/projects/2760b63d11c945d1985f445230666de7/users/4b685afcb41145bba5d39234c7d968ff/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:53.231965 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21649ed-6703-4d51-981a-24d5e967efcf None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:53.233042 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21649ed-6703-4d51-981a-24d5e967efcf None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:53.234282 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21649ed-6703-4d51-981a-24d5e967efcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:53.304010 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4962682-0619-4a2b-9930-ce1d1b82f9dd admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:53.324327 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b21649ed-6703-4d51-981a-24d5e967efcf None None] MFA Rules not processed for user `4b685afcb41145bba5d39234c7d968ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:53.328786 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b21649ed-6703-4d51-981a-24d5e967efcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:53.436630 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feec35f-5f8a-4fa5-8cd9-4090fb33e1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:53.437292 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feec35f-5f8a-4fa5-8cd9-4090fb33e1ef admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:53.437661 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feec35f-5f8a-4fa5-8cd9-4090fb33e1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:53.437964 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feec35f-5f8a-4fa5-8cd9-4090fb33e1ef admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:53.448655 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feec35f-5f8a-4fa5-8cd9-4090fb33e1ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:53.450836 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feec35f-5f8a-4fa5-8cd9-4090fb33e1ef admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:53.500757 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 892/1783] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:53 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:55:53.502231 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21649ed-6703-4d51-981a-24d5e967efcf None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:53.503275 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 892/1784] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:53 2022] POST /identity/v3/users => generated 283 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:53.503835 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b21649ed-6703-4d51-981a-24d5e967efcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:53.504124 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feec35f-5f8a-4fa5-8cd9-4090fb33e1ef admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:53.526130 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feec35f-5f8a-4fa5-8cd9-4090fb33e1ef admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:53.540838 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf75cf-684a-4374-bc21-8a2caeb0a815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:53.541527 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf75cf-684a-4374-bc21-8a2caeb0a815 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:53.541811 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf75cf-684a-4374-bc21-8a2caeb0a815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:53.542092 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf75cf-684a-4374-bc21-8a2caeb0a815 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:53.542855 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf75cf-684a-4374-bc21-8a2caeb0a815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:53.545066 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf75cf-684a-4374-bc21-8a2caeb0a815 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:53.602628 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 893/1785] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:53 2022] POST /identity/v3/projects => generated 355 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:53.603554 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf75cf-684a-4374-bc21-8a2caeb0a815 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:53.611579 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21649ed-6703-4d51-981a-24d5e967efcf None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:53.682352 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa211cf-c395-487d-a398-648cc7851d3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:53.683226 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa211cf-c395-487d-a398-648cc7851d3f service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:53.683707 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa211cf-c395-487d-a398-648cc7851d3f service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:53.684153 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa211cf-c395-487d-a398-648cc7851d3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:53.703195 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa211cf-c395-487d-a398-648cc7851d3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:53.705094 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa211cf-c395-487d-a398-648cc7851d3f service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:53.717925 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 893/1786] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:53.719201 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa211cf-c395-487d-a398-648cc7851d3f service nova] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:53.734481 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf75cf-684a-4374-bc21-8a2caeb0a815 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:53.748550 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77698d-7bf9-4697-88e5-8605796f30e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:53.750606 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77698d-7bf9-4697-88e5-8605796f30e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:53.750973 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77698d-7bf9-4697-88e5-8605796f30e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:53.751255 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77698d-7bf9-4697-88e5-8605796f30e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:53.756254 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77698d-7bf9-4697-88e5-8605796f30e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:53.758981 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77698d-7bf9-4697-88e5-8605796f30e1 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:53.787820 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa211cf-c395-487d-a398-648cc7851d3f service nova] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:53.788629 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 894/1787] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:53.789610 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77698d-7bf9-4697-88e5-8605796f30e1 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:53.792818 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bbd4b-5976-4284-829d-820d14690d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:53.793512 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bbd4b-5976-4284-829d-820d14690d07 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:53.793796 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bbd4b-5976-4284-829d-820d14690d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:53.794098 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bbd4b-5976-4284-829d-820d14690d07 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:53.794798 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610bbd4b-5976-4284-829d-820d14690d07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:53.796828 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610bbd4b-5976-4284-829d-820d14690d07 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:53.818252 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77698d-7bf9-4697-88e5-8605796f30e1 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:53.837645 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 894/1788] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:53 2022] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:53.841293 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968f282-7816-4002-9256-b827e55ac8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:53.842071 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968f282-7816-4002-9256-b827e55ac8fc admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:53.842324 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968f282-7816-4002-9256-b827e55ac8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:53.842529 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968f282-7816-4002-9256-b827e55ac8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:53.866571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bbd4b-5976-4284-829d-820d14690d07 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:53.874183 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9968f282-7816-4002-9256-b827e55ac8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:53.887502 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9968f282-7816-4002-9256-b827e55ac8fc admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:53.932445 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bbd4b-5976-4284-829d-820d14690d07 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:53.944238 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 895/1789] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:53.948801 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968f282-7816-4002-9256-b827e55ac8fc admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:53.950653 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330ad6c-4115-454f-98f2-6647ae514539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:53.954473 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330ad6c-4115-454f-98f2-6647ae514539 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:53.954753 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330ad6c-4115-454f-98f2-6647ae514539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:53.955041 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330ad6c-4115-454f-98f2-6647ae514539 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:53.956836 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330ad6c-4115-454f-98f2-6647ae514539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:53.962675 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330ad6c-4115-454f-98f2-6647ae514539 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:53.977171 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968f282-7816-4002-9256-b827e55ac8fc admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:53.994630 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658d971-e295-40b6-9d31-e9921e299030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:53.995100 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 895/1790] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:53.995574 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658d971-e295-40b6-9d31-e9921e299030 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:53.995883 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658d971-e295-40b6-9d31-e9921e299030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:53.996163 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658d971-e295-40b6-9d31-e9921e299030 admin admin] PATH_INFO: `/v3/projects/4e7389cccbff4ee793df3d18d497610c/users/e9002453758b490180ac2be2446958ff/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:53.996743 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330ad6c-4115-454f-98f2-6647ae514539 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:54.023484 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330ad6c-4115-454f-98f2-6647ae514539 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:54.037406 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98a611-94bf-4009-be6b-5aae2484dcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:54.038345 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98a611-94bf-4009-be6b-5aae2484dcc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:54.038631 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98a611-94bf-4009-be6b-5aae2484dcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:54.038912 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98a611-94bf-4009-be6b-5aae2484dcc2 admin admin] PATH_INFO: `/v3/projects/ccd300c59194419eb95fba032f6f8cd3/users/31b671c3ef8b4da4a25801ef80f35636/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:54.053318 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658d971-e295-40b6-9d31-e9921e299030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7389cccbff4ee793df3d18d497610c, user_id=e9002453758b490180ac2be2446958ff, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:54.056225 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658d971-e295-40b6-9d31-e9921e299030 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:54.089070 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98a611-94bf-4009-be6b-5aae2484dcc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd300c59194419eb95fba032f6f8cd3, user_id=31b671c3ef8b4da4a25801ef80f35636, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:54.094039 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98a611-94bf-4009-be6b-5aae2484dcc2 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:54.095484 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 896/1791] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:53 2022] PUT /identity/v3/projects/4e7389cccbff4ee793df3d18d497610c/users/e9002453758b490180ac2be2446958ff/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:54.116799 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cc74a-1657-44dc-ad2b-8c809d3075e7 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:54.116799 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cc74a-1657-44dc-ad2b-8c809d3075e7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:54.116799 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cc74a-1657-44dc-ad2b-8c809d3075e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:54.147671 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 896/1792] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:53 2022] PUT /identity/v3/projects/ccd300c59194419eb95fba032f6f8cd3/users/31b671c3ef8b4da4a25801ef80f35636/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:54.154947 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98a611-94bf-4009-be6b-5aae2484dcc2 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:54.172735 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-5c6cc74a-1657-44dc-ad2b-8c809d3075e7 None None] MFA Rules not processed for user `e9002453758b490180ac2be2446958ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:54.173975 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5c6cc74a-1657-44dc-ad2b-8c809d3075e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:54.329358 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 897/1793] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:54.334982 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cc74a-1657-44dc-ad2b-8c809d3075e7 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:54.430454 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98a611-94bf-4009-be6b-5aae2484dcc2 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:54.437961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5265c7-4943-4197-bb69-8b6f10329feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:54.438926 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5265c7-4943-4197-bb69-8b6f10329feb admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:54.439275 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5265c7-4943-4197-bb69-8b6f10329feb admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:54.439712 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5265c7-4943-4197-bb69-8b6f10329feb admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:54.440808 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5265c7-4943-4197-bb69-8b6f10329feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:54.444040 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5265c7-4943-4197-bb69-8b6f10329feb admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:54.474163 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cc74a-1657-44dc-ad2b-8c809d3075e7 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:54.479134 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 897/1794] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:54.482662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d325f29-7f2f-4325-b563-6f0f46fab9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:54.483121 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d325f29-7f2f-4325-b563-6f0f46fab9f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:54.483745 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d325f29-7f2f-4325-b563-6f0f46fab9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:54.484096 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d325f29-7f2f-4325-b563-6f0f46fab9f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:54.484954 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d325f29-7f2f-4325-b563-6f0f46fab9f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:54.487514 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d325f29-7f2f-4325-b563-6f0f46fab9f5 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:54.498364 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5265c7-4943-4197-bb69-8b6f10329feb admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:54.510982 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-dc5265c7-4943-4197-bb69-8b6f10329feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:54.542318 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 898/1795] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:54 2022] POST /identity/v3/projects => generated 365 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:54.545925 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d325f29-7f2f-4325-b563-6f0f46fab9f5 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:54.564795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5265c7-4943-4197-bb69-8b6f10329feb admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:54.712961 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d325f29-7f2f-4325-b563-6f0f46fab9f5 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:54.713960 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea9d22-6dae-41cf-8e4e-b4279c73ee78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:54.714846 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea9d22-6dae-41cf-8e4e-b4279c73ee78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:54.715181 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea9d22-6dae-41cf-8e4e-b4279c73ee78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:54.715481 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea9d22-6dae-41cf-8e4e-b4279c73ee78 admin admin] PATH_INFO: `/v3/projects/da052f62569c42fdb4522ade468b297c` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:54.718111 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea9d22-6dae-41cf-8e4e-b4279c73ee78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da052f62569c42fdb4522ade468b297c)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:54.722437 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea9d22-6dae-41cf-8e4e-b4279c73ee78 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:54.725478 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149ff59-627d-4485-8006-1bfa0380fd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:54.726329 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149ff59-627d-4485-8006-1bfa0380fd66 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:54.727210 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149ff59-627d-4485-8006-1bfa0380fd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:54.729309 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149ff59-627d-4485-8006-1bfa0380fd66 admin admin] PATH_INFO: `/v3/projects/ccd300c59194419eb95fba032f6f8cd3/users/31b671c3ef8b4da4a25801ef80f35636/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:54.734074 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149ff59-627d-4485-8006-1bfa0380fd66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd300c59194419eb95fba032f6f8cd3, user_id=31b671c3ef8b4da4a25801ef80f35636, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:54.736796 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149ff59-627d-4485-8006-1bfa0380fd66 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:54.767381 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 899/1796] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:54 2022] PUT /identity/v3/projects/ccd300c59194419eb95fba032f6f8cd3/users/31b671c3ef8b4da4a25801ef80f35636/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:54.769618 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149ff59-627d-4485-8006-1bfa0380fd66 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:54.867297 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-56ea9d22-6dae-41cf-8e4e-b4279c73ee78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da052f62569c42fdb4522ade468b297c', 'request_id': 'req-56ea9d22-6dae-41cf-8e4e-b4279c73ee78'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:54.889390 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-56ea9d22-6dae-41cf-8e4e-b4279c73ee78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da052f62569c42fdb4522ade468b297c', 'request_id': 'req-56ea9d22-6dae-41cf-8e4e-b4279c73ee78'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:54.902827 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-56ea9d22-6dae-41cf-8e4e-b4279c73ee78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da052f62569c42fdb4522ade468b297c', 'request_id': 'req-56ea9d22-6dae-41cf-8e4e-b4279c73ee78'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:54.933289 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-56ea9d22-6dae-41cf-8e4e-b4279c73ee78 admin admin] The token cache is being invalidate because project da052f62569c42fdb4522ade468b297c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:55:54.938839 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-56ea9d22-6dae-41cf-8e4e-b4279c73ee78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:54.943948 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-56ea9d22-6dae-41cf-8e4e-b4279c73ee78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:54.950742 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 898/1797] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:55:54 2022] DELETE /identity/v3/projects/da052f62569c42fdb4522ade468b297c => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:54.955875 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf5093-8513-4b00-8297-b03f761c6e02 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:54.962273 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf5093-8513-4b00-8297-b03f761c6e02 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:54.962695 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf5093-8513-4b00-8297-b03f761c6e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:54.992074 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149ff59-627d-4485-8006-1bfa0380fd66 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:55.052298 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-87cf5093-8513-4b00-8297-b03f761c6e02 None None] MFA Rules not processed for user `31b671c3ef8b4da4a25801ef80f35636`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:55.057381 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-87cf5093-8513-4b00-8297-b03f761c6e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:55.169160 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa2271-96a8-4952-a1c8-41ba47b5af2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:55.172428 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa2271-96a8-4952-a1c8-41ba47b5af2a admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:55.173080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa2271-96a8-4952-a1c8-41ba47b5af2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:55.173589 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa2271-96a8-4952-a1c8-41ba47b5af2a admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:55.175089 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa2271-96a8-4952-a1c8-41ba47b5af2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:55.178630 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa2271-96a8-4952-a1c8-41ba47b5af2a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:55.283542 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 900/1798] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:54 2022] POST /identity/v3/users => generated 289 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:55.286558 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc085e7-db22-48e9-aa74-4f012eabc71d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:55.286922 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc085e7-db22-48e9-aa74-4f012eabc71d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:55.287358 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc085e7-db22-48e9-aa74-4f012eabc71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:55.318290 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-cdc085e7-db22-48e9-aa74-4f012eabc71d None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:55.322409 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-cdc085e7-db22-48e9-aa74-4f012eabc71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:55.353761 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 901/1799] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:55.353761 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc085e7-db22-48e9-aa74-4f012eabc71d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:55.354306 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-cdc085e7-db22-48e9-aa74-4f012eabc71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:55.369763 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc085e7-db22-48e9-aa74-4f012eabc71d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:55.375797 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ce68b-f65e-4a09-b940-1a862573e799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:55.376473 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 899/1800] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:54 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:55.376803 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ce68b-f65e-4a09-b940-1a862573e799 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:55.377103 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ce68b-f65e-4a09-b940-1a862573e799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:55.378905 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338abd8-bb52-4eaa-a150-0f056703b0a5 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:55.380028 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338abd8-bb52-4eaa-a150-0f056703b0a5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:55.380625 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338abd8-bb52-4eaa-a150-0f056703b0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:55.386361 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ce68b-f65e-4a09-b940-1a862573e799 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:55.387217 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ce68b-f65e-4a09-b940-1a862573e799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:55.389214 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ce68b-f65e-4a09-b940-1a862573e799 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:55.414485 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 902/1801] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:55.415485 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ce68b-f65e-4a09-b940-1a862573e799 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:55.418119 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6f4ce68b-f65e-4a09-b940-1a862573e799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:55.426657 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-1338abd8-bb52-4eaa-a150-0f056703b0a5 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:55.428362 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1338abd8-bb52-4eaa-a150-0f056703b0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:55.454752 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 900/1802] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:55.455732 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338abd8-bb52-4eaa-a150-0f056703b0a5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:55.478125 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338abd8-bb52-4eaa-a150-0f056703b0a5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:55.509410 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ce68b-f65e-4a09-b940-1a862573e799 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:55.513270 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d50f3-d699-4221-ade6-e4ca2b26be6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:55.514059 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d50f3-d699-4221-ade6-e4ca2b26be6f service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:55.514482 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d50f3-d699-4221-ade6-e4ca2b26be6f service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:55.514839 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d50f3-d699-4221-ade6-e4ca2b26be6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:55.516051 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf6cb7-702a-408d-aaba-bad86a6102db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:55.516997 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf6cb7-702a-408d-aaba-bad86a6102db admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:55.517265 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf6cb7-702a-408d-aaba-bad86a6102db admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:55.517543 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf6cb7-702a-408d-aaba-bad86a6102db admin admin] PATH_INFO: `/v3/projects/5e24782475d24672a0890aea714d18c9/users/09c76298338145e7a8a481ce1bbe7d00/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:55.535203 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d50f3-d699-4221-ade6-e4ca2b26be6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:55.550265 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d50f3-d699-4221-ade6-e4ca2b26be6f service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:55.551495 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf6cb7-702a-408d-aaba-bad86a6102db admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e24782475d24672a0890aea714d18c9, user_id=09c76298338145e7a8a481ce1bbe7d00, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:55.554759 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf6cb7-702a-408d-aaba-bad86a6102db admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:55.570069 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 903/1803] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:55 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:55.571370 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d50f3-d699-4221-ade6-e4ca2b26be6f service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:55.577767 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 901/1804] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:55 2022] PUT /identity/v3/projects/5e24782475d24672a0890aea714d18c9/users/09c76298338145e7a8a481ce1bbe7d00/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:55.581657 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf6cb7-702a-408d-aaba-bad86a6102db admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:55.591948 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d50f3-d699-4221-ade6-e4ca2b26be6f service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:55.705905 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf6cb7-702a-408d-aaba-bad86a6102db admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:55.712259 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea21df9-bace-4a63-813e-2e5d3a207293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:55.713076 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea21df9-bace-4a63-813e-2e5d3a207293 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:55.713485 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea21df9-bace-4a63-813e-2e5d3a207293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:55.713863 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea21df9-bace-4a63-813e-2e5d3a207293 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:55.714718 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea21df9-bace-4a63-813e-2e5d3a207293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:55.716548 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea21df9-bace-4a63-813e-2e5d3a207293 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:55.730454 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 902/1805] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:55:55.731453 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea21df9-bace-4a63-813e-2e5d3a207293 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:55.737067 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf229f-1f33-486f-80d2-e8e49b3e658c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:55.737758 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf229f-1f33-486f-80d2-e8e49b3e658c admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:55.738046 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf229f-1f33-486f-80d2-e8e49b3e658c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:55.738326 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf229f-1f33-486f-80d2-e8e49b3e658c admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:55.743315 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf229f-1f33-486f-80d2-e8e49b3e658c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:55:55.743672 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf229f-1f33-486f-80d2-e8e49b3e658c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:55.753142 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf229f-1f33-486f-80d2-e8e49b3e658c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:55.789945 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 904/1806] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:55:55.789945 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf229f-1f33-486f-80d2-e8e49b3e658c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:55.814671 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf229f-1f33-486f-80d2-e8e49b3e658c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:55.826541 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c0388-73bb-453e-9470-3f6d33aa3599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:55.827522 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c0388-73bb-453e-9470-3f6d33aa3599 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:55.829406 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c0388-73bb-453e-9470-3f6d33aa3599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:55.829698 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c0388-73bb-453e-9470-3f6d33aa3599 admin admin] PATH_INFO: `/v3/projects/5e24782475d24672a0890aea714d18c9/users/09c76298338145e7a8a481ce1bbe7d00/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:55.830362 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea21df9-bace-4a63-813e-2e5d3a207293 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:55.836911 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55366e-1902-4f50-bdda-2cef8bbf4af5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:55.837971 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55366e-1902-4f50-bdda-2cef8bbf4af5 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:55.837971 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55366e-1902-4f50-bdda-2cef8bbf4af5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:55.838362 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55366e-1902-4f50-bdda-2cef8bbf4af5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:55.840805 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c0388-73bb-453e-9470-3f6d33aa3599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e24782475d24672a0890aea714d18c9, user_id=09c76298338145e7a8a481ce1bbe7d00, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:55.841354 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7d55366e-1902-4f50-bdda-2cef8bbf4af5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:55.861929 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c0388-73bb-453e-9470-3f6d33aa3599 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:55.918137 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 905/1807] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:55 2022] PUT /identity/v3/projects/5e24782475d24672a0890aea714d18c9/users/09c76298338145e7a8a481ce1bbe7d00/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:55.932809 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c0388-73bb-453e-9470-3f6d33aa3599 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:55.935946 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55366e-1902-4f50-bdda-2cef8bbf4af5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:55.937697 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55366e-1902-4f50-bdda-2cef8bbf4af5 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:55.965404 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 903/1808] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:55 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:55.978811 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ab9d0-f0a0-4cd6-a8bb-e8eec1743657 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:55.978811 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ab9d0-f0a0-4cd6-a8bb-e8eec1743657 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:55.978811 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ab9d0-f0a0-4cd6-a8bb-e8eec1743657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:56.065013 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-6c3ab9d0-f0a0-4cd6-a8bb-e8eec1743657 None None] MFA Rules not processed for user `09c76298338145e7a8a481ce1bbe7d00`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:56.067556 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6c3ab9d0-f0a0-4cd6-a8bb-e8eec1743657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:56.184620 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c0388-73bb-453e-9470-3f6d33aa3599 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:56.212508 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90e64c-ce6c-426e-a3ac-4390d86f1384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:56.213585 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90e64c-ce6c-426e-a3ac-4390d86f1384 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:56.213872 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90e64c-ce6c-426e-a3ac-4390d86f1384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:56.214169 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90e64c-ce6c-426e-a3ac-4390d86f1384 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:56.214880 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90e64c-ce6c-426e-a3ac-4390d86f1384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:56.222384 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90e64c-ce6c-426e-a3ac-4390d86f1384 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:56.297902 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 904/1809] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:55 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:56.367336 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 906/1810] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:55 2022] POST /identity/v3/projects => generated 381 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:56.372394 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ab9d0-f0a0-4cd6-a8bb-e8eec1743657 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:56.392585 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ab9d0-f0a0-4cd6-a8bb-e8eec1743657 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:56.444134 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90e64c-ce6c-426e-a3ac-4390d86f1384 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:56.623996 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90e64c-ce6c-426e-a3ac-4390d86f1384 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:56.634973 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1fb8d-9cd6-43fc-a4ef-04ea1c931851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:56.636156 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1fb8d-9cd6-43fc-a4ef-04ea1c931851 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:56.636725 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1fb8d-9cd6-43fc-a4ef-04ea1c931851 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:56.637229 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1fb8d-9cd6-43fc-a4ef-04ea1c931851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:56.656507 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee29a1-0c88-4d01-b474-c6d10136a21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:56.657218 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee29a1-0c88-4d01-b474-c6d10136a21f admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:56.657498 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee29a1-0c88-4d01-b474-c6d10136a21f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:56.657823 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee29a1-0c88-4d01-b474-c6d10136a21f admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:56.658476 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee29a1-0c88-4d01-b474-c6d10136a21f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:56.660582 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee29a1-0c88-4d01-b474-c6d10136a21f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:56.717474 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 905/1811] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:56 2022] POST /identity/v3/users => generated 291 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:56.718430 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee29a1-0c88-4d01-b474-c6d10136a21f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:56.720206 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e1ee29a1-0c88-4d01-b474-c6d10136a21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:56.742922 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee29a1-0c88-4d01-b474-c6d10136a21f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:56.767036 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffca54-5761-4dd1-8245-766a2185765a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:56.768025 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffca54-5761-4dd1-8245-766a2185765a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:56.768282 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffca54-5761-4dd1-8245-766a2185765a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:56.768552 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffca54-5761-4dd1-8245-766a2185765a admin admin] PATH_INFO: `/v3/projects/2dda66f2ef0f4016bdbb44593919f6ad` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:56.769901 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffca54-5761-4dd1-8245-766a2185765a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dda66f2ef0f4016bdbb44593919f6ad)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:56.772039 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffca54-5761-4dd1-8245-766a2185765a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:56.781823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1fb8d-9cd6-43fc-a4ef-04ea1c931851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:56.783754 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1fb8d-9cd6-43fc-a4ef-04ea1c931851 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:56.797328 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 907/1812] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:56 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:56.799622 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e03d7-a325-4730-8d6e-d2feae48f666 None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:56.800226 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e03d7-a325-4730-8d6e-d2feae48f666 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:56.800897 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e03d7-a325-4730-8d6e-d2feae48f666 None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:56.803599 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 908/1813] 10.222.0.67 () {54 vars in 921 bytes} [Mon Apr 11 13:55:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:55:56.804869 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e03d7-a325-4730-8d6e-d2feae48f666 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:56.826692 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e03d7-a325-4730-8d6e-d2feae48f666 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:56.839873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507662b-bade-4a59-bb29-7e8b243d1736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:56.841166 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507662b-bade-4a59-bb29-7e8b243d1736 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:56.841563 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507662b-bade-4a59-bb29-7e8b243d1736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:56.842061 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507662b-bade-4a59-bb29-7e8b243d1736 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:56.843250 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507662b-bade-4a59-bb29-7e8b243d1736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:56.846510 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507662b-bade-4a59-bb29-7e8b243d1736 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:56.876304 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 909/1814] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:56.878270 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17c024-e341-4c55-86d9-e3954ad180de None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:56.878777 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17c024-e341-4c55-86d9-e3954ad180de None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:56.880141 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17c024-e341-4c55-86d9-e3954ad180de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:56.893287 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7fffca54-5761-4dd1-8245-766a2185765a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dda66f2ef0f4016bdbb44593919f6ad', 'request_id': 'req-7fffca54-5761-4dd1-8245-766a2185765a'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:56.911687 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7fffca54-5761-4dd1-8245-766a2185765a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dda66f2ef0f4016bdbb44593919f6ad', 'request_id': 'req-7fffca54-5761-4dd1-8245-766a2185765a'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:56.919764 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7fffca54-5761-4dd1-8245-766a2185765a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dda66f2ef0f4016bdbb44593919f6ad', 'request_id': 'req-7fffca54-5761-4dd1-8245-766a2185765a'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:56.929110 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4b17c024-e341-4c55-86d9-e3954ad180de None None] MFA Rules not processed for user `fedd2314dc594bcba749bf7b0d1e50fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:56.933423 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4b17c024-e341-4c55-86d9-e3954ad180de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:56.939582 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7fffca54-5761-4dd1-8245-766a2185765a admin admin] The token cache is being invalidate because project 2dda66f2ef0f4016bdbb44593919f6ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:55:56.940005 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7fffca54-5761-4dd1-8245-766a2185765a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:56.941169 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7fffca54-5761-4dd1-8245-766a2185765a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:56.948355 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 906/1815] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:55:56 2022] DELETE /identity/v3/projects/2dda66f2ef0f4016bdbb44593919f6ad => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:56.949422 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffca54-5761-4dd1-8245-766a2185765a admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:56.951355 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7fffca54-5761-4dd1-8245-766a2185765a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:57.041835 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffca54-5761-4dd1-8245-766a2185765a admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:57.058403 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11b781-38f1-4df2-9acc-9b837da0d8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:57.059163 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11b781-38f1-4df2-9acc-9b837da0d8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:57.059460 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11b781-38f1-4df2-9acc-9b837da0d8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:57.059773 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11b781-38f1-4df2-9acc-9b837da0d8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:57.061296 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11b781-38f1-4df2-9acc-9b837da0d8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:57.063156 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11b781-38f1-4df2-9acc-9b837da0d8b7 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:57.092997 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 910/1816] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Apr 11 13:55:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:57.094447 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17c024-e341-4c55-86d9-e3954ad180de None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:57.096242 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4b17c024-e341-4c55-86d9-e3954ad180de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:57.107687 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 907/1817] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:57.112942 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11b781-38f1-4df2-9acc-9b837da0d8b7 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:57.125432 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17c024-e341-4c55-86d9-e3954ad180de None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:57.133057 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63679a-569c-45fc-9a02-1a9a8d7ab4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:57.134293 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63679a-569c-45fc-9a02-1a9a8d7ab4f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:57.134711 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63679a-569c-45fc-9a02-1a9a8d7ab4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:57.135131 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63679a-569c-45fc-9a02-1a9a8d7ab4f1 admin admin] PATH_INFO: `/v3/users/3c0d39ee71b041779226bf17376d4b60` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:57.136955 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63679a-569c-45fc-9a02-1a9a8d7ab4f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c0d39ee71b041779226bf17376d4b60)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:57.138618 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63679a-569c-45fc-9a02-1a9a8d7ab4f1 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:57.142514 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11b781-38f1-4df2-9acc-9b837da0d8b7 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:57.151132 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67618aca-bf1d-4e01-bf1e-5dd09101cf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:57.152535 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67618aca-bf1d-4e01-bf1e-5dd09101cf45 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:57.152963 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67618aca-bf1d-4e01-bf1e-5dd09101cf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:57.153400 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67618aca-bf1d-4e01-bf1e-5dd09101cf45 admin admin] PATH_INFO: `/v3/projects/dbb89c8b40734234b2f9b8a79f6729e3/users/17d5ccda2fc946359bd19ec0af452b1e/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:57.172344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67618aca-bf1d-4e01-bf1e-5dd09101cf45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbb89c8b40734234b2f9b8a79f6729e3, user_id=17d5ccda2fc946359bd19ec0af452b1e, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:57.175926 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67618aca-bf1d-4e01-bf1e-5dd09101cf45 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:57.200705 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 908/1818] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:57 2022] PUT /identity/v3/projects/dbb89c8b40734234b2f9b8a79f6729e3/users/17d5ccda2fc946359bd19ec0af452b1e/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:57.211581 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67889b8-cfa2-442b-ba20-56b5e1e3f8a3 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:57.212706 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67889b8-cfa2-442b-ba20-56b5e1e3f8a3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:57.213123 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67889b8-cfa2-442b-ba20-56b5e1e3f8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:57.268464 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0e63679a-569c-45fc-9a02-1a9a8d7ab4f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0d39ee71b041779226bf17376d4b60'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:57.270069 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0e63679a-569c-45fc-9a02-1a9a8d7ab4f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0d39ee71b041779226bf17376d4b60'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:57.274532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e67889b8-cfa2-442b-ba20-56b5e1e3f8a3 None None] MFA Rules not processed for user `17d5ccda2fc946359bd19ec0af452b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:57.274532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e67889b8-cfa2-442b-ba20-56b5e1e3f8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:57.281704 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0e63679a-569c-45fc-9a02-1a9a8d7ab4f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0d39ee71b041779226bf17376d4b60'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:57.296003 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0e63679a-569c-45fc-9a02-1a9a8d7ab4f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0d39ee71b041779226bf17376d4b60'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:57.297859 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-0e63679a-569c-45fc-9a02-1a9a8d7ab4f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0d39ee71b041779226bf17376d4b60'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:57.358514 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 911/1819] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:55:57 2022] DELETE /identity/v3/users/3c0d39ee71b041779226bf17376d4b60 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:57.432830 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 909/1820] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:55:57.434357 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63679a-569c-45fc-9a02-1a9a8d7ab4f1 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:57.436559 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0e63679a-569c-45fc-9a02-1a9a8d7ab4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:57.469737 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67889b8-cfa2-442b-ba20-56b5e1e3f8a3 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:57.471862 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e67889b8-cfa2-442b-ba20-56b5e1e3f8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:57.573527 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63679a-569c-45fc-9a02-1a9a8d7ab4f1 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:57.584465 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67889b8-cfa2-442b-ba20-56b5e1e3f8a3 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:57.584845 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa2a4f-99cd-4a2d-b28e-b99eea6eb260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:57.586694 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa2a4f-99cd-4a2d-b28e-b99eea6eb260 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:57.589448 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa2a4f-99cd-4a2d-b28e-b99eea6eb260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:57.589728 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa2a4f-99cd-4a2d-b28e-b99eea6eb260 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:57.590471 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa2a4f-99cd-4a2d-b28e-b99eea6eb260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:57.594848 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa2a4f-99cd-4a2d-b28e-b99eea6eb260 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:57.655272 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 912/1821] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:55:57 2022] POST /identity/v3/projects => generated 381 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:57.656513 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa2a4f-99cd-4a2d-b28e-b99eea6eb260 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:57.715926 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa0b03-e490-494e-8a2d-64ca35242a85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:57.717923 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa0b03-e490-494e-8a2d-64ca35242a85 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:57.718489 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa0b03-e490-494e-8a2d-64ca35242a85 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:57.718489 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa0b03-e490-494e-8a2d-64ca35242a85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:57.722553 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-83fa0b03-e490-494e-8a2d-64ca35242a85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:57.749858 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa0b03-e490-494e-8a2d-64ca35242a85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:57.753242 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa0b03-e490-494e-8a2d-64ca35242a85 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:57.773324 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 910/1822] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:55:57.774503 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa0b03-e490-494e-8a2d-64ca35242a85 service nova] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:57.777379 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-83fa0b03-e490-494e-8a2d-64ca35242a85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:57.797440 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa0b03-e490-494e-8a2d-64ca35242a85 service nova] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:57.811405 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2d42c-be60-4596-9155-fee8e37c9385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:57.812500 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa2a4f-99cd-4a2d-b28e-b99eea6eb260 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:57.813178 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2d42c-be60-4596-9155-fee8e37c9385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:57.813795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2d42c-be60-4596-9155-fee8e37c9385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:57.814277 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2d42c-be60-4596-9155-fee8e37c9385 admin admin] PATH_INFO: `/v3/users/e9002453758b490180ac2be2446958ff` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:57.816182 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2d42c-be60-4596-9155-fee8e37c9385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9002453758b490180ac2be2446958ff)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:57.818684 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f93666-a38f-4551-996f-f42733c271ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:57.820306 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2d42c-be60-4596-9155-fee8e37c9385 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:57.820580 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f93666-a38f-4551-996f-f42733c271ef admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:57.820873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f93666-a38f-4551-996f-f42733c271ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:57.821153 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f93666-a38f-4551-996f-f42733c271ef admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:57.821992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f93666-a38f-4551-996f-f42733c271ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:57.824389 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f93666-a38f-4551-996f-f42733c271ef admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:57.851875 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 913/1823] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:55:57 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:55:57.858476 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f93666-a38f-4551-996f-f42733c271ef admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:57.871786 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f93666-a38f-4551-996f-f42733c271ef admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:57.877657 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7b609-e233-48b1-8af4-dac2fe5a23af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:57.878393 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7b609-e233-48b1-8af4-dac2fe5a23af admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:57.878681 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7b609-e233-48b1-8af4-dac2fe5a23af admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:57.879004 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7b609-e233-48b1-8af4-dac2fe5a23af admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:57.880936 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7b609-e233-48b1-8af4-dac2fe5a23af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:57.882798 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7b609-e233-48b1-8af4-dac2fe5a23af admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:57.894390 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 914/1824] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:57.898722 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7b609-e233-48b1-8af4-dac2fe5a23af admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:57.912110 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2bf2d42c-be60-4596-9155-fee8e37c9385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9002453758b490180ac2be2446958ff'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:57.916998 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7b609-e233-48b1-8af4-dac2fe5a23af admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:57.920598 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2bf2d42c-be60-4596-9155-fee8e37c9385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9002453758b490180ac2be2446958ff'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:57.925119 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126371f-3558-42f8-944f-01641149dc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:57.929790 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126371f-3558-42f8-944f-01641149dc73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:57.930121 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126371f-3558-42f8-944f-01641149dc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:57.930527 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126371f-3558-42f8-944f-01641149dc73 admin admin] PATH_INFO: `/v3/projects/b190e773912c4f7e88291e2faad047ca/users/6e40477bd9ea49d5acafcfbc8da90d81/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:57.937893 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2bf2d42c-be60-4596-9155-fee8e37c9385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9002453758b490180ac2be2446958ff'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:57.938766 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2bf2d42c-be60-4596-9155-fee8e37c9385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9002453758b490180ac2be2446958ff'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:57.939803 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2bf2d42c-be60-4596-9155-fee8e37c9385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9002453758b490180ac2be2446958ff'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:57.949121 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126371f-3558-42f8-944f-01641149dc73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b190e773912c4f7e88291e2faad047ca, user_id=6e40477bd9ea49d5acafcfbc8da90d81, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:57.952292 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126371f-3558-42f8-944f-01641149dc73 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:57.968995 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 911/1826] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:55:57 2022] DELETE /identity/v3/users/e9002453758b490180ac2be2446958ff => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:57.970662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 915/1826] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:57 2022] PUT /identity/v3/projects/b190e773912c4f7e88291e2faad047ca/users/6e40477bd9ea49d5acafcfbc8da90d81/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:55:57.971927 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126371f-3558-42f8-944f-01641149dc73 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:57.972700 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9a995-5399-4c7b-98a7-2f864d5921f9 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:57.973701 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9a995-5399-4c7b-98a7-2f864d5921f9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:57.974178 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9a995-5399-4c7b-98a7-2f864d5921f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:57.986900 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8126371f-3558-42f8-944f-01641149dc73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:57.996778 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-18f9a995-5399-4c7b-98a7-2f864d5921f9 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:57.998192 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-18f9a995-5399-4c7b-98a7-2f864d5921f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:58.106139 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 912/1827] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:58.125668 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9a995-5399-4c7b-98a7-2f864d5921f9 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:58.126052 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126371f-3558-42f8-944f-01641149dc73 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:58.127574 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-18f9a995-5399-4c7b-98a7-2f864d5921f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:58.133641 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a42e51-5604-4214-8743-c72664e358c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:58.134472 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a42e51-5604-4214-8743-c72664e358c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:58.134760 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a42e51-5604-4214-8743-c72664e358c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:58.135040 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a42e51-5604-4214-8743-c72664e358c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:58.136119 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a42e51-5604-4214-8743-c72664e358c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:58.138295 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a42e51-5604-4214-8743-c72664e358c8 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:58.149701 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 916/1828] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:55:58.154172 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a42e51-5604-4214-8743-c72664e358c8 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:58.169776 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a42e51-5604-4214-8743-c72664e358c8 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:58.176553 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63484b-c990-4dda-b12d-1974c55adab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:58.178514 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63484b-c990-4dda-b12d-1974c55adab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:58.178925 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63484b-c990-4dda-b12d-1974c55adab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:58.179300 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63484b-c990-4dda-b12d-1974c55adab2 admin admin] PATH_INFO: `/v3/projects/b190e773912c4f7e88291e2faad047ca/users/6e40477bd9ea49d5acafcfbc8da90d81/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:58.181586 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63484b-c990-4dda-b12d-1974c55adab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b190e773912c4f7e88291e2faad047ca, user_id=6e40477bd9ea49d5acafcfbc8da90d81, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:58.185049 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63484b-c990-4dda-b12d-1974c55adab2 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:58.236233 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 917/1829] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:55:58 2022] PUT /identity/v3/projects/b190e773912c4f7e88291e2faad047ca/users/6e40477bd9ea49d5acafcfbc8da90d81/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:55:58.247669 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426945e-60ab-4d50-b55b-a1fa078588db None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:58.248059 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426945e-60ab-4d50-b55b-a1fa078588db None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:58.248455 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426945e-60ab-4d50-b55b-a1fa078588db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:58.252454 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9a995-5399-4c7b-98a7-2f864d5921f9 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:58.291449 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-6426945e-60ab-4d50-b55b-a1fa078588db None None] MFA Rules not processed for user `6e40477bd9ea49d5acafcfbc8da90d81`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:55:58.293632 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6426945e-60ab-4d50-b55b-a1fa078588db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:58.328394 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c4b98-2115-49f9-97ee-8f0334500e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:58.329087 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c4b98-2115-49f9-97ee-8f0334500e19 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:58.329368 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c4b98-2115-49f9-97ee-8f0334500e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:58.329640 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c4b98-2115-49f9-97ee-8f0334500e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:58.428451 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 918/1830] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:55:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:55:58.438529 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426945e-60ab-4d50-b55b-a1fa078588db None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:58.440490 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6426945e-60ab-4d50-b55b-a1fa078588db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:58.461114 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c4b98-2115-49f9-97ee-8f0334500e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:58.463191 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c4b98-2115-49f9-97ee-8f0334500e19 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:58.480780 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 913/1831] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:58.560740 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426945e-60ab-4d50-b55b-a1fa078588db None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:58.564628 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a87043-f57f-4957-93a3-50be2f4b4396 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:58.565383 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a87043-f57f-4957-93a3-50be2f4b4396 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:58.565677 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a87043-f57f-4957-93a3-50be2f4b4396 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:58.566003 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a87043-f57f-4957-93a3-50be2f4b4396 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:58.590081 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a87043-f57f-4957-93a3-50be2f4b4396 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:58.591541 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a87043-f57f-4957-93a3-50be2f4b4396 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:58.603319 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 919/1832] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:55:58.617473 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c4b98-2115-49f9-97ee-8f0334500e19 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:58.618980 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1d5c4b98-2115-49f9-97ee-8f0334500e19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:58.633991 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c4b98-2115-49f9-97ee-8f0334500e19 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:58.641686 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e83b1-753f-46d0-bf4b-e1266e5e9064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:58.642838 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e83b1-753f-46d0-bf4b-e1266e5e9064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:58.643319 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e83b1-753f-46d0-bf4b-e1266e5e9064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:58.643817 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e83b1-753f-46d0-bf4b-e1266e5e9064 admin admin] PATH_INFO: `/v3/projects/baae874d23bd46799d7bf80cb62a11fa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:58.645893 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e83b1-753f-46d0-bf4b-e1266e5e9064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baae874d23bd46799d7bf80cb62a11fa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:58.648452 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e83b1-753f-46d0-bf4b-e1266e5e9064 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:58.730462 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a87043-f57f-4957-93a3-50be2f4b4396 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:58.730844 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-748e83b1-753f-46d0-bf4b-e1266e5e9064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baae874d23bd46799d7bf80cb62a11fa', 'request_id': 'req-748e83b1-753f-46d0-bf4b-e1266e5e9064'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:58.743957 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a87043-f57f-4957-93a3-50be2f4b4396 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:58.744327 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-748e83b1-753f-46d0-bf4b-e1266e5e9064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baae874d23bd46799d7bf80cb62a11fa', 'request_id': 'req-748e83b1-753f-46d0-bf4b-e1266e5e9064'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:58.752123 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-748e83b1-753f-46d0-bf4b-e1266e5e9064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baae874d23bd46799d7bf80cb62a11fa', 'request_id': 'req-748e83b1-753f-46d0-bf4b-e1266e5e9064'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:58.768900 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-748e83b1-753f-46d0-bf4b-e1266e5e9064 admin admin] The token cache is being invalidate because project baae874d23bd46799d7bf80cb62a11fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:55:58.769353 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-748e83b1-753f-46d0-bf4b-e1266e5e9064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:58.770447 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-748e83b1-753f-46d0-bf4b-e1266e5e9064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:58.773074 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 914/1833] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:55:58 2022] DELETE /identity/v3/projects/baae874d23bd46799d7bf80cb62a11fa => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:58.778758 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e83b1-753f-46d0-bf4b-e1266e5e9064 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:58.782814 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-748e83b1-753f-46d0-bf4b-e1266e5e9064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:58.885710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e83b1-753f-46d0-bf4b-e1266e5e9064 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:58.898792 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940c8bc-fce5-4d0e-8585-f9504e9e953a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:58.900065 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940c8bc-fce5-4d0e-8585-f9504e9e953a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:58.900523 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940c8bc-fce5-4d0e-8585-f9504e9e953a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:58.900936 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940c8bc-fce5-4d0e-8585-f9504e9e953a admin admin] PATH_INFO: `/v3/users/d0f52b5bb4f24e87afdd44c0ec30f904` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:58.903228 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940c8bc-fce5-4d0e-8585-f9504e9e953a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0f52b5bb4f24e87afdd44c0ec30f904)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:58.908880 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940c8bc-fce5-4d0e-8585-f9504e9e953a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:58.924418 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6bfb9-de10-42fa-93fe-f9ada6117378 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:58.925769 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6bfb9-de10-42fa-93fe-f9ada6117378 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:58.927140 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6bfb9-de10-42fa-93fe-f9ada6117378 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:58.927522 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6bfb9-de10-42fa-93fe-f9ada6117378 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:58.930418 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-42d6bfb9-de10-42fa-93fe-f9ada6117378 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:59.022170 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6bfb9-de10-42fa-93fe-f9ada6117378 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:59.023889 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6bfb9-de10-42fa-93fe-f9ada6117378 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:59.032159 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f940c8bc-fce5-4d0e-8585-f9504e9e953a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0f52b5bb4f24e87afdd44c0ec30f904'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:59.046739 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 920/1834] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:55:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:55:59.047561 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f940c8bc-fce5-4d0e-8585-f9504e9e953a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0f52b5bb4f24e87afdd44c0ec30f904'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:59.069878 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f940c8bc-fce5-4d0e-8585-f9504e9e953a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0f52b5bb4f24e87afdd44c0ec30f904'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:59.070597 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f940c8bc-fce5-4d0e-8585-f9504e9e953a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0f52b5bb4f24e87afdd44c0ec30f904'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:59.071237 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f940c8bc-fce5-4d0e-8585-f9504e9e953a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0f52b5bb4f24e87afdd44c0ec30f904'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:59.102342 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 915/1835] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:55:58 2022] DELETE /identity/v3/users/d0f52b5bb4f24e87afdd44c0ec30f904 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:59.182655 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6bfb9-de10-42fa-93fe-f9ada6117378 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:59.184479 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-42d6bfb9-de10-42fa-93fe-f9ada6117378 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:59.208847 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6bfb9-de10-42fa-93fe-f9ada6117378 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:59.344075 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9559f-2283-43f7-9707-42ae83129679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:59.344722 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9559f-2283-43f7-9707-42ae83129679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:59.346306 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9559f-2283-43f7-9707-42ae83129679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:59.346647 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9559f-2283-43f7-9707-42ae83129679 admin admin] PATH_INFO: `/v3/projects/4e7389cccbff4ee793df3d18d497610c` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:59.363940 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9559f-2283-43f7-9707-42ae83129679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e7389cccbff4ee793df3d18d497610c)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:59.368577 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9559f-2283-43f7-9707-42ae83129679 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:59.471684 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-47e9559f-2283-43f7-9707-42ae83129679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e7389cccbff4ee793df3d18d497610c', 'request_id': 'req-47e9559f-2283-43f7-9707-42ae83129679'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:59.488181 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-47e9559f-2283-43f7-9707-42ae83129679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e7389cccbff4ee793df3d18d497610c', 'request_id': 'req-47e9559f-2283-43f7-9707-42ae83129679'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:59.500972 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-47e9559f-2283-43f7-9707-42ae83129679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e7389cccbff4ee793df3d18d497610c', 'request_id': 'req-47e9559f-2283-43f7-9707-42ae83129679'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:59.541861 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-47e9559f-2283-43f7-9707-42ae83129679 admin admin] The token cache is being invalidate because project 4e7389cccbff4ee793df3d18d497610c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:55:59.542848 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-47e9559f-2283-43f7-9707-42ae83129679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:59.543806 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-47e9559f-2283-43f7-9707-42ae83129679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:59.547359 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 921/1836] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:55:59 2022] DELETE /identity/v3/projects/4e7389cccbff4ee793df3d18d497610c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:55:59.552755 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940c8bc-fce5-4d0e-8585-f9504e9e953a admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:55:59.554255 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f940c8bc-fce5-4d0e-8585-f9504e9e953a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:55:59.582412 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940c8bc-fce5-4d0e-8585-f9504e9e953a admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:55:59.679753 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf86718-3b34-48c4-8f79-5d08a18abd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:55:59.681025 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf86718-3b34-48c4-8f79-5d08a18abd69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:55:59.681025 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf86718-3b34-48c4-8f79-5d08a18abd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:55:59.681309 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf86718-3b34-48c4-8f79-5d08a18abd69 admin admin] PATH_INFO: `/v3/users/09c76298338145e7a8a481ce1bbe7d00` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:55:59.683320 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf86718-3b34-48c4-8f79-5d08a18abd69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09c76298338145e7a8a481ce1bbe7d00)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:55:59.685669 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf86718-3b34-48c4-8f79-5d08a18abd69 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:55:59.758028 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bbf86718-3b34-48c4-8f79-5d08a18abd69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09c76298338145e7a8a481ce1bbe7d00'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:59.770488 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bbf86718-3b34-48c4-8f79-5d08a18abd69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09c76298338145e7a8a481ce1bbe7d00'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:59.781799 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bbf86718-3b34-48c4-8f79-5d08a18abd69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09c76298338145e7a8a481ce1bbe7d00'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:59.782722 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bbf86718-3b34-48c4-8f79-5d08a18abd69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09c76298338145e7a8a481ce1bbe7d00'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:59.783422 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bbf86718-3b34-48c4-8f79-5d08a18abd69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09c76298338145e7a8a481ce1bbe7d00'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:55:59.836288 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 916/1837] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:55:59 2022] DELETE /identity/v3/users/09c76298338145e7a8a481ce1bbe7d00 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:00.095566 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9559f-2283-43f7-9707-42ae83129679 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:00.097436 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-47e9559f-2283-43f7-9707-42ae83129679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:00.119754 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9559f-2283-43f7-9707-42ae83129679 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:00.308384 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37273c6-f1f6-4399-a37e-911847c97d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:00.309317 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37273c6-f1f6-4399-a37e-911847c97d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:00.309653 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37273c6-f1f6-4399-a37e-911847c97d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:00.309929 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37273c6-f1f6-4399-a37e-911847c97d17 admin admin] PATH_INFO: `/v3/projects/dcec9f9d91fe49209f27d4150e6732b5` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:00.311215 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37273c6-f1f6-4399-a37e-911847c97d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcec9f9d91fe49209f27d4150e6732b5)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:00.313195 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37273c6-f1f6-4399-a37e-911847c97d17 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:00.388548 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a37273c6-f1f6-4399-a37e-911847c97d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcec9f9d91fe49209f27d4150e6732b5', 'request_id': 'req-a37273c6-f1f6-4399-a37e-911847c97d17'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:00.398743 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a37273c6-f1f6-4399-a37e-911847c97d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcec9f9d91fe49209f27d4150e6732b5', 'request_id': 'req-a37273c6-f1f6-4399-a37e-911847c97d17'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:00.406534 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a37273c6-f1f6-4399-a37e-911847c97d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcec9f9d91fe49209f27d4150e6732b5', 'request_id': 'req-a37273c6-f1f6-4399-a37e-911847c97d17'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:00.422960 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a37273c6-f1f6-4399-a37e-911847c97d17 admin admin] The token cache is being invalidate because project dcec9f9d91fe49209f27d4150e6732b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:00.423322 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a37273c6-f1f6-4399-a37e-911847c97d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:00.424316 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a37273c6-f1f6-4399-a37e-911847c97d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:00.426667 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 922/1838] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:00 2022] DELETE /identity/v3/projects/dcec9f9d91fe49209f27d4150e6732b5 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:00.433822 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a30a8-083f-47c2-975e-2a5a0f5b057d None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:00.433822 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a30a8-083f-47c2-975e-2a5a0f5b057d None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:00.434177 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a30a8-083f-47c2-975e-2a5a0f5b057d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:00.454420 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-191a30a8-083f-47c2-975e-2a5a0f5b057d None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:00.455654 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-191a30a8-083f-47c2-975e-2a5a0f5b057d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:00.525943 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 917/1839] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:00.529270 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c080fdd-c826-453f-bd9c-981f9cf4fced None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:00.530528 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c080fdd-c826-453f-bd9c-981f9cf4fced None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:00.530822 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c080fdd-c826-453f-bd9c-981f9cf4fced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:00.554192 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-3c080fdd-c826-453f-bd9c-981f9cf4fced None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:00.555458 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3c080fdd-c826-453f-bd9c-981f9cf4fced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:00.568133 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 923/1840] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:00.574063 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a30a8-083f-47c2-975e-2a5a0f5b057d None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:00.587982 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a30a8-083f-47c2-975e-2a5a0f5b057d None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:00.594257 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d7fd3-22e8-4f02-85c9-60497782d5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:00.595459 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d7fd3-22e8-4f02-85c9-60497782d5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:00.595959 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d7fd3-22e8-4f02-85c9-60497782d5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:00.596417 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d7fd3-22e8-4f02-85c9-60497782d5e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:00.597615 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d7fd3-22e8-4f02-85c9-60497782d5e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:00.598143 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d7fd3-22e8-4f02-85c9-60497782d5e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:00.600234 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d7fd3-22e8-4f02-85c9-60497782d5e0 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:00.620242 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 918/1841] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:56:00.624778 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c080fdd-c826-453f-bd9c-981f9cf4fced None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:00.638137 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c080fdd-c826-453f-bd9c-981f9cf4fced None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:00.653783 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bede6-b5af-4bdd-8f1f-c56b31a6759c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:00.654473 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bede6-b5af-4bdd-8f1f-c56b31a6759c admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:00.654759 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bede6-b5af-4bdd-8f1f-c56b31a6759c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:00.655040 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bede6-b5af-4bdd-8f1f-c56b31a6759c admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:00.655779 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bede6-b5af-4bdd-8f1f-c56b31a6759c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:00.657687 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bede6-b5af-4bdd-8f1f-c56b31a6759c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:00.730562 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 924/1842] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:00 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:00.734461 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d7fd3-22e8-4f02-85c9-60497782d5e0 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:00.746688 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d7fd3-22e8-4f02-85c9-60497782d5e0 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:00.875974 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75271c1-fbe5-493e-b05e-7b32193d5c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:00.879748 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75271c1-fbe5-493e-b05e-7b32193d5c5f admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:00.883142 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75271c1-fbe5-493e-b05e-7b32193d5c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:00.884295 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75271c1-fbe5-493e-b05e-7b32193d5c5f admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:00.885397 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75271c1-fbe5-493e-b05e-7b32193d5c5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:00.902787 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75271c1-fbe5-493e-b05e-7b32193d5c5f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:00.947297 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 919/1843] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:00 2022] POST /identity/v3/users => generated 283 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:00.951692 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bede6-b5af-4bdd-8f1f-c56b31a6759c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:00.969436 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bede6-b5af-4bdd-8f1f-c56b31a6759c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:00.975541 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6f32e-5404-4923-9ab5-63c03fbaad1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:00.976261 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6f32e-5404-4923-9ab5-63c03fbaad1f admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:00.976553 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6f32e-5404-4923-9ab5-63c03fbaad1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:00.977295 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6f32e-5404-4923-9ab5-63c03fbaad1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:00.978508 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6f32e-5404-4923-9ab5-63c03fbaad1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:00.980701 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6f32e-5404-4923-9ab5-63c03fbaad1f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:00.996997 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 925/1844] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:00.998738 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75271c1-fbe5-493e-b05e-7b32193d5c5f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:01.018094 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75271c1-fbe5-493e-b05e-7b32193d5c5f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:01.018567 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6f32e-5404-4923-9ab5-63c03fbaad1f admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:01.021741 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ead6f32e-5404-4923-9ab5-63c03fbaad1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:01.026343 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bdae6-682a-4586-a1dd-c7248bae2d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:01.027694 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bdae6-682a-4586-a1dd-c7248bae2d1d admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:01.028171 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bdae6-682a-4586-a1dd-c7248bae2d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:01.028655 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bdae6-682a-4586-a1dd-c7248bae2d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:01.029923 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bdae6-682a-4586-a1dd-c7248bae2d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:01.031550 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bdae6-682a-4586-a1dd-c7248bae2d1d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:01.036807 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6f32e-5404-4923-9ab5-63c03fbaad1f admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:01.043899 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bf405-2391-43db-b352-3af69d852955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:01.044973 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bf405-2391-43db-b352-3af69d852955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:01.045590 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 920/1845] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:01.049744 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bdae6-682a-4586-a1dd-c7248bae2d1d admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:01.049854 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bf405-2391-43db-b352-3af69d852955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:01.050108 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bf405-2391-43db-b352-3af69d852955 admin admin] PATH_INFO: `/v3/projects/5e24782475d24672a0890aea714d18c9` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:01.051522 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bf405-2391-43db-b352-3af69d852955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e24782475d24672a0890aea714d18c9)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:01.054542 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bf405-2391-43db-b352-3af69d852955 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:01.062686 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bdae6-682a-4586-a1dd-c7248bae2d1d admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:01.070957 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06595e6-f011-4003-8a46-9e3254610e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:01.072386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06595e6-f011-4003-8a46-9e3254610e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:01.072875 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06595e6-f011-4003-8a46-9e3254610e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:01.073221 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06595e6-f011-4003-8a46-9e3254610e9c admin admin] PATH_INFO: `/v3/projects/d65e3264fe2542b2aa4c08f6b8b090e8/users/97a144792a9442d6bb9b61d6862bd531/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:01.089952 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06595e6-f011-4003-8a46-9e3254610e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d65e3264fe2542b2aa4c08f6b8b090e8, user_id=97a144792a9442d6bb9b61d6862bd531, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:01.092937 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06595e6-f011-4003-8a46-9e3254610e9c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:01.108409 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 921/1846] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:01 2022] PUT /identity/v3/projects/d65e3264fe2542b2aa4c08f6b8b090e8/users/97a144792a9442d6bb9b61d6862bd531/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:01.118380 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-690bf405-2391-43db-b352-3af69d852955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e24782475d24672a0890aea714d18c9', 'request_id': 'req-690bf405-2391-43db-b352-3af69d852955'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:01.121669 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49115e08-cc2a-469e-8610-fc5290cae958 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:01.122243 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49115e08-cc2a-469e-8610-fc5290cae958 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:01.122833 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49115e08-cc2a-469e-8610-fc5290cae958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:01.129669 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-690bf405-2391-43db-b352-3af69d852955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e24782475d24672a0890aea714d18c9', 'request_id': 'req-690bf405-2391-43db-b352-3af69d852955'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:01.135960 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-690bf405-2391-43db-b352-3af69d852955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e24782475d24672a0890aea714d18c9', 'request_id': 'req-690bf405-2391-43db-b352-3af69d852955'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:01.154704 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-690bf405-2391-43db-b352-3af69d852955 admin admin] The token cache is being invalidate because project 5e24782475d24672a0890aea714d18c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:01.155046 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-690bf405-2391-43db-b352-3af69d852955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:01.160265 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-690bf405-2391-43db-b352-3af69d852955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:01.161419 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-49115e08-cc2a-469e-8610-fc5290cae958 None None] MFA Rules not processed for user `97a144792a9442d6bb9b61d6862bd531`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:01.162829 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-49115e08-cc2a-469e-8610-fc5290cae958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:01.162967 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 926/1847] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:01 2022] DELETE /identity/v3/projects/5e24782475d24672a0890aea714d18c9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:01.167302 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c7ca2-c4af-43e6-9bba-135451b34d54 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:01.167599 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c7ca2-c4af-43e6-9bba-135451b34d54 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:01.167929 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c7ca2-c4af-43e6-9bba-135451b34d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:01.190188 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-378c7ca2-c4af-43e6-9bba-135451b34d54 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:01.193443 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-378c7ca2-c4af-43e6-9bba-135451b34d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:01.250300 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 922/1848] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:01.256485 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49115e08-cc2a-469e-8610-fc5290cae958 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:01.259290 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-49115e08-cc2a-469e-8610-fc5290cae958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:01.273187 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 927/1849] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:01.274524 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49115e08-cc2a-469e-8610-fc5290cae958 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:01.280283 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb5f6c-eff7-484e-9279-bc578a7a15fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:01.281071 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb5f6c-eff7-484e-9279-bc578a7a15fc admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:01.281385 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342ab7d-9956-4ab1-bacb-664ebbe8f0d7 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:01.281580 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb5f6c-eff7-484e-9279-bc578a7a15fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:01.281992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342ab7d-9956-4ab1-bacb-664ebbe8f0d7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:01.282197 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb5f6c-eff7-484e-9279-bc578a7a15fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:01.283390 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb5f6c-eff7-484e-9279-bc578a7a15fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:01.285963 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342ab7d-9956-4ab1-bacb-664ebbe8f0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:01.286940 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb5f6c-eff7-484e-9279-bc578a7a15fc admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:01.312527 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a342ab7d-9956-4ab1-bacb-664ebbe8f0d7 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:01.313844 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a342ab7d-9956-4ab1-bacb-664ebbe8f0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:01.325112 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 928/1850] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:01.328228 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 923/1851] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:01 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:56:01.332234 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb5f6c-eff7-484e-9279-bc578a7a15fc admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:01.332719 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342ab7d-9956-4ab1-bacb-664ebbe8f0d7 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:01.346611 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342ab7d-9956-4ab1-bacb-664ebbe8f0d7 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:01.441742 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c90322-291b-42c2-90bd-43e33d745ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:01.442871 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c90322-291b-42c2-90bd-43e33d745ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:01.444212 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c90322-291b-42c2-90bd-43e33d745ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:01.444667 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c90322-291b-42c2-90bd-43e33d745ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:01.447043 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c90322-291b-42c2-90bd-43e33d745ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:01.448629 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb5f6c-eff7-484e-9279-bc578a7a15fc admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:01.448894 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c90322-291b-42c2-90bd-43e33d745ba6 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:01.455274 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3efe43-223f-4ea6-8860-bb41900a6adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:01.458695 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3efe43-223f-4ea6-8860-bb41900a6adb admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:01.459085 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3efe43-223f-4ea6-8860-bb41900a6adb admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:01.459463 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3efe43-223f-4ea6-8860-bb41900a6adb admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:01.460555 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3efe43-223f-4ea6-8860-bb41900a6adb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:01.464286 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3efe43-223f-4ea6-8860-bb41900a6adb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:01.467383 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3efe43-223f-4ea6-8860-bb41900a6adb admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:01.492094 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 924/1852] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:56:01.492867 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 929/1853] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:01 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:01.503117 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c90322-291b-42c2-90bd-43e33d745ba6 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:01.503316 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3efe43-223f-4ea6-8860-bb41900a6adb admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:01.534739 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3efe43-223f-4ea6-8860-bb41900a6adb admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:01.542992 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1d1f5-e20c-47f1-a912-dda0027699b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:01.543870 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1d1f5-e20c-47f1-a912-dda0027699b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:01.544712 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1d1f5-e20c-47f1-a912-dda0027699b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:01.545304 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1d1f5-e20c-47f1-a912-dda0027699b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:01.546131 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c90322-291b-42c2-90bd-43e33d745ba6 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:01.547361 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1d1f5-e20c-47f1-a912-dda0027699b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:01.550652 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1d1f5-e20c-47f1-a912-dda0027699b1 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:01.559002 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe66ded-c8a2-497f-b845-689884d9b100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:01.560228 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe66ded-c8a2-497f-b845-689884d9b100 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:01.561192 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe66ded-c8a2-497f-b845-689884d9b100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:01.561564 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe66ded-c8a2-497f-b845-689884d9b100 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:01.563150 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe66ded-c8a2-497f-b845-689884d9b100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:01.564983 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe66ded-c8a2-497f-b845-689884d9b100 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:01.589174 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 930/1854] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:01.590434 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe66ded-c8a2-497f-b845-689884d9b100 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:01.593520 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 925/1855] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:01 2022] POST /identity/v3/projects => generated 391 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:01.599497 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1d1f5-e20c-47f1-a912-dda0027699b1 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:01.616826 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe66ded-c8a2-497f-b845-689884d9b100 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:01.709470 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e2818-6dce-4519-8ad8-db050208b3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:01.710607 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e2818-6dce-4519-8ad8-db050208b3a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:01.711002 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e2818-6dce-4519-8ad8-db050208b3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:01.711755 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e2818-6dce-4519-8ad8-db050208b3a6 admin admin] PATH_INFO: `/v3/projects/f11c9592596b4d9390eae2b910dbd1e3/users/7cd08f5abca54659b3fde4c0a12dad22/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:01.724549 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1d1f5-e20c-47f1-a912-dda0027699b1 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:01.729963 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db839f-7e2e-4659-89c8-98cce31c2d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:01.731410 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db839f-7e2e-4659-89c8-98cce31c2d5f admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:01.731776 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db839f-7e2e-4659-89c8-98cce31c2d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:01.732106 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db839f-7e2e-4659-89c8-98cce31c2d5f admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:01.732826 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db839f-7e2e-4659-89c8-98cce31c2d5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:01.733996 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e2818-6dce-4519-8ad8-db050208b3a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f11c9592596b4d9390eae2b910dbd1e3, user_id=7cd08f5abca54659b3fde4c0a12dad22, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:01.735366 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db839f-7e2e-4659-89c8-98cce31c2d5f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:01.737647 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e2818-6dce-4519-8ad8-db050208b3a6 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:01.763222 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 926/1857] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:01 2022] POST /identity/v3/users => generated 296 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:01.765487 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db839f-7e2e-4659-89c8-98cce31c2d5f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:01.767237 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 931/1857] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:01 2022] PUT /identity/v3/projects/f11c9592596b4d9390eae2b910dbd1e3/users/7cd08f5abca54659b3fde4c0a12dad22/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:01.768599 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e2818-6dce-4519-8ad8-db050208b3a6 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:01.777896 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db839f-7e2e-4659-89c8-98cce31c2d5f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:01.854073 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f4b32-9f0d-4520-99a1-87a57a80b5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:01.854618 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e2818-6dce-4519-8ad8-db050208b3a6 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:01.854917 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f4b32-9f0d-4520-99a1-87a57a80b5fc admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:01.855223 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f4b32-9f0d-4520-99a1-87a57a80b5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:01.855665 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f4b32-9f0d-4520-99a1-87a57a80b5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:01.856960 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f4b32-9f0d-4520-99a1-87a57a80b5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:01.858919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f4b32-9f0d-4520-99a1-87a57a80b5fc admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:01.860657 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9179a72-bf51-4666-bbe9-117629a62bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:01.861849 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9179a72-bf51-4666-bbe9-117629a62bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:01.862634 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9179a72-bf51-4666-bbe9-117629a62bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:01.863117 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9179a72-bf51-4666-bbe9-117629a62bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:01.864754 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9179a72-bf51-4666-bbe9-117629a62bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:01.866459 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9179a72-bf51-4666-bbe9-117629a62bb4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:01.875712 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 927/1858] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:56:01.880625 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f4b32-9f0d-4520-99a1-87a57a80b5fc admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:01.884039 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 932/1859] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:01.885432 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff2c0b-ae0f-458b-a018-e7276b38aa8d None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:01.885778 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff2c0b-ae0f-458b-a018-e7276b38aa8d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:01.886214 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff2c0b-ae0f-458b-a018-e7276b38aa8d None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:01.888116 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 933/1860] 10.222.0.67 () {54 vars in 921 bytes} [Mon Apr 11 13:56:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:56:01.888966 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff2c0b-ae0f-458b-a018-e7276b38aa8d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:01.897395 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f4b32-9f0d-4520-99a1-87a57a80b5fc admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:01.905519 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff2c0b-ae0f-458b-a018-e7276b38aa8d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:01.912799 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a2e85-882b-4fa4-b812-8e4bd5b74f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:01.914395 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a2e85-882b-4fa4-b812-8e4bd5b74f4f admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:01.914740 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a2e85-882b-4fa4-b812-8e4bd5b74f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:01.915079 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a2e85-882b-4fa4-b812-8e4bd5b74f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:01.916556 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a2e85-882b-4fa4-b812-8e4bd5b74f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:01.919476 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a2e85-882b-4fa4-b812-8e4bd5b74f4f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:01.921083 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31ff1f-5f1e-43f7-9759-0e4a709c1082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:01.925094 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31ff1f-5f1e-43f7-9759-0e4a709c1082 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:01.925583 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31ff1f-5f1e-43f7-9759-0e4a709c1082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:01.926456 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31ff1f-5f1e-43f7-9759-0e4a709c1082 admin admin] PATH_INFO: `/v3/projects/f11c9592596b4d9390eae2b910dbd1e3/users/7cd08f5abca54659b3fde4c0a12dad22/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:01.932519 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31ff1f-5f1e-43f7-9759-0e4a709c1082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f11c9592596b4d9390eae2b910dbd1e3, user_id=7cd08f5abca54659b3fde4c0a12dad22, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:01.934876 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 934/1861] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:01.936396 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85de875-7f57-4273-bdad-e2f4588d40d7 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:01.936823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85de875-7f57-4273-bdad-e2f4588d40d7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:01.937162 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85de875-7f57-4273-bdad-e2f4588d40d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:01.944657 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31ff1f-5f1e-43f7-9759-0e4a709c1082 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:01.975409 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a85de875-7f57-4273-bdad-e2f4588d40d7 None None] MFA Rules not processed for user `fedd2314dc594bcba749bf7b0d1e50fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:01.976564 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a85de875-7f57-4273-bdad-e2f4588d40d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:01.999859 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 928/1862] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:01 2022] PUT /identity/v3/projects/f11c9592596b4d9390eae2b910dbd1e3/users/7cd08f5abca54659b3fde4c0a12dad22/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:02.001883 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31ff1f-5f1e-43f7-9759-0e4a709c1082 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:02.133761 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 935/1863] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Apr 11 13:56:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:02.135133 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba22067-b05f-4209-b3a6-b98a2227aefe None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:02.136045 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba22067-b05f-4209-b3a6-b98a2227aefe None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:02.136335 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba22067-b05f-4209-b3a6-b98a2227aefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:02.175254 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-bba22067-b05f-4209-b3a6-b98a2227aefe None None] MFA Rules not processed for user `7cd08f5abca54659b3fde4c0a12dad22`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:02.177205 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-bba22067-b05f-4209-b3a6-b98a2227aefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:02.204802 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31ff1f-5f1e-43f7-9759-0e4a709c1082 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:02.221177 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd2b72-78c9-4cb8-8c30-32334337b5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:02.226281 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd2b72-78c9-4cb8-8c30-32334337b5c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:02.226586 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd2b72-78c9-4cb8-8c30-32334337b5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:02.227325 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd2b72-78c9-4cb8-8c30-32334337b5c9 admin admin] PATH_INFO: `/v3/projects/50992da84f4348beb1bc5ce32c1242a2/users/5671359448b04a7e8548adfbfd2a5b72/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:02.277864 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd2b72-78c9-4cb8-8c30-32334337b5c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50992da84f4348beb1bc5ce32c1242a2, user_id=5671359448b04a7e8548adfbfd2a5b72, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:02.283439 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd2b72-78c9-4cb8-8c30-32334337b5c9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:02.306400 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 929/1864] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:01 2022] PUT /identity/v3/projects/50992da84f4348beb1bc5ce32c1242a2/users/5671359448b04a7e8548adfbfd2a5b72/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:02.307315 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd2b72-78c9-4cb8-8c30-32334337b5c9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:02.318042 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-abfd2b72-78c9-4cb8-8c30-32334337b5c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:02.326790 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 936/1865] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:02 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:02.326790 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba22067-b05f-4209-b3a6-b98a2227aefe None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:02.330183 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-bba22067-b05f-4209-b3a6-b98a2227aefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:02.365083 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba22067-b05f-4209-b3a6-b98a2227aefe None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:02.408476 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd2b72-78c9-4cb8-8c30-32334337b5c9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:02.415327 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a784d-2f09-4adb-b876-0fa9bd258073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:02.416626 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a784d-2f09-4adb-b876-0fa9bd258073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:02.416916 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a784d-2f09-4adb-b876-0fa9bd258073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:02.417643 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a784d-2f09-4adb-b876-0fa9bd258073 admin admin] PATH_INFO: `/v3/users/17d5ccda2fc946359bd19ec0af452b1e` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:02.418926 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a784d-2f09-4adb-b876-0fa9bd258073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d5ccda2fc946359bd19ec0af452b1e)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:02.421899 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a784d-2f09-4adb-b876-0fa9bd258073 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:02.462170 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12a107-a2dd-493e-8ed2-ee308b9784c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:02.463450 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12a107-a2dd-493e-8ed2-ee308b9784c6 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:02.463798 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12a107-a2dd-493e-8ed2-ee308b9784c6 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:02.464074 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12a107-a2dd-493e-8ed2-ee308b9784c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:02.478514 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12a107-a2dd-493e-8ed2-ee308b9784c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:02.481419 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12a107-a2dd-493e-8ed2-ee308b9784c6 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:02.494134 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 937/1866] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:02.495462 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0a9f0-ad1d-4212-9fa7-4f6ab747c5a9 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:02.495800 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0a9f0-ad1d-4212-9fa7-4f6ab747c5a9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:02.496084 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0a9f0-ad1d-4212-9fa7-4f6ab747c5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:02.496902 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-9d5a784d-2f09-4adb-b876-0fa9bd258073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d5ccda2fc946359bd19ec0af452b1e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:02.504810 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-9d5a784d-2f09-4adb-b876-0fa9bd258073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d5ccda2fc946359bd19ec0af452b1e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:02.537957 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-9d5a784d-2f09-4adb-b876-0fa9bd258073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d5ccda2fc946359bd19ec0af452b1e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:02.538899 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-9d5a784d-2f09-4adb-b876-0fa9bd258073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d5ccda2fc946359bd19ec0af452b1e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:02.544796 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-9d5a784d-2f09-4adb-b876-0fa9bd258073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d5ccda2fc946359bd19ec0af452b1e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:02.572442 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-88d0a9f0-ad1d-4212-9fa7-4f6ab747c5a9 None None] MFA Rules not processed for user `5671359448b04a7e8548adfbfd2a5b72`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:02.573892 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-88d0a9f0-ad1d-4212-9fa7-4f6ab747c5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:02.591503 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 930/1867] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:02 2022] DELETE /identity/v3/users/17d5ccda2fc946359bd19ec0af452b1e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:02.591503 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a784d-2f09-4adb-b876-0fa9bd258073 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:02.593921 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9d5a784d-2f09-4adb-b876-0fa9bd258073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:02.680427 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 938/1868] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:02.680427 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6e126-daea-4971-95ef-56029911864e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:02.680427 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6e126-daea-4971-95ef-56029911864e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:02.680427 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6e126-daea-4971-95ef-56029911864e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:02.693618 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a784d-2f09-4adb-b876-0fa9bd258073 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:02.699151 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93b1e1-472a-464d-920f-21b69e8c20a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:02.699318 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93b1e1-472a-464d-920f-21b69e8c20a9 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:02.699544 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93b1e1-472a-464d-920f-21b69e8c20a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:02.699984 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93b1e1-472a-464d-920f-21b69e8c20a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:02.700425 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a2d6e126-daea-4971-95ef-56029911864e None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:02.701787 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a2d6e126-daea-4971-95ef-56029911864e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:02.701923 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ad93b1e1-472a-464d-920f-21b69e8c20a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:02.773226 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 939/1869] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:02.774282 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6e126-daea-4971-95ef-56029911864e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:02.775757 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a2d6e126-daea-4971-95ef-56029911864e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:02.782667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93b1e1-472a-464d-920f-21b69e8c20a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:02.784175 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93b1e1-472a-464d-920f-21b69e8c20a9 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:02.788298 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6e126-daea-4971-95ef-56029911864e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:02.793260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f30cd-4e16-499b-a513-68de393335e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:02.793926 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f30cd-4e16-499b-a513-68de393335e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:02.794214 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f30cd-4e16-499b-a513-68de393335e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:02.794487 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f30cd-4e16-499b-a513-68de393335e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:02.795212 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f30cd-4e16-499b-a513-68de393335e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:02.795325 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 931/1870] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:02 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:02.796058 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93b1e1-472a-464d-920f-21b69e8c20a9 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:02.797442 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f30cd-4e16-499b-a513-68de393335e4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:02.797566 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ad93b1e1-472a-464d-920f-21b69e8c20a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:02.828176 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 940/1871] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:02 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:02.829421 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f30cd-4e16-499b-a513-68de393335e4 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:02.862230 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93b1e1-472a-464d-920f-21b69e8c20a9 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:02.915612 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f30cd-4e16-499b-a513-68de393335e4 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:02.920413 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa81acc-2c5a-4821-940e-9b51506a76b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:02.921049 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa81acc-2c5a-4821-940e-9b51506a76b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:02.921304 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa81acc-2c5a-4821-940e-9b51506a76b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:02.921582 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa81acc-2c5a-4821-940e-9b51506a76b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:02.922271 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa81acc-2c5a-4821-940e-9b51506a76b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:02.922608 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb430f5-69a1-4dba-9901-7c1fbb8d0948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:02.923808 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb430f5-69a1-4dba-9901-7c1fbb8d0948 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:02.923808 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb430f5-69a1-4dba-9901-7c1fbb8d0948 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:02.924265 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb430f5-69a1-4dba-9901-7c1fbb8d0948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:02.924497 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa81acc-2c5a-4821-940e-9b51506a76b7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:02.934619 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb430f5-69a1-4dba-9901-7c1fbb8d0948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:02.936108 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb430f5-69a1-4dba-9901-7c1fbb8d0948 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:02.947828 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 941/1872] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:02 2022] POST /identity/v3/users => generated 303 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:02.948669 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa81acc-2c5a-4821-940e-9b51506a76b7 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:02.950914 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 932/1873] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:02.951791 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb430f5-69a1-4dba-9901-7c1fbb8d0948 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:02.964331 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb430f5-69a1-4dba-9901-7c1fbb8d0948 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:02.969474 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994c8fa-a64c-485d-831e-3b52f7efc3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:02.970149 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994c8fa-a64c-485d-831e-3b52f7efc3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:02.970982 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994c8fa-a64c-485d-831e-3b52f7efc3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:02.971271 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994c8fa-a64c-485d-831e-3b52f7efc3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:02.972099 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994c8fa-a64c-485d-831e-3b52f7efc3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:02.975286 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994c8fa-a64c-485d-831e-3b52f7efc3d5 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:02.987466 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 933/1874] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:02.991776 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994c8fa-a64c-485d-831e-3b52f7efc3d5 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:03.005347 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994c8fa-a64c-485d-831e-3b52f7efc3d5 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:03.012171 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce8633-9d69-4182-9c3f-b7ab43eb9b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:03.013790 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce8633-9d69-4182-9c3f-b7ab43eb9b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:03.014091 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce8633-9d69-4182-9c3f-b7ab43eb9b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:03.014395 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce8633-9d69-4182-9c3f-b7ab43eb9b9c admin admin] PATH_INFO: `/v3/projects/5dc39530e0194ea6b7544f5fb649325b/users/62d7d41f0ec641b49b62544f0b0b99b1/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:03.033974 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce8633-9d69-4182-9c3f-b7ab43eb9b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc39530e0194ea6b7544f5fb649325b, user_id=62d7d41f0ec641b49b62544f0b0b99b1, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:03.038474 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce8633-9d69-4182-9c3f-b7ab43eb9b9c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:03.040722 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa81acc-2c5a-4821-940e-9b51506a76b7 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:03.047285 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ef50f-1bf6-4f07-9533-a44f63194c81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:03.049292 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ef50f-1bf6-4f07-9533-a44f63194c81 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:03.049404 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ef50f-1bf6-4f07-9533-a44f63194c81 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:03.049690 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ef50f-1bf6-4f07-9533-a44f63194c81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:03.051918 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3e9ef50f-1bf6-4f07-9533-a44f63194c81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:03.063545 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 934/1875] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:02 2022] PUT /identity/v3/projects/5dc39530e0194ea6b7544f5fb649325b/users/62d7d41f0ec641b49b62544f0b0b99b1/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:03.067765 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce8633-9d69-4182-9c3f-b7ab43eb9b9c admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:03.152723 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce8633-9d69-4182-9c3f-b7ab43eb9b9c admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:03.155585 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ef50f-1bf6-4f07-9533-a44f63194c81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:03.157308 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ef50f-1bf6-4f07-9533-a44f63194c81 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:03.160736 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af149a8-efbc-429d-976e-7347edb07d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:03.161507 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af149a8-efbc-429d-976e-7347edb07d71 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:03.161920 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af149a8-efbc-429d-976e-7347edb07d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:03.162161 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af149a8-efbc-429d-976e-7347edb07d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:03.162930 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af149a8-efbc-429d-976e-7347edb07d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:03.164610 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af149a8-efbc-429d-976e-7347edb07d71 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:03.167020 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 942/1876] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:02 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:03.177476 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 935/1877] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:03.181398 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ef50f-1bf6-4f07-9533-a44f63194c81 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:03.193295 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ef50f-1bf6-4f07-9533-a44f63194c81 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:03.198147 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be92736-949f-41e7-941a-84c542e31942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:03.199177 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be92736-949f-41e7-941a-84c542e31942 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:03.199538 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be92736-949f-41e7-941a-84c542e31942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:03.200519 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be92736-949f-41e7-941a-84c542e31942 admin admin] PATH_INFO: `/v3/projects/5dc39530e0194ea6b7544f5fb649325b/users/62d7d41f0ec641b49b62544f0b0b99b1/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:03.203465 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be92736-949f-41e7-941a-84c542e31942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc39530e0194ea6b7544f5fb649325b, user_id=62d7d41f0ec641b49b62544f0b0b99b1, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:03.206247 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be92736-949f-41e7-941a-84c542e31942 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:03.223319 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 943/1878] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:03 2022] PUT /identity/v3/projects/5dc39530e0194ea6b7544f5fb649325b/users/62d7d41f0ec641b49b62544f0b0b99b1/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:03.231383 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a1f41-254a-40a3-a9b4-78ddc6d21ce5 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:03.231934 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a1f41-254a-40a3-a9b4-78ddc6d21ce5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:03.232459 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a1f41-254a-40a3-a9b4-78ddc6d21ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:03.316016 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-7a6a1f41-254a-40a3-a9b4-78ddc6d21ce5 None None] MFA Rules not processed for user `62d7d41f0ec641b49b62544f0b0b99b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:03.317447 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7a6a1f41-254a-40a3-a9b4-78ddc6d21ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:03.362704 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be92736-949f-41e7-941a-84c542e31942 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:03.365990 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3be92736-949f-41e7-941a-84c542e31942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:03.510307 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 936/1879] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:03.552986 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be92736-949f-41e7-941a-84c542e31942 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:03.576157 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bdb69-8e26-4cc3-8f5c-aa76b412ab45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:03.577192 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bdb69-8e26-4cc3-8f5c-aa76b412ab45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:03.577304 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bdb69-8e26-4cc3-8f5c-aa76b412ab45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:03.577592 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bdb69-8e26-4cc3-8f5c-aa76b412ab45 admin admin] PATH_INFO: `/v3/projects/dbb89c8b40734234b2f9b8a79f6729e3` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:03.579057 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bdb69-8e26-4cc3-8f5c-aa76b412ab45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbb89c8b40734234b2f9b8a79f6729e3)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:03.580787 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bdb69-8e26-4cc3-8f5c-aa76b412ab45 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:03.594256 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a1f41-254a-40a3-a9b4-78ddc6d21ce5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:03.597120 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7a6a1f41-254a-40a3-a9b4-78ddc6d21ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:03.689741 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-888bdb69-8e26-4cc3-8f5c-aa76b412ab45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbb89c8b40734234b2f9b8a79f6729e3', 'request_id': 'req-888bdb69-8e26-4cc3-8f5c-aa76b412ab45'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:03.697594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-888bdb69-8e26-4cc3-8f5c-aa76b412ab45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbb89c8b40734234b2f9b8a79f6729e3', 'request_id': 'req-888bdb69-8e26-4cc3-8f5c-aa76b412ab45'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:03.716537 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a1f41-254a-40a3-a9b4-78ddc6d21ce5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:03.720250 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-888bdb69-8e26-4cc3-8f5c-aa76b412ab45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbb89c8b40734234b2f9b8a79f6729e3', 'request_id': 'req-888bdb69-8e26-4cc3-8f5c-aa76b412ab45'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:03.746939 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-888bdb69-8e26-4cc3-8f5c-aa76b412ab45 admin admin] The token cache is being invalidate because project dbb89c8b40734234b2f9b8a79f6729e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:03.748224 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-888bdb69-8e26-4cc3-8f5c-aa76b412ab45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:03.748894 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-888bdb69-8e26-4cc3-8f5c-aa76b412ab45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:03.753202 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 944/1880] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:03 2022] DELETE /identity/v3/projects/dbb89c8b40734234b2f9b8a79f6729e3 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:03.757899 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bdb69-8e26-4cc3-8f5c-aa76b412ab45 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:03.760618 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-888bdb69-8e26-4cc3-8f5c-aa76b412ab45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:03.817942 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22e5e5-3506-442a-beec-83a37c7394c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:03.818837 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22e5e5-3506-442a-beec-83a37c7394c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:03.819116 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22e5e5-3506-442a-beec-83a37c7394c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:03.820139 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f22e5e5-3506-442a-beec-83a37c7394c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:03.822276 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4f22e5e5-3506-442a-beec-83a37c7394c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:03.892719 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bdb69-8e26-4cc3-8f5c-aa76b412ab45 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:03.898635 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e33918-1f23-4710-afba-89c141622860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:03.899660 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e33918-1f23-4710-afba-89c141622860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:03.900101 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e33918-1f23-4710-afba-89c141622860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:03.900366 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e33918-1f23-4710-afba-89c141622860 admin admin] PATH_INFO: `/v3/users/6e40477bd9ea49d5acafcfbc8da90d81` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:03.901735 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e33918-1f23-4710-afba-89c141622860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e40477bd9ea49d5acafcfbc8da90d81)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:03.903798 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e33918-1f23-4710-afba-89c141622860 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:03.915110 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22e5e5-3506-442a-beec-83a37c7394c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:03.917238 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f22e5e5-3506-442a-beec-83a37c7394c3 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:03.935603 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 937/1881] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:04.013552 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-74e33918-1f23-4710-afba-89c141622860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e40477bd9ea49d5acafcfbc8da90d81'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:04.014518 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-74e33918-1f23-4710-afba-89c141622860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e40477bd9ea49d5acafcfbc8da90d81'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:04.033794 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22e5e5-3506-442a-beec-83a37c7394c3 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:04.037036 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4f22e5e5-3506-442a-beec-83a37c7394c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:04.037298 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-74e33918-1f23-4710-afba-89c141622860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e40477bd9ea49d5acafcfbc8da90d81'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:04.051726 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f22e5e5-3506-442a-beec-83a37c7394c3 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:04.056907 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fffc09-0701-4873-99bf-4c79a121a165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:04.058833 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-74e33918-1f23-4710-afba-89c141622860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e40477bd9ea49d5acafcfbc8da90d81'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:04.059755 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-74e33918-1f23-4710-afba-89c141622860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e40477bd9ea49d5acafcfbc8da90d81'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:04.062578 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fffc09-0701-4873-99bf-4c79a121a165 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:04.062578 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fffc09-0701-4873-99bf-4c79a121a165 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:04.062766 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fffc09-0701-4873-99bf-4c79a121a165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:04.067755 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a4fffc09-0701-4873-99bf-4c79a121a165 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:04.085220 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 945/1882] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:03 2022] DELETE /identity/v3/users/6e40477bd9ea49d5acafcfbc8da90d81 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:04.159873 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fffc09-0701-4873-99bf-4c79a121a165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:04.161834 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fffc09-0701-4873-99bf-4c79a121a165 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:04.177576 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 938/1883] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:04.434779 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e33918-1f23-4710-afba-89c141622860 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:04.436950 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-74e33918-1f23-4710-afba-89c141622860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:04.533122 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e33918-1f23-4710-afba-89c141622860 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:04.547377 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e7061-fa79-4b14-a810-6218c8542669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:04.549523 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e7061-fa79-4b14-a810-6218c8542669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:04.550160 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e7061-fa79-4b14-a810-6218c8542669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:04.550697 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e7061-fa79-4b14-a810-6218c8542669 admin admin] PATH_INFO: `/v3/projects/b190e773912c4f7e88291e2faad047ca` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:04.553014 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e7061-fa79-4b14-a810-6218c8542669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b190e773912c4f7e88291e2faad047ca)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:04.555847 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88e7061-fa79-4b14-a810-6218c8542669 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:04.623657 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e88e7061-fa79-4b14-a810-6218c8542669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b190e773912c4f7e88291e2faad047ca', 'request_id': 'req-e88e7061-fa79-4b14-a810-6218c8542669'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:04.630863 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e88e7061-fa79-4b14-a810-6218c8542669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b190e773912c4f7e88291e2faad047ca', 'request_id': 'req-e88e7061-fa79-4b14-a810-6218c8542669'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:04.637187 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e88e7061-fa79-4b14-a810-6218c8542669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b190e773912c4f7e88291e2faad047ca', 'request_id': 'req-e88e7061-fa79-4b14-a810-6218c8542669'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:04.655744 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e88e7061-fa79-4b14-a810-6218c8542669 admin admin] The token cache is being invalidate because project b190e773912c4f7e88291e2faad047ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:04.656053 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e88e7061-fa79-4b14-a810-6218c8542669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:04.656806 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e88e7061-fa79-4b14-a810-6218c8542669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:04.658687 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 946/1884] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:04 2022] DELETE /identity/v3/projects/b190e773912c4f7e88291e2faad047ca => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:04.663779 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5b285-43eb-470a-b85b-e6b3aae9bae3 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:04.664127 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5b285-43eb-470a-b85b-e6b3aae9bae3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:04.664465 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5b285-43eb-470a-b85b-e6b3aae9bae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:04.685504 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-aaa5b285-43eb-470a-b85b-e6b3aae9bae3 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:04.687060 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-aaa5b285-43eb-470a-b85b-e6b3aae9bae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:04.754151 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 939/1885] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:04.756154 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3312c0-65e1-438a-9de5-afd12dacd803 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:04.756450 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3312c0-65e1-438a-9de5-afd12dacd803 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:04.757225 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3312c0-65e1-438a-9de5-afd12dacd803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:04.776266 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-2b3312c0-65e1-438a-9de5-afd12dacd803 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:04.777469 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2b3312c0-65e1-438a-9de5-afd12dacd803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:04.786491 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 947/1886] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:04.790747 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5b285-43eb-470a-b85b-e6b3aae9bae3 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:04.800463 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5b285-43eb-470a-b85b-e6b3aae9bae3 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:04.805785 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed01c5e-d5df-4856-a4ec-b2032b32a0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:04.806468 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed01c5e-d5df-4856-a4ec-b2032b32a0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:04.806745 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed01c5e-d5df-4856-a4ec-b2032b32a0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:04.807016 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed01c5e-d5df-4856-a4ec-b2032b32a0f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:04.807780 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed01c5e-d5df-4856-a4ec-b2032b32a0f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:04.808085 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed01c5e-d5df-4856-a4ec-b2032b32a0f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:04.809703 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed01c5e-d5df-4856-a4ec-b2032b32a0f4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:04.821931 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 940/1887] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:56:04.826274 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3312c0-65e1-438a-9de5-afd12dacd803 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:04.835664 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3312c0-65e1-438a-9de5-afd12dacd803 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:04.840282 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfacd0-118c-431c-98be-7548b41ef8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:04.840940 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfacd0-118c-431c-98be-7548b41ef8dc admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:04.841224 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfacd0-118c-431c-98be-7548b41ef8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:04.841500 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfacd0-118c-431c-98be-7548b41ef8dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:04.842217 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfacd0-118c-431c-98be-7548b41ef8dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:04.844134 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfacd0-118c-431c-98be-7548b41ef8dc admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:04.872371 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 948/1888] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:04 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:04.876459 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed01c5e-d5df-4856-a4ec-b2032b32a0f4 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:04.886621 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed01c5e-d5df-4856-a4ec-b2032b32a0f4 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:04.940838 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e9530-1d10-451b-af53-da5e42df6b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:04.941535 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e9530-1d10-451b-af53-da5e42df6b87 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:04.941899 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e9530-1d10-451b-af53-da5e42df6b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:04.942177 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e9530-1d10-451b-af53-da5e42df6b87 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:04.942860 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e9530-1d10-451b-af53-da5e42df6b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:04.944801 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e9530-1d10-451b-af53-da5e42df6b87 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:04.964580 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 941/1889] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:04 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:56:04.968557 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfacd0-118c-431c-98be-7548b41ef8dc admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:04.979602 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfacd0-118c-431c-98be-7548b41ef8dc admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:04.984315 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea009e-2640-4902-8cda-8eea62f281ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:04.984985 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea009e-2640-4902-8cda-8eea62f281ac admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:04.985263 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea009e-2640-4902-8cda-8eea62f281ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:04.985539 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea009e-2640-4902-8cda-8eea62f281ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:04.986263 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea009e-2640-4902-8cda-8eea62f281ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:04.987946 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea009e-2640-4902-8cda-8eea62f281ac admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:05.001959 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 949/1890] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:56:05.002912 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e9530-1d10-451b-af53-da5e42df6b87 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:05.013885 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e9530-1d10-451b-af53-da5e42df6b87 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:05.019026 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e228ed-0400-4b3b-a3f5-41dfd7d1f092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:05.020529 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e228ed-0400-4b3b-a3f5-41dfd7d1f092 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:05.020759 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e228ed-0400-4b3b-a3f5-41dfd7d1f092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:05.021227 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e228ed-0400-4b3b-a3f5-41dfd7d1f092 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:05.022172 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e228ed-0400-4b3b-a3f5-41dfd7d1f092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:05.027327 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e228ed-0400-4b3b-a3f5-41dfd7d1f092 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:05.036593 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 942/1891] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:56:05.040911 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea009e-2640-4902-8cda-8eea62f281ac admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:05.051457 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea009e-2640-4902-8cda-8eea62f281ac admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:05.056188 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6822e-beff-45a1-a3ad-40d6b4483233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:05.057235 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6822e-beff-45a1-a3ad-40d6b4483233 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:05.057642 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6822e-beff-45a1-a3ad-40d6b4483233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:05.058016 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6822e-beff-45a1-a3ad-40d6b4483233 admin admin] PATH_INFO: `/v3/projects/83198ec40e634c7db215ce1a23cd41b5/users/b38a3533d9f741f3af1942117b5179fd/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:05.073711 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6822e-beff-45a1-a3ad-40d6b4483233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83198ec40e634c7db215ce1a23cd41b5, user_id=b38a3533d9f741f3af1942117b5179fd, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:05.076459 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6822e-beff-45a1-a3ad-40d6b4483233 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:05.094177 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 950/1892] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:05 2022] PUT /identity/v3/projects/83198ec40e634c7db215ce1a23cd41b5/users/b38a3533d9f741f3af1942117b5179fd/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:05.108512 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853f371-c521-4ba2-9a48-969465ac2a70 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:05.108813 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853f371-c521-4ba2-9a48-969465ac2a70 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:05.109077 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853f371-c521-4ba2-9a48-969465ac2a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:05.137392 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-f853f371-c521-4ba2-9a48-969465ac2a70 None None] MFA Rules not processed for user `b38a3533d9f741f3af1942117b5179fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:05.138879 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f853f371-c521-4ba2-9a48-969465ac2a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:05.208870 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 943/1893] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:05.219491 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6822e-beff-45a1-a3ad-40d6b4483233 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:05.221613 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b5c6822e-beff-45a1-a3ad-40d6b4483233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:05.284471 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6822e-beff-45a1-a3ad-40d6b4483233 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:05.289023 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d17d2-9495-44f4-bf18-1d860af253ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:05.289689 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d17d2-9495-44f4-bf18-1d860af253ad service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:05.289961 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d17d2-9495-44f4-bf18-1d860af253ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:05.290241 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d17d2-9495-44f4-bf18-1d860af253ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:05.298340 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d17d2-9495-44f4-bf18-1d860af253ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:05.300091 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d17d2-9495-44f4-bf18-1d860af253ad service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:05.309461 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 951/1894] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:10.982619 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853f371-c521-4ba2-9a48-969465ac2a70 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:10.985349 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f853f371-c521-4ba2-9a48-969465ac2a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:10.998493 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d17d2-9495-44f4-bf18-1d860af253ad service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:11.080088 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853f371-c521-4ba2-9a48-969465ac2a70 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:11.086990 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc486ee-027e-45fd-bb47-1560eca69235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:11.088610 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc486ee-027e-45fd-bb47-1560eca69235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:11.088819 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc486ee-027e-45fd-bb47-1560eca69235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:11.089163 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc486ee-027e-45fd-bb47-1560eca69235 admin admin] PATH_INFO: `/v3/users/5671359448b04a7e8548adfbfd2a5b72` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:11.090745 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc486ee-027e-45fd-bb47-1560eca69235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5671359448b04a7e8548adfbfd2a5b72)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:11.093604 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc486ee-027e-45fd-bb47-1560eca69235 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:11.134220 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d17d2-9495-44f4-bf18-1d860af253ad service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:11.153349 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa4a5b-d54a-40e9-ab95-4479a54197aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:11.154328 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa4a5b-d54a-40e9-ab95-4479a54197aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:11.154767 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa4a5b-d54a-40e9-ab95-4479a54197aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:11.155778 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa4a5b-d54a-40e9-ab95-4479a54197aa admin admin] PATH_INFO: `/v3/users/b38a3533d9f741f3af1942117b5179fd` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:11.163434 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa4a5b-d54a-40e9-ab95-4479a54197aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b38a3533d9f741f3af1942117b5179fd)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:11.172278 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa4a5b-d54a-40e9-ab95-4479a54197aa admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:11.199963 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2dc486ee-027e-45fd-bb47-1560eca69235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5671359448b04a7e8548adfbfd2a5b72'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:11.207585 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2dc486ee-027e-45fd-bb47-1560eca69235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5671359448b04a7e8548adfbfd2a5b72'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:11.216672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2dc486ee-027e-45fd-bb47-1560eca69235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5671359448b04a7e8548adfbfd2a5b72'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:11.217396 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2dc486ee-027e-45fd-bb47-1560eca69235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5671359448b04a7e8548adfbfd2a5b72'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:11.218013 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2dc486ee-027e-45fd-bb47-1560eca69235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5671359448b04a7e8548adfbfd2a5b72'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:11.238314 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-36aa4a5b-d54a-40e9-ab95-4479a54197aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b38a3533d9f741f3af1942117b5179fd'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:11.238945 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-36aa4a5b-d54a-40e9-ab95-4479a54197aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b38a3533d9f741f3af1942117b5179fd'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:11.239709 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 944/1895] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:10 2022] DELETE /identity/v3/users/5671359448b04a7e8548adfbfd2a5b72 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:11.240701 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc486ee-027e-45fd-bb47-1560eca69235 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:11.242093 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2dc486ee-027e-45fd-bb47-1560eca69235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:11.248772 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-36aa4a5b-d54a-40e9-ab95-4479a54197aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b38a3533d9f741f3af1942117b5179fd'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:11.260755 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-36aa4a5b-d54a-40e9-ab95-4479a54197aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b38a3533d9f741f3af1942117b5179fd'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:11.262188 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-36aa4a5b-d54a-40e9-ab95-4479a54197aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b38a3533d9f741f3af1942117b5179fd'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:11.281984 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 952/1896] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:10 2022] DELETE /identity/v3/users/b38a3533d9f741f3af1942117b5179fd => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:11.283772 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bf8dc-c90b-4f1c-aa51-770d1d1c45ce None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:11.283870 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bf8dc-c90b-4f1c-aa51-770d1d1c45ce None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:11.284135 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bf8dc-c90b-4f1c-aa51-770d1d1c45ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:11.303980 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-bf5bf8dc-c90b-4f1c-aa51-770d1d1c45ce None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:11.305190 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-bf5bf8dc-c90b-4f1c-aa51-770d1d1c45ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:11.320787 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc486ee-027e-45fd-bb47-1560eca69235 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:11.375985 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 953/1897] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:11.375985 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bb0bf-400e-4e80-8d05-f1cf1e406d39 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:11.375985 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bb0bf-400e-4e80-8d05-f1cf1e406d39 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:11.375985 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bb0bf-400e-4e80-8d05-f1cf1e406d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:11.397482 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a49d17-ec1a-403f-b42f-0d8ced05b99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:11.398124 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-1e0bb0bf-400e-4e80-8d05-f1cf1e406d39 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:11.398553 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a49d17-ec1a-403f-b42f-0d8ced05b99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:11.398920 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a49d17-ec1a-403f-b42f-0d8ced05b99d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:11.399661 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a49d17-ec1a-403f-b42f-0d8ced05b99d admin admin] PATH_INFO: `/v3/users/97a144792a9442d6bb9b61d6862bd531` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:11.399778 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1e0bb0bf-400e-4e80-8d05-f1cf1e406d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:11.400833 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a49d17-ec1a-403f-b42f-0d8ced05b99d admin admin] RBAC: Authorizing `identity:delete_user(user_id=97a144792a9442d6bb9b61d6862bd531)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:11.403776 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a49d17-ec1a-403f-b42f-0d8ced05b99d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:11.408754 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 954/1898] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:11.410402 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bb0bf-400e-4e80-8d05-f1cf1e406d39 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:11.412006 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1e0bb0bf-400e-4e80-8d05-f1cf1e406d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:11.468984 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-18a49d17-ec1a-403f-b42f-0d8ced05b99d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97a144792a9442d6bb9b61d6862bd531'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:11.477820 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-18a49d17-ec1a-403f-b42f-0d8ced05b99d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97a144792a9442d6bb9b61d6862bd531'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:11.489198 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-18a49d17-ec1a-403f-b42f-0d8ced05b99d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97a144792a9442d6bb9b61d6862bd531'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:11.490037 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-18a49d17-ec1a-403f-b42f-0d8ced05b99d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97a144792a9442d6bb9b61d6862bd531'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:11.490847 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-18a49d17-ec1a-403f-b42f-0d8ced05b99d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97a144792a9442d6bb9b61d6862bd531'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:11.496682 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bb0bf-400e-4e80-8d05-f1cf1e406d39 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:11.501161 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7620d-9244-46a9-86e8-428a50408cd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:11.501920 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7620d-9244-46a9-86e8-428a50408cd4 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:11.502301 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7620d-9244-46a9-86e8-428a50408cd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:11.502673 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7620d-9244-46a9-86e8-428a50408cd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:11.505645 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-cdf7620d-9244-46a9-86e8-428a50408cd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:11.516656 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 945/1899] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:11 2022] DELETE /identity/v3/users/97a144792a9442d6bb9b61d6862bd531 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:11.517730 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a49d17-ec1a-403f-b42f-0d8ced05b99d admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:11.519400 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7620d-9244-46a9-86e8-428a50408cd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:11.520225 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-18a49d17-ec1a-403f-b42f-0d8ced05b99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:11.521553 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7620d-9244-46a9-86e8-428a50408cd4 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:11.547938 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 955/1900] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:11.549814 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ef470-a5c6-4bb7-af57-19a8247ea72f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:11.550324 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ef470-a5c6-4bb7-af57-19a8247ea72f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:11.550708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ef470-a5c6-4bb7-af57-19a8247ea72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:11.583722 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-353ef470-a5c6-4bb7-af57-19a8247ea72f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:11.585897 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-353ef470-a5c6-4bb7-af57-19a8247ea72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:11.625985 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a49d17-ec1a-403f-b42f-0d8ced05b99d admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:11.633949 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c82ad-4868-48fe-aa25-704481215788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:11.636681 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c82ad-4868-48fe-aa25-704481215788 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:11.636970 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c82ad-4868-48fe-aa25-704481215788 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:11.637436 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c82ad-4868-48fe-aa25-704481215788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:11.639562 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a87c82ad-4868-48fe-aa25-704481215788 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:11.735440 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c82ad-4868-48fe-aa25-704481215788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:11.738139 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c82ad-4868-48fe-aa25-704481215788 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:11.743745 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 956/1901] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:11.751975 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 946/1902] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:11.755493 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ef470-a5c6-4bb7-af57-19a8247ea72f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:11.756883 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-353ef470-a5c6-4bb7-af57-19a8247ea72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:11.782507 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ef470-a5c6-4bb7-af57-19a8247ea72f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:11.792336 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3881fbc-9f43-4d9a-a53d-d2786abf2ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:11.793860 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3881fbc-9f43-4d9a-a53d-d2786abf2ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:11.794494 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3881fbc-9f43-4d9a-a53d-d2786abf2ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:11.794971 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3881fbc-9f43-4d9a-a53d-d2786abf2ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:11.810533 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3881fbc-9f43-4d9a-a53d-d2786abf2ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:11.812217 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3881fbc-9f43-4d9a-a53d-d2786abf2ff5 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:11.833891 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 957/1903] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:56:12.083957 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c82ad-4868-48fe-aa25-704481215788 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:12.085376 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a87c82ad-4868-48fe-aa25-704481215788 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:12.097572 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c82ad-4868-48fe-aa25-704481215788 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:12.102695 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9d4ec-8021-4fee-b522-9c70560608f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:12.103575 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9d4ec-8021-4fee-b522-9c70560608f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:12.103812 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9d4ec-8021-4fee-b522-9c70560608f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:12.104082 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9d4ec-8021-4fee-b522-9c70560608f4 admin admin] PATH_INFO: `/v3/projects/50992da84f4348beb1bc5ce32c1242a2` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:12.105306 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9d4ec-8021-4fee-b522-9c70560608f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50992da84f4348beb1bc5ce32c1242a2)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:12.107237 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9d4ec-8021-4fee-b522-9c70560608f4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:12.179682 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-91b9d4ec-8021-4fee-b522-9c70560608f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50992da84f4348beb1bc5ce32c1242a2', 'request_id': 'req-91b9d4ec-8021-4fee-b522-9c70560608f4'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:12.187699 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-91b9d4ec-8021-4fee-b522-9c70560608f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50992da84f4348beb1bc5ce32c1242a2', 'request_id': 'req-91b9d4ec-8021-4fee-b522-9c70560608f4'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:12.196139 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-91b9d4ec-8021-4fee-b522-9c70560608f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50992da84f4348beb1bc5ce32c1242a2', 'request_id': 'req-91b9d4ec-8021-4fee-b522-9c70560608f4'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:12.220434 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-91b9d4ec-8021-4fee-b522-9c70560608f4 admin admin] The token cache is being invalidate because project 50992da84f4348beb1bc5ce32c1242a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:12.220722 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-91b9d4ec-8021-4fee-b522-9c70560608f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:12.223015 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-91b9d4ec-8021-4fee-b522-9c70560608f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:12.226298 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 947/1904] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:12 2022] DELETE /identity/v3/projects/50992da84f4348beb1bc5ce32c1242a2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:12.230899 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3881fbc-9f43-4d9a-a53d-d2786abf2ff5 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:12.250321 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3881fbc-9f43-4d9a-a53d-d2786abf2ff5 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:12.344399 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0550a2-d6d8-48b8-888c-6ded02d70e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:12.345436 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0550a2-d6d8-48b8-888c-6ded02d70e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:12.347400 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0550a2-d6d8-48b8-888c-6ded02d70e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:12.355276 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9d4ec-8021-4fee-b522-9c70560608f4 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:12.357999 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-91b9d4ec-8021-4fee-b522-9c70560608f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:12.358126 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0550a2-d6d8-48b8-888c-6ded02d70e8c admin admin] PATH_INFO: `/v3/users/62d7d41f0ec641b49b62544f0b0b99b1` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:12.365118 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0550a2-d6d8-48b8-888c-6ded02d70e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=62d7d41f0ec641b49b62544f0b0b99b1)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:12.371028 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0550a2-d6d8-48b8-888c-6ded02d70e8c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:12.376470 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9d4ec-8021-4fee-b522-9c70560608f4 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:12.391976 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe19481-c1a2-473e-ad5d-6bb2558ad537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:12.392926 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe19481-c1a2-473e-ad5d-6bb2558ad537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:12.393215 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe19481-c1a2-473e-ad5d-6bb2558ad537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:12.393501 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe19481-c1a2-473e-ad5d-6bb2558ad537 admin admin] PATH_INFO: `/v3/projects/83198ec40e634c7db215ce1a23cd41b5` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:12.396594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe19481-c1a2-473e-ad5d-6bb2558ad537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83198ec40e634c7db215ce1a23cd41b5)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:12.400963 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe19481-c1a2-473e-ad5d-6bb2558ad537 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:12.507465 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6b0550a2-d6d8-48b8-888c-6ded02d70e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62d7d41f0ec641b49b62544f0b0b99b1'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:12.508260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6b0550a2-d6d8-48b8-888c-6ded02d70e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62d7d41f0ec641b49b62544f0b0b99b1'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:12.521633 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6b0550a2-d6d8-48b8-888c-6ded02d70e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62d7d41f0ec641b49b62544f0b0b99b1'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:12.546105 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6b0550a2-d6d8-48b8-888c-6ded02d70e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62d7d41f0ec641b49b62544f0b0b99b1'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:12.546999 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6b0550a2-d6d8-48b8-888c-6ded02d70e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62d7d41f0ec641b49b62544f0b0b99b1'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:12.561602 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-abe19481-c1a2-473e-ad5d-6bb2558ad537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83198ec40e634c7db215ce1a23cd41b5', 'request_id': 'req-abe19481-c1a2-473e-ad5d-6bb2558ad537'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:12.577802 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 958/1905] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:12 2022] DELETE /identity/v3/users/62d7d41f0ec641b49b62544f0b0b99b1 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:12.579744 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-abe19481-c1a2-473e-ad5d-6bb2558ad537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83198ec40e634c7db215ce1a23cd41b5', 'request_id': 'req-abe19481-c1a2-473e-ad5d-6bb2558ad537'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:12.579993 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0550a2-d6d8-48b8-888c-6ded02d70e8c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:12.582271 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6b0550a2-d6d8-48b8-888c-6ded02d70e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:12.602006 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-abe19481-c1a2-473e-ad5d-6bb2558ad537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83198ec40e634c7db215ce1a23cd41b5', 'request_id': 'req-abe19481-c1a2-473e-ad5d-6bb2558ad537'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:12.623408 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-abe19481-c1a2-473e-ad5d-6bb2558ad537 admin admin] The token cache is being invalidate because project 83198ec40e634c7db215ce1a23cd41b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:12.623737 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-abe19481-c1a2-473e-ad5d-6bb2558ad537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:12.624718 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-abe19481-c1a2-473e-ad5d-6bb2558ad537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:12.629757 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 948/1906] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:12 2022] DELETE /identity/v3/projects/83198ec40e634c7db215ce1a23cd41b5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:12.632896 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9991b-220c-4547-b2cc-d0459112b6e3 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:12.633199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9991b-220c-4547-b2cc-d0459112b6e3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:12.633481 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9991b-220c-4547-b2cc-d0459112b6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:12.686172 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-04d9991b-220c-4547-b2cc-d0459112b6e3 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:12.687509 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-04d9991b-220c-4547-b2cc-d0459112b6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:12.691248 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0550a2-d6d8-48b8-888c-6ded02d70e8c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:12.700409 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 949/1907] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:12.708169 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57edc8-8c97-4d10-9a84-1745afbf39df None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:12.708530 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57edc8-8c97-4d10-9a84-1745afbf39df None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:12.709689 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57edc8-8c97-4d10-9a84-1745afbf39df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:12.714083 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b64c98-f690-4b0e-b268-0a08158e719f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:12.715165 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b64c98-f690-4b0e-b268-0a08158e719f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:12.715651 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b64c98-f690-4b0e-b268-0a08158e719f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:12.716247 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b64c98-f690-4b0e-b268-0a08158e719f admin admin] PATH_INFO: `/v3/projects/d65e3264fe2542b2aa4c08f6b8b090e8` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:12.717924 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b64c98-f690-4b0e-b268-0a08158e719f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d65e3264fe2542b2aa4c08f6b8b090e8)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:12.720231 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b64c98-f690-4b0e-b268-0a08158e719f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:12.735392 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4f57edc8-8c97-4d10-9a84-1745afbf39df None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:12.736275 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4f57edc8-8c97-4d10-9a84-1745afbf39df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:12.751883 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 950/1908] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:12.754178 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57edc8-8c97-4d10-9a84-1745afbf39df None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:12.766602 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57edc8-8c97-4d10-9a84-1745afbf39df None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:12.772900 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd6cb7-a179-4af6-ac57-4d3d3c7a4f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:12.773629 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd6cb7-a179-4af6-ac57-4d3d3c7a4f82 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:12.773909 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd6cb7-a179-4af6-ac57-4d3d3c7a4f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:12.774326 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd6cb7-a179-4af6-ac57-4d3d3c7a4f82 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:12.775160 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd6cb7-a179-4af6-ac57-4d3d3c7a4f82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:12.775472 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd6cb7-a179-4af6-ac57-4d3d3c7a4f82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:12.777245 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd6cb7-a179-4af6-ac57-4d3d3c7a4f82 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:12.796851 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 951/1909] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:56:12.806368 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd6cb7-a179-4af6-ac57-4d3d3c7a4f82 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:12.821213 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd6cb7-a179-4af6-ac57-4d3d3c7a4f82 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:12.827344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2964ea4-86f9-45e1-9895-1b8fce604ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:12.828657 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2964ea4-86f9-45e1-9895-1b8fce604ebf admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:12.829180 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2964ea4-86f9-45e1-9895-1b8fce604ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:12.829603 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2964ea4-86f9-45e1-9895-1b8fce604ebf admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:12.830584 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2964ea4-86f9-45e1-9895-1b8fce604ebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:12.833093 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2964ea4-86f9-45e1-9895-1b8fce604ebf admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:12.861293 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-48b64c98-f690-4b0e-b268-0a08158e719f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd65e3264fe2542b2aa4c08f6b8b090e8', 'request_id': 'req-48b64c98-f690-4b0e-b268-0a08158e719f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:12.873952 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-48b64c98-f690-4b0e-b268-0a08158e719f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd65e3264fe2542b2aa4c08f6b8b090e8', 'request_id': 'req-48b64c98-f690-4b0e-b268-0a08158e719f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:12.877954 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 952/1910] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:12 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:12.882590 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2964ea4-86f9-45e1-9895-1b8fce604ebf admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:12.885386 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-48b64c98-f690-4b0e-b268-0a08158e719f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd65e3264fe2542b2aa4c08f6b8b090e8', 'request_id': 'req-48b64c98-f690-4b0e-b268-0a08158e719f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:12.907827 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-48b64c98-f690-4b0e-b268-0a08158e719f admin admin] The token cache is being invalidate because project d65e3264fe2542b2aa4c08f6b8b090e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:12.908384 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-48b64c98-f690-4b0e-b268-0a08158e719f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:12.910010 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-48b64c98-f690-4b0e-b268-0a08158e719f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:12.912472 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 959/1911] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:12 2022] DELETE /identity/v3/projects/d65e3264fe2542b2aa4c08f6b8b090e8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:12.916298 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b64c98-f690-4b0e-b268-0a08158e719f admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:12.918686 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-48b64c98-f690-4b0e-b268-0a08158e719f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:13.012898 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2964ea4-86f9-45e1-9895-1b8fce604ebf admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:13.029880 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a9a2a-fe6c-4bb2-9148-77f5578563b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:13.030722 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a9a2a-fe6c-4bb2-9148-77f5578563b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:13.031069 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a9a2a-fe6c-4bb2-9148-77f5578563b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:13.031357 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a9a2a-fe6c-4bb2-9148-77f5578563b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:13.032393 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a9a2a-fe6c-4bb2-9148-77f5578563b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:13.032714 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b64c98-f690-4b0e-b268-0a08158e719f admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:13.034525 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a9a2a-fe6c-4bb2-9148-77f5578563b1 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:13.039533 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442f380-fb5f-41dc-926e-ae77233cd162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:13.040797 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442f380-fb5f-41dc-926e-ae77233cd162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:13.041153 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442f380-fb5f-41dc-926e-ae77233cd162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:13.041500 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442f380-fb5f-41dc-926e-ae77233cd162 admin admin] PATH_INFO: `/v3/users/7cd08f5abca54659b3fde4c0a12dad22` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:13.043379 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442f380-fb5f-41dc-926e-ae77233cd162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cd08f5abca54659b3fde4c0a12dad22)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:13.046342 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442f380-fb5f-41dc-926e-ae77233cd162 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:13.068270 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 953/1912] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:12 2022] POST /identity/v3/users => generated 288 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:56:13.073006 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a9a2a-fe6c-4bb2-9148-77f5578563b1 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:13.077815 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5d5a9a2a-fe6c-4bb2-9148-77f5578563b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:13.097301 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a9a2a-fe6c-4bb2-9148-77f5578563b1 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:13.104450 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cc01c-49ca-415d-af51-e2f82bd31cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:13.105219 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cc01c-49ca-415d-af51-e2f82bd31cbe admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:13.105617 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cc01c-49ca-415d-af51-e2f82bd31cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:13.105788 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cc01c-49ca-415d-af51-e2f82bd31cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:13.106544 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cc01c-49ca-415d-af51-e2f82bd31cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:13.109010 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cc01c-49ca-415d-af51-e2f82bd31cbe admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:13.132386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 954/1913] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:13.140796 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cc01c-49ca-415d-af51-e2f82bd31cbe admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:13.146937 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b442f380-fb5f-41dc-926e-ae77233cd162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cd08f5abca54659b3fde4c0a12dad22'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:13.148846 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b442f380-fb5f-41dc-926e-ae77233cd162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cd08f5abca54659b3fde4c0a12dad22'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:13.152228 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cc01c-49ca-415d-af51-e2f82bd31cbe admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:13.158503 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc152a1-dc29-45fb-9b2d-8d5a29786d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:13.159191 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc152a1-dc29-45fb-9b2d-8d5a29786d1e admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:13.159539 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc152a1-dc29-45fb-9b2d-8d5a29786d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:13.159977 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc152a1-dc29-45fb-9b2d-8d5a29786d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:13.161156 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc152a1-dc29-45fb-9b2d-8d5a29786d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:13.162364 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc152a1-dc29-45fb-9b2d-8d5a29786d1e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:13.177625 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 955/1914] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:13.177625 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc152a1-dc29-45fb-9b2d-8d5a29786d1e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:13.178285 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2bc152a1-dc29-45fb-9b2d-8d5a29786d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:13.183816 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b442f380-fb5f-41dc-926e-ae77233cd162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cd08f5abca54659b3fde4c0a12dad22'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:13.196611 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc152a1-dc29-45fb-9b2d-8d5a29786d1e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:13.199819 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b442f380-fb5f-41dc-926e-ae77233cd162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cd08f5abca54659b3fde4c0a12dad22'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:13.203113 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b442f380-fb5f-41dc-926e-ae77233cd162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cd08f5abca54659b3fde4c0a12dad22'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:13.206766 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c691ec-c042-4a92-8e7d-105f3d42827c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:13.208191 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c691ec-c042-4a92-8e7d-105f3d42827c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:13.208640 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c691ec-c042-4a92-8e7d-105f3d42827c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:13.209562 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c691ec-c042-4a92-8e7d-105f3d42827c admin admin] PATH_INFO: `/v3/projects/5dc39530e0194ea6b7544f5fb649325b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:13.211116 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c691ec-c042-4a92-8e7d-105f3d42827c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc39530e0194ea6b7544f5fb649325b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:13.213601 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c691ec-c042-4a92-8e7d-105f3d42827c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:13.234916 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 960/1915] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:12 2022] DELETE /identity/v3/users/7cd08f5abca54659b3fde4c0a12dad22 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:13.239673 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442f380-fb5f-41dc-926e-ae77233cd162 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:13.239673 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b442f380-fb5f-41dc-926e-ae77233cd162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:13.284724 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-19c691ec-c042-4a92-8e7d-105f3d42827c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc39530e0194ea6b7544f5fb649325b', 'request_id': 'req-19c691ec-c042-4a92-8e7d-105f3d42827c'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:13.311673 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-19c691ec-c042-4a92-8e7d-105f3d42827c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc39530e0194ea6b7544f5fb649325b', 'request_id': 'req-19c691ec-c042-4a92-8e7d-105f3d42827c'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:13.322254 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-19c691ec-c042-4a92-8e7d-105f3d42827c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc39530e0194ea6b7544f5fb649325b', 'request_id': 'req-19c691ec-c042-4a92-8e7d-105f3d42827c'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:13.339262 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-19c691ec-c042-4a92-8e7d-105f3d42827c admin admin] The token cache is being invalidate because project 5dc39530e0194ea6b7544f5fb649325b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:13.339555 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-19c691ec-c042-4a92-8e7d-105f3d42827c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:13.340284 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-19c691ec-c042-4a92-8e7d-105f3d42827c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:13.342149 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 956/1916] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:13 2022] DELETE /identity/v3/projects/5dc39530e0194ea6b7544f5fb649325b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:13.348216 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a642e-e2c5-4908-9f90-4f818399482b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:13.348659 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a642e-e2c5-4908-9f90-4f818399482b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:13.349038 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a642e-e2c5-4908-9f90-4f818399482b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:13.381750 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-231a642e-e2c5-4908-9f90-4f818399482b None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:13.383198 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-231a642e-e2c5-4908-9f90-4f818399482b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:13.389656 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442f380-fb5f-41dc-926e-ae77233cd162 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:13.475707 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 957/1917] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:13.483806 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85cedf-6a6e-45ca-86e8-2b554c0fbfef None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:13.484498 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85cedf-6a6e-45ca-86e8-2b554c0fbfef None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:13.485162 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85cedf-6a6e-45ca-86e8-2b554c0fbfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:13.485303 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7e363-4ca4-49b0-8d53-91c2f49a37c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:13.486541 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7e363-4ca4-49b0-8d53-91c2f49a37c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:13.486927 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7e363-4ca4-49b0-8d53-91c2f49a37c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:13.487372 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7e363-4ca4-49b0-8d53-91c2f49a37c3 admin admin] PATH_INFO: `/v3/projects/8b6eb49d6cb74605a14093941782541d/users/ace2f76279c54ec49d4019c96a2c6672/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:13.513082 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7e363-4ca4-49b0-8d53-91c2f49a37c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b6eb49d6cb74605a14093941782541d, user_id=ace2f76279c54ec49d4019c96a2c6672, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:13.515581 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-3f85cedf-6a6e-45ca-86e8-2b554c0fbfef None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:13.516836 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7e363-4ca4-49b0-8d53-91c2f49a37c3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:13.520281 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3f85cedf-6a6e-45ca-86e8-2b554c0fbfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:13.531747 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 958/1918] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:13.534924 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 961/1919] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:13 2022] PUT /identity/v3/projects/8b6eb49d6cb74605a14093941782541d/users/ace2f76279c54ec49d4019c96a2c6672/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:13.536266 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85cedf-6a6e-45ca-86e8-2b554c0fbfef None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:13.546204 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85cedf-6a6e-45ca-86e8-2b554c0fbfef None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:13.547598 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094fd2b-0111-48cb-bab9-afa3edab3420 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:13.548039 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094fd2b-0111-48cb-bab9-afa3edab3420 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:13.548971 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094fd2b-0111-48cb-bab9-afa3edab3420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:13.596979 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4094fd2b-0111-48cb-bab9-afa3edab3420 None None] MFA Rules not processed for user `ace2f76279c54ec49d4019c96a2c6672`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:13.598353 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4094fd2b-0111-48cb-bab9-afa3edab3420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:13.645326 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541cab9-f14d-402d-a371-e68e25c61c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:13.646493 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541cab9-f14d-402d-a371-e68e25c61c91 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:13.646670 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541cab9-f14d-402d-a371-e68e25c61c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:13.646944 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7541cab9-f14d-402d-a371-e68e25c61c91 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:13.649254 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541cab9-f14d-402d-a371-e68e25c61c91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:13.649572 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541cab9-f14d-402d-a371-e68e25c61c91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:13.652063 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7541cab9-f14d-402d-a371-e68e25c61c91 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:13.668833 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 959/1920] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:56:13.670183 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541cab9-f14d-402d-a371-e68e25c61c91 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:13.680889 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7541cab9-f14d-402d-a371-e68e25c61c91 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:13.686804 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1d433-f127-4bed-895d-8834ed4d41ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:13.687886 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1d433-f127-4bed-895d-8834ed4d41ff admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:13.689149 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1d433-f127-4bed-895d-8834ed4d41ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:13.689587 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1d433-f127-4bed-895d-8834ed4d41ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:13.690983 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1d433-f127-4bed-895d-8834ed4d41ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:13.693661 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1d433-f127-4bed-895d-8834ed4d41ff admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:13.725976 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 962/1921] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:13.737227 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094fd2b-0111-48cb-bab9-afa3edab3420 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:13.738140 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 960/1922] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:13 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:13.740018 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4094fd2b-0111-48cb-bab9-afa3edab3420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:13.741811 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1d433-f127-4bed-895d-8834ed4d41ff admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:13.774333 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094fd2b-0111-48cb-bab9-afa3edab3420 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:13.855761 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1d433-f127-4bed-895d-8834ed4d41ff admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:13.863596 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9acce-3164-472d-86c7-d213269bd4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:13.864333 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9acce-3164-472d-86c7-d213269bd4f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:13.864647 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9acce-3164-472d-86c7-d213269bd4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:13.865119 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9acce-3164-472d-86c7-d213269bd4f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:13.865813 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9acce-3164-472d-86c7-d213269bd4f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:13.868086 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9acce-3164-472d-86c7-d213269bd4f9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:13.905959 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 961/1923] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:13 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:56:13.907344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9acce-3164-472d-86c7-d213269bd4f9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:13.910070 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e2c9acce-3164-472d-86c7-d213269bd4f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:13.923878 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9acce-3164-472d-86c7-d213269bd4f9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:13.927088 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f88cfc-5e48-4366-9578-fe268b306f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:13.927805 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f88cfc-5e48-4366-9578-fe268b306f09 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:13.928092 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f88cfc-5e48-4366-9578-fe268b306f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:13.928514 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f88cfc-5e48-4366-9578-fe268b306f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:13.929432 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f88cfc-5e48-4366-9578-fe268b306f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:13.931496 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f88cfc-5e48-4366-9578-fe268b306f09 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:13.941772 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b228a8-5405-4f65-8fef-b14267fbe02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:13.942589 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b228a8-5405-4f65-8fef-b14267fbe02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:13.942874 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b228a8-5405-4f65-8fef-b14267fbe02c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:13.943149 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b228a8-5405-4f65-8fef-b14267fbe02c admin admin] PATH_INFO: `/v3/projects/f11c9592596b4d9390eae2b910dbd1e3` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:13.944462 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b228a8-5405-4f65-8fef-b14267fbe02c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f11c9592596b4d9390eae2b910dbd1e3)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:13.947374 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b228a8-5405-4f65-8fef-b14267fbe02c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:13.970888 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 963/1924] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:13 2022] POST /identity/v3/projects => generated 375 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:13.972468 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f88cfc-5e48-4366-9578-fe268b306f09 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:14.020559 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a1b228a8-5405-4f65-8fef-b14267fbe02c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f11c9592596b4d9390eae2b910dbd1e3', 'request_id': 'req-a1b228a8-5405-4f65-8fef-b14267fbe02c'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:14.038858 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a1b228a8-5405-4f65-8fef-b14267fbe02c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f11c9592596b4d9390eae2b910dbd1e3', 'request_id': 'req-a1b228a8-5405-4f65-8fef-b14267fbe02c'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:14.044963 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a1b228a8-5405-4f65-8fef-b14267fbe02c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f11c9592596b4d9390eae2b910dbd1e3', 'request_id': 'req-a1b228a8-5405-4f65-8fef-b14267fbe02c'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:14.050911 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f88cfc-5e48-4366-9578-fe268b306f09 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:14.062187 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a1b228a8-5405-4f65-8fef-b14267fbe02c admin admin] The token cache is being invalidate because project f11c9592596b4d9390eae2b910dbd1e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:14.062896 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a1b228a8-5405-4f65-8fef-b14267fbe02c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:14.063676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-a1b228a8-5405-4f65-8fef-b14267fbe02c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:14.065692 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 962/1925] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:13 2022] DELETE /identity/v3/projects/f11c9592596b4d9390eae2b910dbd1e3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:14.066501 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b228a8-5405-4f65-8fef-b14267fbe02c admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:14.067885 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a1b228a8-5405-4f65-8fef-b14267fbe02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:14.127039 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060afd9e-20c2-4ed7-a0d4-a756c9c6faec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:14.127512 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060afd9e-20c2-4ed7-a0d4-a756c9c6faec admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:14.127844 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060afd9e-20c2-4ed7-a0d4-a756c9c6faec admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:14.128146 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060afd9e-20c2-4ed7-a0d4-a756c9c6faec admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:14.130174 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060afd9e-20c2-4ed7-a0d4-a756c9c6faec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:14.131104 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060afd9e-20c2-4ed7-a0d4-a756c9c6faec admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:14.142052 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b228a8-5405-4f65-8fef-b14267fbe02c admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:14.148116 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 964/1926] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:14.148116 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fb554-c260-4c85-b7fb-240079c51347 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:14.148116 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fb554-c260-4c85-b7fb-240079c51347 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:14.148116 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fb554-c260-4c85-b7fb-240079c51347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:14.150689 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03674a9-3eb4-47b3-94c6-4c633034a3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:14.151477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03674a9-3eb4-47b3-94c6-4c633034a3ac admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:14.151879 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03674a9-3eb4-47b3-94c6-4c633034a3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:14.152150 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03674a9-3eb4-47b3-94c6-4c633034a3ac admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:14.153011 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03674a9-3eb4-47b3-94c6-4c633034a3ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:14.155053 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03674a9-3eb4-47b3-94c6-4c633034a3ac admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:14.171832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d41fb554-c260-4c85-b7fb-240079c51347 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:14.173651 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d41fb554-c260-4c85-b7fb-240079c51347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:14.183221 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 963/1927] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:14 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:14.183221 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03674a9-3eb4-47b3-94c6-4c633034a3ac admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:14.185543 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b03674a9-3eb4-47b3-94c6-4c633034a3ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:14.195872 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 965/1928] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:14.195872 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fb554-c260-4c85-b7fb-240079c51347 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:14.201817 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03674a9-3eb4-47b3-94c6-4c633034a3ac admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:14.202815 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fb554-c260-4c85-b7fb-240079c51347 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:14.206971 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651411b-0b8e-43e0-824a-14f4ae38b725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:14.207698 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651411b-0b8e-43e0-824a-14f4ae38b725 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:14.208001 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651411b-0b8e-43e0-824a-14f4ae38b725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:14.208265 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651411b-0b8e-43e0-824a-14f4ae38b725 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:14.209428 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d706d3-021a-496f-8f26-02e1aee53074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:14.209572 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651411b-0b8e-43e0-824a-14f4ae38b725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:14.209651 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d706d3-021a-496f-8f26-02e1aee53074 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:14.209651 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d706d3-021a-496f-8f26-02e1aee53074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:14.209855 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d706d3-021a-496f-8f26-02e1aee53074 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:14.210703 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651411b-0b8e-43e0-824a-14f4ae38b725 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:14.210818 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d706d3-021a-496f-8f26-02e1aee53074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:14.212539 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d706d3-021a-496f-8f26-02e1aee53074 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:14.224559 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 964/1929] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:14.224559 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c56775-0e94-4826-9806-bda7edf3f4d0 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:14.224559 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c56775-0e94-4826-9806-bda7edf3f4d0 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:14.224559 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c56775-0e94-4826-9806-bda7edf3f4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:14.226232 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 966/1930] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:14.227119 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d706d3-021a-496f-8f26-02e1aee53074 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:14.238012 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d706d3-021a-496f-8f26-02e1aee53074 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:14.243155 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-91c56775-0e94-4826-9806-bda7edf3f4d0 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:14.243342 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352dff03-865e-451c-914d-323bb6419a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:14.250817 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352dff03-865e-451c-914d-323bb6419a8d admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:14.250952 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-91c56775-0e94-4826-9806-bda7edf3f4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:14.251031 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352dff03-865e-451c-914d-323bb6419a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:14.251031 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352dff03-865e-451c-914d-323bb6419a8d admin admin] PATH_INFO: `/v3/projects/49f34e81c61849e4a8881b1439acd42c/users/7c83d35e769e4431b887cd91d0ba0717/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:14.260459 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 965/1931] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:14.263726 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c56775-0e94-4826-9806-bda7edf3f4d0 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:14.265340 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352dff03-865e-451c-914d-323bb6419a8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=49f34e81c61849e4a8881b1439acd42c, user_id=7c83d35e769e4431b887cd91d0ba0717, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:14.268116 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352dff03-865e-451c-914d-323bb6419a8d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:14.275429 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c56775-0e94-4826-9806-bda7edf3f4d0 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:14.280623 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da324e9f-7d1e-482a-a10a-7294ad700b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:14.281385 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da324e9f-7d1e-482a-a10a-7294ad700b9b admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:14.281667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da324e9f-7d1e-482a-a10a-7294ad700b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:14.281937 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da324e9f-7d1e-482a-a10a-7294ad700b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:14.282672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da324e9f-7d1e-482a-a10a-7294ad700b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:14.284855 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 967/1932] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:14 2022] PUT /identity/v3/projects/49f34e81c61849e4a8881b1439acd42c/users/7c83d35e769e4431b887cd91d0ba0717/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:14.286810 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352dff03-865e-451c-914d-323bb6419a8d admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:14.287894 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da324e9f-7d1e-482a-a10a-7294ad700b9b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:14.299865 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 966/1933] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:14.302742 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab5187-a9fd-4892-b31a-48366b2dc4e6 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:14.303181 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab5187-a9fd-4892-b31a-48366b2dc4e6 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:14.303817 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab5187-a9fd-4892-b31a-48366b2dc4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:14.343138 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-68ab5187-a9fd-4892-b31a-48366b2dc4e6 None None] MFA Rules not processed for user `7c83d35e769e4431b887cd91d0ba0717`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:14.344587 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-68ab5187-a9fd-4892-b31a-48366b2dc4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:14.388199 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352dff03-865e-451c-914d-323bb6419a8d admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:14.394534 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2fdd7-2418-4132-acbf-0bf2949975f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:14.395875 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2fdd7-2418-4132-acbf-0bf2949975f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:14.396212 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2fdd7-2418-4132-acbf-0bf2949975f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:14.396439 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2fdd7-2418-4132-acbf-0bf2949975f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:14.397167 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2fdd7-2418-4132-acbf-0bf2949975f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:14.397787 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2fdd7-2418-4132-acbf-0bf2949975f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:14.399399 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2fdd7-2418-4132-acbf-0bf2949975f1 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:14.419593 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 968/1934] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:56:14.420079 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2fdd7-2418-4132-acbf-0bf2949975f1 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:14.431145 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 967/1935] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:14.436146 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab5187-a9fd-4892-b31a-48366b2dc4e6 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:14.437232 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2fdd7-2418-4132-acbf-0bf2949975f1 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:14.443062 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ff321-74d1-4d81-ab83-e5625071e176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:14.445309 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ff321-74d1-4d81-ab83-e5625071e176 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:14.445601 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ff321-74d1-4d81-ab83-e5625071e176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:14.445879 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ff321-74d1-4d81-ab83-e5625071e176 admin admin] PATH_INFO: `/v3/projects/4e0a5850fb2c4c668b1ba47c7c943097/users/f7b54dcbeae240868f7b3cc6b31b8919/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:14.454864 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab5187-a9fd-4892-b31a-48366b2dc4e6 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:14.462862 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2dbb9-e42a-484b-9902-50ac0584c0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:14.463004 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ff321-74d1-4d81-ab83-e5625071e176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e0a5850fb2c4c668b1ba47c7c943097, user_id=f7b54dcbeae240868f7b3cc6b31b8919, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:14.464076 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2dbb9-e42a-484b-9902-50ac0584c0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:14.464637 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2dbb9-e42a-484b-9902-50ac0584c0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:14.465093 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2dbb9-e42a-484b-9902-50ac0584c0a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:14.465856 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ff321-74d1-4d81-ab83-e5625071e176 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:14.466047 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2dbb9-e42a-484b-9902-50ac0584c0a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:14.468075 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2dbb9-e42a-484b-9902-50ac0584c0a4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:14.495989 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 969/1936] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:14 2022] PUT /identity/v3/projects/4e0a5850fb2c4c668b1ba47c7c943097/users/f7b54dcbeae240868f7b3cc6b31b8919/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:14.495989 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ff321-74d1-4d81-ab83-e5625071e176 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:14.495989 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-579ff321-74d1-4d81-ab83-e5625071e176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:14.514749 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 968/1937] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:14 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:14.516253 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52cf4a-3a20-46c4-8410-7faf1735706a None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:14.516639 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52cf4a-3a20-46c4-8410-7faf1735706a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:14.517013 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52cf4a-3a20-46c4-8410-7faf1735706a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:14.564515 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-dc52cf4a-3a20-46c4-8410-7faf1735706a None None] MFA Rules not processed for user `f7b54dcbeae240868f7b3cc6b31b8919`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:14.567054 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-dc52cf4a-3a20-46c4-8410-7faf1735706a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:14.597340 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ff321-74d1-4d81-ab83-e5625071e176 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:14.658675 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 969/1938] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:14.659978 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52cf4a-3a20-46c4-8410-7faf1735706a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:14.676728 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23facdce-9e77-4cab-be8d-0c83ea7741a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cbf69574af4e25b940ec038f9e1bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:14.679273 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23facdce-9e77-4cab-be8d-0c83ea7741a7 service glance] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:14.679941 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23facdce-9e77-4cab-be8d-0c83ea7741a7 service glance] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:14.682418 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23facdce-9e77-4cab-be8d-0c83ea7741a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:14.771164 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52cf4a-3a20-46c4-8410-7faf1735706a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:14.776852 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d7b92-24d3-4812-b313-c48acae7252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:14.778745 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d7b92-24d3-4812-b313-c48acae7252e admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:14.779027 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d7b92-24d3-4812-b313-c48acae7252e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:14.779299 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d7b92-24d3-4812-b313-c48acae7252e admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:14.780596 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d7b92-24d3-4812-b313-c48acae7252e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:14.784627 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d7b92-24d3-4812-b313-c48acae7252e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:14.821712 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 970/1939] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:14 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:14.824012 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d7b92-24d3-4812-b313-c48acae7252e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:14.839815 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23facdce-9e77-4cab-be8d-0c83ea7741a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:14.839815 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23facdce-9e77-4cab-be8d-0c83ea7741a7 service glance] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:14.850109 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d7b92-24d3-4812-b313-c48acae7252e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:14.858492 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0baaa57-310f-4c30-8958-69fa3cf4d5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:14.859966 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0baaa57-310f-4c30-8958-69fa3cf4d5ae admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:14.860662 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0baaa57-310f-4c30-8958-69fa3cf4d5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:14.861214 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0baaa57-310f-4c30-8958-69fa3cf4d5ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:14.861894 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0baaa57-310f-4c30-8958-69fa3cf4d5ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:14.862805 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 970/1940] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:14.864468 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23facdce-9e77-4cab-be8d-0c83ea7741a7 service glance] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:14.871869 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0baaa57-310f-4c30-8958-69fa3cf4d5ae admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:14.881649 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23facdce-9e77-4cab-be8d-0c83ea7741a7 service glance] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:14.898300 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a294c-a44b-477f-9726-a479e330771b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:14.898300 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a294c-a44b-477f-9726-a479e330771b admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:14.898300 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a294c-a44b-477f-9726-a479e330771b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:14.898300 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a294c-a44b-477f-9726-a479e330771b admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:14.898831 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a294c-a44b-477f-9726-a479e330771b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:14.900785 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a294c-a44b-477f-9726-a479e330771b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:14.919160 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 971/1941] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:14.926929 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a294c-a44b-477f-9726-a479e330771b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:14.927095 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 971/1942] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:14 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:14.928544 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0baaa57-310f-4c30-8958-69fa3cf4d5ae admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:14.941610 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a294c-a44b-477f-9726-a479e330771b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:15.027006 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab900a9-7d5f-4ff9-a7c6-0ddeee48759f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:15.029629 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab900a9-7d5f-4ff9-a7c6-0ddeee48759f admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:15.030022 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab900a9-7d5f-4ff9-a7c6-0ddeee48759f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:15.030491 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab900a9-7d5f-4ff9-a7c6-0ddeee48759f admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:15.031306 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab900a9-7d5f-4ff9-a7c6-0ddeee48759f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:15.036264 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab900a9-7d5f-4ff9-a7c6-0ddeee48759f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:15.049159 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0baaa57-310f-4c30-8958-69fa3cf4d5ae admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:15.055796 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e2bfe-b554-4234-bc9b-06a00d4e2b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:15.056492 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e2bfe-b554-4234-bc9b-06a00d4e2b8f admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:15.056779 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e2bfe-b554-4234-bc9b-06a00d4e2b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:15.057056 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e2bfe-b554-4234-bc9b-06a00d4e2b8f admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:15.057909 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e2bfe-b554-4234-bc9b-06a00d4e2b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:15.059925 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e2bfe-b554-4234-bc9b-06a00d4e2b8f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:15.074459 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 972/1943] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:15.079941 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab900a9-7d5f-4ff9-a7c6-0ddeee48759f admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:15.094084 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab900a9-7d5f-4ff9-a7c6-0ddeee48759f admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:15.103644 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c11190-88d1-42be-bb79-6f4de6c297f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:15.104676 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c11190-88d1-42be-bb79-6f4de6c297f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:15.104963 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c11190-88d1-42be-bb79-6f4de6c297f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:15.105239 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c11190-88d1-42be-bb79-6f4de6c297f8 admin admin] PATH_INFO: `/v3/projects/5fb8042fc2074ee3b01adfbb95533b83/users/f9a48aa0a32f41398ea1dd407cf94ffb/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:15.108291 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 972/1944] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:14 2022] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:56:15.110008 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e2bfe-b554-4234-bc9b-06a00d4e2b8f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:15.124753 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c11190-88d1-42be-bb79-6f4de6c297f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb8042fc2074ee3b01adfbb95533b83, user_id=f9a48aa0a32f41398ea1dd407cf94ffb, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:15.128617 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c11190-88d1-42be-bb79-6f4de6c297f8 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:15.129830 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e2bfe-b554-4234-bc9b-06a00d4e2b8f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:15.137155 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ea10e-bfb8-40c3-8cba-212e28893488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:15.138468 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ea10e-bfb8-40c3-8cba-212e28893488 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:15.138833 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ea10e-bfb8-40c3-8cba-212e28893488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:15.139769 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ea10e-bfb8-40c3-8cba-212e28893488 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:15.140759 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ea10e-bfb8-40c3-8cba-212e28893488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:15.142969 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ea10e-bfb8-40c3-8cba-212e28893488 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:15.151395 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 973/1945] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:15 2022] PUT /identity/v3/projects/5fb8042fc2074ee3b01adfbb95533b83/users/f9a48aa0a32f41398ea1dd407cf94ffb/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:15.160839 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 973/1946] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:15.162905 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95074000-4680-42db-8733-cf22d45dd334 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:15.163193 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95074000-4680-42db-8733-cf22d45dd334 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:15.163465 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95074000-4680-42db-8733-cf22d45dd334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:15.167239 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ea10e-bfb8-40c3-8cba-212e28893488 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:15.185384 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ea10e-bfb8-40c3-8cba-212e28893488 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:15.209844 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-95074000-4680-42db-8733-cf22d45dd334 None None] MFA Rules not processed for user `f9a48aa0a32f41398ea1dd407cf94ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:15.213470 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-95074000-4680-42db-8733-cf22d45dd334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:15.274526 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684b2ef-7e86-4841-9847-c2a5f40e5cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:15.275395 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684b2ef-7e86-4841-9847-c2a5f40e5cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:15.275693 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684b2ef-7e86-4841-9847-c2a5f40e5cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:15.276005 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684b2ef-7e86-4841-9847-c2a5f40e5cd4 admin admin] PATH_INFO: `/v3/projects/8a5786b26d054fe594102a84e4fa92e6/users/2b8f96488fae42d691d2dce8c1923cfb/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:15.305315 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684b2ef-7e86-4841-9847-c2a5f40e5cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5786b26d054fe594102a84e4fa92e6, user_id=2b8f96488fae42d691d2dce8c1923cfb, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:15.308115 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684b2ef-7e86-4841-9847-c2a5f40e5cd4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:15.328112 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 974/1947] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:15 2022] PUT /identity/v3/projects/8a5786b26d054fe594102a84e4fa92e6/users/2b8f96488fae42d691d2dce8c1923cfb/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:15.332210 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684b2ef-7e86-4841-9847-c2a5f40e5cd4 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:15.351023 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 974/1948] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:15.352259 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95074000-4680-42db-8733-cf22d45dd334 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:15.364743 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95074000-4680-42db-8733-cf22d45dd334 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:15.420678 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684b2ef-7e86-4841-9847-c2a5f40e5cd4 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:15.432487 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471f77a-3cd2-47f4-b2b8-8ebb86fc1e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:15.433064 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471f77a-3cd2-47f4-b2b8-8ebb86fc1e24 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:15.433359 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471f77a-3cd2-47f4-b2b8-8ebb86fc1e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:15.434720 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471f77a-3cd2-47f4-b2b8-8ebb86fc1e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:15.437458 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471f77a-3cd2-47f4-b2b8-8ebb86fc1e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:15.438843 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471f77a-3cd2-47f4-b2b8-8ebb86fc1e24 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:15.442258 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5811e2-9e91-4a8f-b61f-8366b480351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:15.443180 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5811e2-9e91-4a8f-b61f-8366b480351b admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:15.443771 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5811e2-9e91-4a8f-b61f-8366b480351b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:15.444130 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5811e2-9e91-4a8f-b61f-8366b480351b admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:15.445086 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5811e2-9e91-4a8f-b61f-8366b480351b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:15.447524 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5811e2-9e91-4a8f-b61f-8366b480351b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:15.467673 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 975/1949] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:15.473336 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471f77a-3cd2-47f4-b2b8-8ebb86fc1e24 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:15.504654 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 975/1950] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:15 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:15.507811 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471f77a-3cd2-47f4-b2b8-8ebb86fc1e24 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:15.508582 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5811e2-9e91-4a8f-b61f-8366b480351b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:15.635667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0973ea-afb2-45fb-aeea-55defcc838b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:15.636703 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0973ea-afb2-45fb-aeea-55defcc838b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:15.637067 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0973ea-afb2-45fb-aeea-55defcc838b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:15.637398 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0973ea-afb2-45fb-aeea-55defcc838b1 admin admin] PATH_INFO: `/v3/projects/8a5786b26d054fe594102a84e4fa92e6/users/2b8f96488fae42d691d2dce8c1923cfb/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:15.640588 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0973ea-afb2-45fb-aeea-55defcc838b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5786b26d054fe594102a84e4fa92e6, user_id=2b8f96488fae42d691d2dce8c1923cfb, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:15.646757 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0973ea-afb2-45fb-aeea-55defcc838b1 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:15.655565 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5811e2-9e91-4a8f-b61f-8366b480351b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:15.668412 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 976/1951] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:15 2022] PUT /identity/v3/projects/8a5786b26d054fe594102a84e4fa92e6/users/2b8f96488fae42d691d2dce8c1923cfb/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:15.671198 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b26a06-d055-4489-9d2f-377b98e3059d None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:15.671612 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b26a06-d055-4489-9d2f-377b98e3059d None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:15.672120 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b26a06-d055-4489-9d2f-377b98e3059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:15.722558 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-02b26a06-d055-4489-9d2f-377b98e3059d None None] MFA Rules not processed for user `2b8f96488fae42d691d2dce8c1923cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:15.723949 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-02b26a06-d055-4489-9d2f-377b98e3059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:15.752716 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6abf04-32c0-4404-ad0f-9d3e7514537f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:15.755556 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6abf04-32c0-4404-ad0f-9d3e7514537f admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:15.755556 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6abf04-32c0-4404-ad0f-9d3e7514537f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:15.755556 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6abf04-32c0-4404-ad0f-9d3e7514537f admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:15.755880 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6abf04-32c0-4404-ad0f-9d3e7514537f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:15.757986 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6abf04-32c0-4404-ad0f-9d3e7514537f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:15.783681 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 976/1952] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:15 2022] POST /identity/v3/users => generated 300 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:56:15.787573 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6abf04-32c0-4404-ad0f-9d3e7514537f admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:15.797991 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6abf04-32c0-4404-ad0f-9d3e7514537f admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:15.804306 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3fe22-7d35-4470-b2b5-ec1559e026c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:15.804977 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3fe22-7d35-4470-b2b5-ec1559e026c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:15.805262 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3fe22-7d35-4470-b2b5-ec1559e026c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:15.805542 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3fe22-7d35-4470-b2b5-ec1559e026c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:15.806277 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3fe22-7d35-4470-b2b5-ec1559e026c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:15.807951 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3fe22-7d35-4470-b2b5-ec1559e026c5 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:15.810441 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 977/1953] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:15.821930 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 977/1954] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:15.824285 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b26a06-d055-4489-9d2f-377b98e3059d None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:15.826343 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3fe22-7d35-4470-b2b5-ec1559e026c5 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:15.827602 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-02b26a06-d055-4489-9d2f-377b98e3059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:15.837023 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3fe22-7d35-4470-b2b5-ec1559e026c5 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:15.843004 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae86f65-901b-4271-a434-edacb4079cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:15.843004 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae86f65-901b-4271-a434-edacb4079cef admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:15.843004 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae86f65-901b-4271-a434-edacb4079cef admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:15.843485 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae86f65-901b-4271-a434-edacb4079cef admin admin] PATH_INFO: `/v3/projects/57d0108190bd4021b7c9a1688e20c1a2/users/2955434384c94638b2e396f22d341b58/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:15.860416 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae86f65-901b-4271-a434-edacb4079cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d0108190bd4021b7c9a1688e20c1a2, user_id=2955434384c94638b2e396f22d341b58, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:15.864977 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae86f65-901b-4271-a434-edacb4079cef admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:15.884797 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 978/1955] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:15 2022] PUT /identity/v3/projects/57d0108190bd4021b7c9a1688e20c1a2/users/2955434384c94638b2e396f22d341b58/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:15.888122 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae86f65-901b-4271-a434-edacb4079cef admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:15.920954 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b26a06-d055-4489-9d2f-377b98e3059d None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:16.001915 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae86f65-901b-4271-a434-edacb4079cef admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:16.011885 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f41f86-9d60-40b0-b56c-9ce48a87e608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:16.012711 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f41f86-9d60-40b0-b56c-9ce48a87e608 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:16.012938 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f41f86-9d60-40b0-b56c-9ce48a87e608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:16.013334 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f41f86-9d60-40b0-b56c-9ce48a87e608 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:16.014047 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f41f86-9d60-40b0-b56c-9ce48a87e608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:16.015668 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f41f86-9d60-40b0-b56c-9ce48a87e608 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:16.030811 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436625f9-e5e2-48fd-b8d3-9b6a1b24ffe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:16.031426 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436625f9-e5e2-48fd-b8d3-9b6a1b24ffe7 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:16.031729 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436625f9-e5e2-48fd-b8d3-9b6a1b24ffe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:16.032009 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436625f9-e5e2-48fd-b8d3-9b6a1b24ffe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:16.033995 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-436625f9-e5e2-48fd-b8d3-9b6a1b24ffe7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:16.036019 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 979/1956] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:16.044520 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f41f86-9d60-40b0-b56c-9ce48a87e608 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:16.068004 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f41f86-9d60-40b0-b56c-9ce48a87e608 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:16.082912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2068388-ec85-48ab-9b29-ae8f3abb10ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:16.084289 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2068388-ec85-48ab-9b29-ae8f3abb10ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:16.084570 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2068388-ec85-48ab-9b29-ae8f3abb10ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:16.084827 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2068388-ec85-48ab-9b29-ae8f3abb10ad admin admin] PATH_INFO: `/v3/projects/57d0108190bd4021b7c9a1688e20c1a2/users/2955434384c94638b2e396f22d341b58/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:16.087783 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2068388-ec85-48ab-9b29-ae8f3abb10ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d0108190bd4021b7c9a1688e20c1a2, user_id=2955434384c94638b2e396f22d341b58, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:16.093450 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2068388-ec85-48ab-9b29-ae8f3abb10ad admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:16.134577 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 980/1957] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:16 2022] PUT /identity/v3/projects/57d0108190bd4021b7c9a1688e20c1a2/users/2955434384c94638b2e396f22d341b58/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:16.155088 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e68ea5-006b-493f-a799-8454049e415b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:16.155088 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e68ea5-006b-493f-a799-8454049e415b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:16.155088 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e68ea5-006b-493f-a799-8454049e415b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:16.168622 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436625f9-e5e2-48fd-b8d3-9b6a1b24ffe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:16.170696 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436625f9-e5e2-48fd-b8d3-9b6a1b24ffe7 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:16.204532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 978/1958] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:16.214252 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-07e68ea5-006b-493f-a799-8454049e415b None None] MFA Rules not processed for user `2955434384c94638b2e396f22d341b58`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:16.216514 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-07e68ea5-006b-493f-a799-8454049e415b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:16.403347 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 981/1959] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:16.499789 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436625f9-e5e2-48fd-b8d3-9b6a1b24ffe7 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:16.502696 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-436625f9-e5e2-48fd-b8d3-9b6a1b24ffe7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:16.524083 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436625f9-e5e2-48fd-b8d3-9b6a1b24ffe7 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:16.621237 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06024cf9-d32e-4e4a-bcdf-d96dfab152b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:16.621947 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06024cf9-d32e-4e4a-bcdf-d96dfab152b0 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:16.622236 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06024cf9-d32e-4e4a-bcdf-d96dfab152b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:16.622597 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06024cf9-d32e-4e4a-bcdf-d96dfab152b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:16.633955 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06024cf9-d32e-4e4a-bcdf-d96dfab152b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:16.635963 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06024cf9-d32e-4e4a-bcdf-d96dfab152b0 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:16.668395 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 979/1960] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:17.149091 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e68ea5-006b-493f-a799-8454049e415b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:17.150562 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-07e68ea5-006b-493f-a799-8454049e415b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:17.234817 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e68ea5-006b-493f-a799-8454049e415b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:17.244989 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7690c8-41d6-482e-b1b5-d13b5fdae541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:17.245908 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7690c8-41d6-482e-b1b5-d13b5fdae541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:17.246194 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7690c8-41d6-482e-b1b5-d13b5fdae541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:17.246472 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7690c8-41d6-482e-b1b5-d13b5fdae541 admin admin] PATH_INFO: `/v3/users/4b685afcb41145bba5d39234c7d968ff` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:17.247698 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7690c8-41d6-482e-b1b5-d13b5fdae541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b685afcb41145bba5d39234c7d968ff)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:17.249657 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7690c8-41d6-482e-b1b5-d13b5fdae541 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:17.306395 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3f7690c8-41d6-482e-b1b5-d13b5fdae541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b685afcb41145bba5d39234c7d968ff'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:17.307307 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3f7690c8-41d6-482e-b1b5-d13b5fdae541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b685afcb41145bba5d39234c7d968ff'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:17.325562 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3f7690c8-41d6-482e-b1b5-d13b5fdae541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b685afcb41145bba5d39234c7d968ff'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:17.337784 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3f7690c8-41d6-482e-b1b5-d13b5fdae541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b685afcb41145bba5d39234c7d968ff'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:17.338412 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3f7690c8-41d6-482e-b1b5-d13b5fdae541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b685afcb41145bba5d39234c7d968ff'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:17.357918 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 982/1961] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:17 2022] DELETE /identity/v3/users/4b685afcb41145bba5d39234c7d968ff => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:17.363018 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f05d95-d1ba-43ab-a292-e3dfffa9782a None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:17.364081 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f05d95-d1ba-43ab-a292-e3dfffa9782a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:17.364513 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f05d95-d1ba-43ab-a292-e3dfffa9782a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:17.399751 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-27f05d95-d1ba-43ab-a292-e3dfffa9782a None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:17.400979 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-27f05d95-d1ba-43ab-a292-e3dfffa9782a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:17.472147 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 980/1962] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:17.474264 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7690c8-41d6-482e-b1b5-d13b5fdae541 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:17.475725 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3f7690c8-41d6-482e-b1b5-d13b5fdae541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:17.483592 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f05d95-d1ba-43ab-a292-e3dfffa9782a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:17.487461 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-27f05d95-d1ba-43ab-a292-e3dfffa9782a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:17.500250 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7690c8-41d6-482e-b1b5-d13b5fdae541 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:17.506122 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41b1c0-873b-4674-9b10-9e57649c693d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:17.507063 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41b1c0-873b-4674-9b10-9e57649c693d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:17.507350 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41b1c0-873b-4674-9b10-9e57649c693d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:17.507679 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41b1c0-873b-4674-9b10-9e57649c693d admin admin] PATH_INFO: `/v3/users/f9a48aa0a32f41398ea1dd407cf94ffb` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:17.508931 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41b1c0-873b-4674-9b10-9e57649c693d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a48aa0a32f41398ea1dd407cf94ffb)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:17.511070 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41b1c0-873b-4674-9b10-9e57649c693d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:17.570209 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f05d95-d1ba-43ab-a292-e3dfffa9782a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:17.575028 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c060f36-b940-4d8c-9137-7093368bcfdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:17.575967 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c060f36-b940-4d8c-9137-7093368bcfdc service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:17.576245 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c060f36-b940-4d8c-9137-7093368bcfdc service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:17.576593 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c060f36-b940-4d8c-9137-7093368bcfdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:17.579595 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-7f41b1c0-873b-4674-9b10-9e57649c693d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a48aa0a32f41398ea1dd407cf94ffb'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:17.580739 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-7f41b1c0-873b-4674-9b10-9e57649c693d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a48aa0a32f41398ea1dd407cf94ffb'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:17.588393 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c060f36-b940-4d8c-9137-7093368bcfdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:17.590158 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c060f36-b940-4d8c-9137-7093368bcfdc service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:17.592411 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-7f41b1c0-873b-4674-9b10-9e57649c693d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a48aa0a32f41398ea1dd407cf94ffb'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:17.602535 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 981/1963] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:56:17.604770 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-7f41b1c0-873b-4674-9b10-9e57649c693d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a48aa0a32f41398ea1dd407cf94ffb'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:17.606257 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-7f41b1c0-873b-4674-9b10-9e57649c693d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a48aa0a32f41398ea1dd407cf94ffb'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:17.635732 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 983/1964] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:17 2022] DELETE /identity/v3/users/f9a48aa0a32f41398ea1dd407cf94ffb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:17.640199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2b075-b3d3-4205-a9f7-068369fc9ce9 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:17.640751 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2b075-b3d3-4205-a9f7-068369fc9ce9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:17.640962 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2b075-b3d3-4205-a9f7-068369fc9ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:17.663311 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-19c2b075-b3d3-4205-a9f7-068369fc9ce9 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:17.665110 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-19c2b075-b3d3-4205-a9f7-068369fc9ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:17.793811 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 982/1965] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:17.808908 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41b1c0-873b-4674-9b10-9e57649c693d admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:17.812103 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7f41b1c0-873b-4674-9b10-9e57649c693d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:17.890044 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41b1c0-873b-4674-9b10-9e57649c693d admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:17.896284 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30330128-04b9-4a5e-b476-7a31cb94ac3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:17.897296 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30330128-04b9-4a5e-b476-7a31cb94ac3b service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:17.897733 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30330128-04b9-4a5e-b476-7a31cb94ac3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:17.898157 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30330128-04b9-4a5e-b476-7a31cb94ac3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:17.912865 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30330128-04b9-4a5e-b476-7a31cb94ac3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:17.915967 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30330128-04b9-4a5e-b476-7a31cb94ac3b service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:17.928504 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 984/1966] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:18.069189 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2b075-b3d3-4205-a9f7-068369fc9ce9 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:18.070568 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-19c2b075-b3d3-4205-a9f7-068369fc9ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:18.147058 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2b075-b3d3-4205-a9f7-068369fc9ce9 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:18.151052 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261cc78-7afa-4152-a911-0e39e73dd1b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:18.151756 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261cc78-7afa-4152-a911-0e39e73dd1b0 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:18.152050 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261cc78-7afa-4152-a911-0e39e73dd1b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:18.152346 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261cc78-7afa-4152-a911-0e39e73dd1b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:18.154248 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b261cc78-7afa-4152-a911-0e39e73dd1b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:18.165300 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30330128-04b9-4a5e-b476-7a31cb94ac3b service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:18.167536 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-30330128-04b9-4a5e-b476-7a31cb94ac3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:18.183882 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30330128-04b9-4a5e-b476-7a31cb94ac3b service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:18.191410 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f37b2a-fac0-457d-afa2-bd10c96354fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:18.192592 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f37b2a-fac0-457d-afa2-bd10c96354fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:18.192859 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f37b2a-fac0-457d-afa2-bd10c96354fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:18.193206 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f37b2a-fac0-457d-afa2-bd10c96354fe admin admin] PATH_INFO: `/v3/projects/2760b63d11c945d1985f445230666de7` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:18.194861 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f37b2a-fac0-457d-afa2-bd10c96354fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2760b63d11c945d1985f445230666de7)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:18.197207 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f37b2a-fac0-457d-afa2-bd10c96354fe admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:18.234455 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261cc78-7afa-4152-a911-0e39e73dd1b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:18.235951 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261cc78-7afa-4152-a911-0e39e73dd1b0 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:18.249000 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 983/1967] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:18.274551 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-31f37b2a-fac0-457d-afa2-bd10c96354fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2760b63d11c945d1985f445230666de7', 'request_id': 'req-31f37b2a-fac0-457d-afa2-bd10c96354fe'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:18.281470 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-31f37b2a-fac0-457d-afa2-bd10c96354fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2760b63d11c945d1985f445230666de7', 'request_id': 'req-31f37b2a-fac0-457d-afa2-bd10c96354fe'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:18.288550 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-31f37b2a-fac0-457d-afa2-bd10c96354fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2760b63d11c945d1985f445230666de7', 'request_id': 'req-31f37b2a-fac0-457d-afa2-bd10c96354fe'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:18.303147 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-31f37b2a-fac0-457d-afa2-bd10c96354fe admin admin] The token cache is being invalidate because project 2760b63d11c945d1985f445230666de7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:18.303578 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-31f37b2a-fac0-457d-afa2-bd10c96354fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:18.305071 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-31f37b2a-fac0-457d-afa2-bd10c96354fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:18.309805 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 985/1968] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:18 2022] DELETE /identity/v3/projects/2760b63d11c945d1985f445230666de7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:18.311078 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261cc78-7afa-4152-a911-0e39e73dd1b0 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:18.322615 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261cc78-7afa-4152-a911-0e39e73dd1b0 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:18.387284 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10177a-4391-4a0a-9a35-040b9f2c83d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:18.387967 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10177a-4391-4a0a-9a35-040b9f2c83d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:18.388326 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10177a-4391-4a0a-9a35-040b9f2c83d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:18.388672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10177a-4391-4a0a-9a35-040b9f2c83d6 admin admin] PATH_INFO: `/v3/users/31b671c3ef8b4da4a25801ef80f35636` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:18.390436 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10177a-4391-4a0a-9a35-040b9f2c83d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b671c3ef8b4da4a25801ef80f35636)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:18.398805 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10177a-4391-4a0a-9a35-040b9f2c83d6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:18.423362 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f37b2a-fac0-457d-afa2-bd10c96354fe admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:18.425674 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-31f37b2a-fac0-457d-afa2-bd10c96354fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:18.443219 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f37b2a-fac0-457d-afa2-bd10c96354fe admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:18.449724 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb148c-6680-496e-8ac6-830c1b077346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:18.451207 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb148c-6680-496e-8ac6-830c1b077346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:18.451814 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb148c-6680-496e-8ac6-830c1b077346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:18.452281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb148c-6680-496e-8ac6-830c1b077346 admin admin] PATH_INFO: `/v3/projects/5fb8042fc2074ee3b01adfbb95533b83` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:18.455494 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb148c-6680-496e-8ac6-830c1b077346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fb8042fc2074ee3b01adfbb95533b83)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:18.460192 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb148c-6680-496e-8ac6-830c1b077346 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:18.485444 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-9f10177a-4391-4a0a-9a35-040b9f2c83d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b671c3ef8b4da4a25801ef80f35636'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:18.495792 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-9f10177a-4391-4a0a-9a35-040b9f2c83d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b671c3ef8b4da4a25801ef80f35636'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:18.504972 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-9f10177a-4391-4a0a-9a35-040b9f2c83d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b671c3ef8b4da4a25801ef80f35636'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:18.505611 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-9f10177a-4391-4a0a-9a35-040b9f2c83d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b671c3ef8b4da4a25801ef80f35636'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:18.506407 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-9f10177a-4391-4a0a-9a35-040b9f2c83d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b671c3ef8b4da4a25801ef80f35636'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:18.524105 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8ceb148c-6680-496e-8ac6-830c1b077346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fb8042fc2074ee3b01adfbb95533b83', 'request_id': 'req-8ceb148c-6680-496e-8ac6-830c1b077346'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:18.524783 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 984/1969] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:18 2022] DELETE /identity/v3/users/31b671c3ef8b4da4a25801ef80f35636 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:18.535043 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8ceb148c-6680-496e-8ac6-830c1b077346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fb8042fc2074ee3b01adfbb95533b83', 'request_id': 'req-8ceb148c-6680-496e-8ac6-830c1b077346'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:18.541207 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8ceb148c-6680-496e-8ac6-830c1b077346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fb8042fc2074ee3b01adfbb95533b83', 'request_id': 'req-8ceb148c-6680-496e-8ac6-830c1b077346'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:18.556514 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8ceb148c-6680-496e-8ac6-830c1b077346 admin admin] The token cache is being invalidate because project 5fb8042fc2074ee3b01adfbb95533b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:18.556864 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8ceb148c-6680-496e-8ac6-830c1b077346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:18.557515 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8ceb148c-6680-496e-8ac6-830c1b077346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:18.559322 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 986/1970] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:18 2022] DELETE /identity/v3/projects/5fb8042fc2074ee3b01adfbb95533b83 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:18.563164 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10177a-4391-4a0a-9a35-040b9f2c83d6 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:18.564919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9f10177a-4391-4a0a-9a35-040b9f2c83d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:18.631905 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10177a-4391-4a0a-9a35-040b9f2c83d6 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:18.636825 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be775d54-82d9-4d6a-b790-da127c8579ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:18.637708 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be775d54-82d9-4d6a-b790-da127c8579ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:18.637987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be775d54-82d9-4d6a-b790-da127c8579ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:18.638262 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be775d54-82d9-4d6a-b790-da127c8579ae admin admin] PATH_INFO: `/v3/users/2955434384c94638b2e396f22d341b58` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:18.639451 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be775d54-82d9-4d6a-b790-da127c8579ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=2955434384c94638b2e396f22d341b58)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:18.641463 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be775d54-82d9-4d6a-b790-da127c8579ae admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:18.694425 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-be775d54-82d9-4d6a-b790-da127c8579ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2955434384c94638b2e396f22d341b58'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:18.701637 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-be775d54-82d9-4d6a-b790-da127c8579ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2955434384c94638b2e396f22d341b58'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:18.709218 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-be775d54-82d9-4d6a-b790-da127c8579ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2955434384c94638b2e396f22d341b58'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:18.709874 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-be775d54-82d9-4d6a-b790-da127c8579ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2955434384c94638b2e396f22d341b58'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:18.710492 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-be775d54-82d9-4d6a-b790-da127c8579ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2955434384c94638b2e396f22d341b58'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:18.727231 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 985/1971] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:18 2022] DELETE /identity/v3/users/2955434384c94638b2e396f22d341b58 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:18.796761 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb148c-6680-496e-8ac6-830c1b077346 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:18.798836 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8ceb148c-6680-496e-8ac6-830c1b077346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:18.897676 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb148c-6680-496e-8ac6-830c1b077346 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:18.957562 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9d96c-a1d6-4990-97f9-a1cac79c0972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:18.958503 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9d96c-a1d6-4990-97f9-a1cac79c0972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:18.958849 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9d96c-a1d6-4990-97f9-a1cac79c0972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:18.959213 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9d96c-a1d6-4990-97f9-a1cac79c0972 admin admin] PATH_INFO: `/v3/projects/ccd300c59194419eb95fba032f6f8cd3` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:18.960532 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9d96c-a1d6-4990-97f9-a1cac79c0972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd300c59194419eb95fba032f6f8cd3)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:18.962560 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9d96c-a1d6-4990-97f9-a1cac79c0972 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:19.010287 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-31d9d96c-a1d6-4990-97f9-a1cac79c0972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd300c59194419eb95fba032f6f8cd3', 'request_id': 'req-31d9d96c-a1d6-4990-97f9-a1cac79c0972'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:19.016791 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-31d9d96c-a1d6-4990-97f9-a1cac79c0972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd300c59194419eb95fba032f6f8cd3', 'request_id': 'req-31d9d96c-a1d6-4990-97f9-a1cac79c0972'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:19.022598 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-31d9d96c-a1d6-4990-97f9-a1cac79c0972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd300c59194419eb95fba032f6f8cd3', 'request_id': 'req-31d9d96c-a1d6-4990-97f9-a1cac79c0972'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:19.028441 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be775d54-82d9-4d6a-b790-da127c8579ae admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:19.029973 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-be775d54-82d9-4d6a-b790-da127c8579ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:19.038203 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-31d9d96c-a1d6-4990-97f9-a1cac79c0972 admin admin] The token cache is being invalidate because project ccd300c59194419eb95fba032f6f8cd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:19.038635 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-31d9d96c-a1d6-4990-97f9-a1cac79c0972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:19.039275 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-31d9d96c-a1d6-4990-97f9-a1cac79c0972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:19.044186 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 987/1972] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:18 2022] DELETE /identity/v3/projects/ccd300c59194419eb95fba032f6f8cd3 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:19.045553 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831724e7-5385-4e73-a03f-7e312802c4b8 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:19.045844 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831724e7-5385-4e73-a03f-7e312802c4b8 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:19.046121 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831724e7-5385-4e73-a03f-7e312802c4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:19.051222 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be775d54-82d9-4d6a-b790-da127c8579ae admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:19.071725 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-831724e7-5385-4e73-a03f-7e312802c4b8 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:19.073011 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-831724e7-5385-4e73-a03f-7e312802c4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:19.128319 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef222f-f21f-4f01-80a8-bd36a429071e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:19.129733 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef222f-f21f-4f01-80a8-bd36a429071e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:19.130026 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef222f-f21f-4f01-80a8-bd36a429071e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:19.130308 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef222f-f21f-4f01-80a8-bd36a429071e admin admin] PATH_INFO: `/v3/projects/57d0108190bd4021b7c9a1688e20c1a2` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:19.134452 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef222f-f21f-4f01-80a8-bd36a429071e admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d0108190bd4021b7c9a1688e20c1a2)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:19.137268 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef222f-f21f-4f01-80a8-bd36a429071e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:19.154342 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 988/1973] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:19.163216 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2dec4-0a91-441f-9a90-c72559f5ba4f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:19.164678 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2dec4-0a91-441f-9a90-c72559f5ba4f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:19.165132 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2dec4-0a91-441f-9a90-c72559f5ba4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:19.198557 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7eb2dec4-0a91-441f-9a90-c72559f5ba4f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:19.199003 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-82ef222f-f21f-4f01-80a8-bd36a429071e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d0108190bd4021b7c9a1688e20c1a2', 'request_id': 'req-82ef222f-f21f-4f01-80a8-bd36a429071e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:19.199786 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7eb2dec4-0a91-441f-9a90-c72559f5ba4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:19.208625 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-82ef222f-f21f-4f01-80a8-bd36a429071e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d0108190bd4021b7c9a1688e20c1a2', 'request_id': 'req-82ef222f-f21f-4f01-80a8-bd36a429071e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:19.215162 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-82ef222f-f21f-4f01-80a8-bd36a429071e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d0108190bd4021b7c9a1688e20c1a2', 'request_id': 'req-82ef222f-f21f-4f01-80a8-bd36a429071e'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:19.227095 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-82ef222f-f21f-4f01-80a8-bd36a429071e admin admin] The token cache is being invalidate because project 57d0108190bd4021b7c9a1688e20c1a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:19.227586 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-82ef222f-f21f-4f01-80a8-bd36a429071e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:19.228781 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-82ef222f-f21f-4f01-80a8-bd36a429071e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:19.231842 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 986/1974] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:19 2022] DELETE /identity/v3/projects/57d0108190bd4021b7c9a1688e20c1a2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:19.234594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d6f8a-1ada-4031-bcab-66e95604013d None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:19.235976 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d6f8a-1ada-4031-bcab-66e95604013d None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:19.236377 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d6f8a-1ada-4031-bcab-66e95604013d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:19.260849 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-a10d6f8a-1ada-4031-bcab-66e95604013d None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:19.262091 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a10d6f8a-1ada-4031-bcab-66e95604013d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:19.302242 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 989/1975] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:19.306729 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2dec4-0a91-441f-9a90-c72559f5ba4f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:19.320641 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2dec4-0a91-441f-9a90-c72559f5ba4f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:19.326082 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724a05f-e169-413d-bd44-81ca4be7345d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:19.327652 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724a05f-e169-413d-bd44-81ca4be7345d admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:19.327948 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724a05f-e169-413d-bd44-81ca4be7345d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:19.328230 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724a05f-e169-413d-bd44-81ca4be7345d admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:19.328972 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724a05f-e169-413d-bd44-81ca4be7345d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:19.329522 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724a05f-e169-413d-bd44-81ca4be7345d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:19.332833 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724a05f-e169-413d-bd44-81ca4be7345d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:19.350307 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 990/1976] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:56:19.355805 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 987/1977] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:19.355993 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724a05f-e169-413d-bd44-81ca4be7345d admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:19.359408 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d3310-8c00-42f9-a4ef-4e55dd1dfba3 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:19.359724 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d3310-8c00-42f9-a4ef-4e55dd1dfba3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:19.360007 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d3310-8c00-42f9-a4ef-4e55dd1dfba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:19.363075 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724a05f-e169-413d-bd44-81ca4be7345d admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:19.368102 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049dd28-a572-4bc7-ae80-8600feeaf037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:19.368794 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049dd28-a572-4bc7-ae80-8600feeaf037 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:19.369041 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049dd28-a572-4bc7-ae80-8600feeaf037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:19.369345 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049dd28-a572-4bc7-ae80-8600feeaf037 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:19.370103 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049dd28-a572-4bc7-ae80-8600feeaf037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:19.372056 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049dd28-a572-4bc7-ae80-8600feeaf037 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:19.387362 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c43d3310-8c00-42f9-a4ef-4e55dd1dfba3 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:19.388684 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c43d3310-8c00-42f9-a4ef-4e55dd1dfba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:19.400282 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 988/1978] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:19.401951 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d3310-8c00-42f9-a4ef-4e55dd1dfba3 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:19.403226 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c43d3310-8c00-42f9-a4ef-4e55dd1dfba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:19.406850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 991/1979] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:19 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:19.406850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049dd28-a572-4bc7-ae80-8600feeaf037 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:19.462609 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d3310-8c00-42f9-a4ef-4e55dd1dfba3 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:19.467791 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049dd28-a572-4bc7-ae80-8600feeaf037 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:19.473040 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ebd5b-3d92-403e-8e24-2c4bbdc236f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:19.473706 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ebd5b-3d92-403e-8e24-2c4bbdc236f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:19.473999 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ebd5b-3d92-403e-8e24-2c4bbdc236f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:19.474279 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ebd5b-3d92-403e-8e24-2c4bbdc236f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:19.475008 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ebd5b-3d92-403e-8e24-2c4bbdc236f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:19.475316 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ebd5b-3d92-403e-8e24-2c4bbdc236f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:19.476963 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ebd5b-3d92-403e-8e24-2c4bbdc236f4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:19.487969 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 992/1980] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:56:19.488743 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ebd5b-3d92-403e-8e24-2c4bbdc236f4 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:19.498125 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ebd5b-3d92-403e-8e24-2c4bbdc236f4 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:19.503259 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc67a33-24cc-43cb-a4b4-cbf5e4c3ce6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:19.503936 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc67a33-24cc-43cb-a4b4-cbf5e4c3ce6c admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:19.504218 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc67a33-24cc-43cb-a4b4-cbf5e4c3ce6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:19.504497 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc67a33-24cc-43cb-a4b4-cbf5e4c3ce6c admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:19.505173 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc67a33-24cc-43cb-a4b4-cbf5e4c3ce6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:19.507072 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc67a33-24cc-43cb-a4b4-cbf5e4c3ce6c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:19.510389 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc5fea-f85e-47be-b945-da261a21f11b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:19.511098 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc5fea-f85e-47be-b945-da261a21f11b service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:19.511322 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc5fea-f85e-47be-b945-da261a21f11b service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:19.511597 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc5fea-f85e-47be-b945-da261a21f11b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:19.513403 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c8bc5fea-f85e-47be-b945-da261a21f11b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:19.531140 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 993/1981] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:19 2022] POST /identity/v3/users => generated 285 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:19.531140 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc67a33-24cc-43cb-a4b4-cbf5e4c3ce6c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:19.543571 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc67a33-24cc-43cb-a4b4-cbf5e4c3ce6c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:19.548798 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da27be-1233-4585-a8da-3cc87283cee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:19.549560 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da27be-1233-4585-a8da-3cc87283cee6 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:19.549929 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da27be-1233-4585-a8da-3cc87283cee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:19.550205 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da27be-1233-4585-a8da-3cc87283cee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:19.551082 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da27be-1233-4585-a8da-3cc87283cee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:19.553094 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da27be-1233-4585-a8da-3cc87283cee6 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:19.580414 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 994/1982] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:19 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:19.582126 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da27be-1233-4585-a8da-3cc87283cee6 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:19.586844 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc5fea-f85e-47be-b945-da261a21f11b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:19.588341 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc5fea-f85e-47be-b945-da261a21f11b service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:19.598326 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 989/1983] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:19.599748 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc5fea-f85e-47be-b945-da261a21f11b service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:19.609980 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc5fea-f85e-47be-b945-da261a21f11b service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:19.643988 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da27be-1233-4585-a8da-3cc87283cee6 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:19.650329 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8461d-272c-4350-b0bc-a06205ac0ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:19.651012 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8461d-272c-4350-b0bc-a06205ac0ecf admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:19.651299 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8461d-272c-4350-b0bc-a06205ac0ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:19.652187 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8461d-272c-4350-b0bc-a06205ac0ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:19.652940 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8461d-272c-4350-b0bc-a06205ac0ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:19.654620 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8461d-272c-4350-b0bc-a06205ac0ecf admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:19.667879 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 995/1984] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:19.669717 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8461d-272c-4350-b0bc-a06205ac0ecf admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:19.673199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818b904-68b1-4125-a39f-db7f3ebd23d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:19.673911 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818b904-68b1-4125-a39f-db7f3ebd23d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:19.674192 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818b904-68b1-4125-a39f-db7f3ebd23d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:19.674543 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818b904-68b1-4125-a39f-db7f3ebd23d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:19.675236 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818b904-68b1-4125-a39f-db7f3ebd23d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:19.677392 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818b904-68b1-4125-a39f-db7f3ebd23d3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:19.681331 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8461d-272c-4350-b0bc-a06205ac0ecf admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:19.686279 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b75bc-f675-49a2-b5b3-10bb5c4c9477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:19.687108 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b75bc-f675-49a2-b5b3-10bb5c4c9477 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:19.687729 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b75bc-f675-49a2-b5b3-10bb5c4c9477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:19.687856 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b75bc-f675-49a2-b5b3-10bb5c4c9477 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:19.688759 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b75bc-f675-49a2-b5b3-10bb5c4c9477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:19.691288 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b75bc-f675-49a2-b5b3-10bb5c4c9477 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:19.698191 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 990/1985] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:19 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:19.702421 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818b904-68b1-4125-a39f-db7f3ebd23d3 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:19.703666 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 996/1986] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:19.708243 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b75bc-f675-49a2-b5b3-10bb5c4c9477 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:19.712891 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818b904-68b1-4125-a39f-db7f3ebd23d3 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:19.719144 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adca66-088a-4997-917b-2dfd1f714cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:19.719704 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b75bc-f675-49a2-b5b3-10bb5c4c9477 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:19.719848 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adca66-088a-4997-917b-2dfd1f714cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:19.720133 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adca66-088a-4997-917b-2dfd1f714cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:19.720410 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adca66-088a-4997-917b-2dfd1f714cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:19.721144 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adca66-088a-4997-917b-2dfd1f714cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:19.723660 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adca66-088a-4997-917b-2dfd1f714cb5 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:19.727206 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02139fe-96c7-457d-9df5-4047615beb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:19.728125 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02139fe-96c7-457d-9df5-4047615beb24 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:19.728409 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02139fe-96c7-457d-9df5-4047615beb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:19.728686 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02139fe-96c7-457d-9df5-4047615beb24 admin admin] PATH_INFO: `/v3/projects/428c7db5869949729fbf6e63bfa6dfbe/users/ace3cc5cca21458789c99ddbe67ae6ca/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:19.734458 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 991/1987] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:56:19.738866 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adca66-088a-4997-917b-2dfd1f714cb5 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:19.745420 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02139fe-96c7-457d-9df5-4047615beb24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=428c7db5869949729fbf6e63bfa6dfbe, user_id=ace3cc5cca21458789c99ddbe67ae6ca, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:19.748201 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02139fe-96c7-457d-9df5-4047615beb24 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:19.749544 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adca66-088a-4997-917b-2dfd1f714cb5 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:19.754788 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2ef08-f319-4c92-8e58-41544769929f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:19.755504 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2ef08-f319-4c92-8e58-41544769929f admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:19.755846 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2ef08-f319-4c92-8e58-41544769929f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:19.756127 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2ef08-f319-4c92-8e58-41544769929f admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:19.756856 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2ef08-f319-4c92-8e58-41544769929f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:19.758448 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2ef08-f319-4c92-8e58-41544769929f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:19.761340 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 997/1988] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:19 2022] PUT /identity/v3/projects/428c7db5869949729fbf6e63bfa6dfbe/users/ace3cc5cca21458789c99ddbe67ae6ca/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:19.768878 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 992/1989] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:56:19.771586 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bd1fc-86b8-4f14-a7ba-c3fefba4627c None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:19.771916 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bd1fc-86b8-4f14-a7ba-c3fefba4627c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:19.772203 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bd1fc-86b8-4f14-a7ba-c3fefba4627c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:19.772846 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2ef08-f319-4c92-8e58-41544769929f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:19.782248 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2ef08-f319-4c92-8e58-41544769929f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:19.798232 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-5f5bd1fc-86b8-4f14-a7ba-c3fefba4627c None None] MFA Rules not processed for user `ace3cc5cca21458789c99ddbe67ae6ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:19.800054 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5f5bd1fc-86b8-4f14-a7ba-c3fefba4627c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:19.837999 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111e4fc-97ca-4655-835c-3c722c356c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:19.838887 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111e4fc-97ca-4655-835c-3c722c356c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:19.839167 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111e4fc-97ca-4655-835c-3c722c356c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:19.839438 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111e4fc-97ca-4655-835c-3c722c356c02 admin admin] PATH_INFO: `/v3/projects/0ec9fc40c15d4b7aa0dc0e75eb3b3716/users/68108036518f4673906aa150203ad82d/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:19.854271 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111e4fc-97ca-4655-835c-3c722c356c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec9fc40c15d4b7aa0dc0e75eb3b3716, user_id=68108036518f4673906aa150203ad82d, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:19.857008 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111e4fc-97ca-4655-835c-3c722c356c02 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:19.861337 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 998/1990] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:19.867182 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bd1fc-86b8-4f14-a7ba-c3fefba4627c None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:19.871021 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 993/1991] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:19 2022] PUT /identity/v3/projects/0ec9fc40c15d4b7aa0dc0e75eb3b3716/users/68108036518f4673906aa150203ad82d/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:19.879447 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bd1fc-86b8-4f14-a7ba-c3fefba4627c None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:19.881394 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621122b-94f5-4b69-90fd-cf628cd4940a None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:19.881675 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621122b-94f5-4b69-90fd-cf628cd4940a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:19.881952 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621122b-94f5-4b69-90fd-cf628cd4940a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:19.913014 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-6621122b-94f5-4b69-90fd-cf628cd4940a None None] MFA Rules not processed for user `68108036518f4673906aa150203ad82d`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:19.914405 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6621122b-94f5-4b69-90fd-cf628cd4940a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:19.943298 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37e5f2-b3e6-44e3-81bb-b6af4729a678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:19.943999 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37e5f2-b3e6-44e3-81bb-b6af4729a678 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:19.944284 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37e5f2-b3e6-44e3-81bb-b6af4729a678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:19.944560 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37e5f2-b3e6-44e3-81bb-b6af4729a678 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:19.945272 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37e5f2-b3e6-44e3-81bb-b6af4729a678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:19.947161 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37e5f2-b3e6-44e3-81bb-b6af4729a678 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:19.976855 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 999/1992] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:19 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:19.981142 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37e5f2-b3e6-44e3-81bb-b6af4729a678 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:19.995315 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 994/1993] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:19.996554 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621122b-94f5-4b69-90fd-cf628cd4940a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:20.010082 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621122b-94f5-4b69-90fd-cf628cd4940a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:20.042071 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37e5f2-b3e6-44e3-81bb-b6af4729a678 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:20.046656 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c80c7-a606-4c04-b1e4-4222abc9eba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:20.047330 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c80c7-a606-4c04-b1e4-4222abc9eba7 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:20.047622 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c80c7-a606-4c04-b1e4-4222abc9eba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:20.048176 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c80c7-a606-4c04-b1e4-4222abc9eba7 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:20.048868 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c80c7-a606-4c04-b1e4-4222abc9eba7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:20.051038 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c80c7-a606-4c04-b1e4-4222abc9eba7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:20.066096 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbafe1-af22-4e82-960c-faf6a8282129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:20.066761 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbafe1-af22-4e82-960c-faf6a8282129 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:20.067044 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbafe1-af22-4e82-960c-faf6a8282129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:20.067320 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbafe1-af22-4e82-960c-faf6a8282129 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:20.068071 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cbafe1-af22-4e82-960c-faf6a8282129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:20.069968 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cbafe1-af22-4e82-960c-faf6a8282129 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:20.071147 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1000/1994] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:19 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:20.075005 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c80c7-a606-4c04-b1e4-4222abc9eba7 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:20.085859 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c80c7-a606-4c04-b1e4-4222abc9eba7 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:20.090991 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33440c5d-263b-4cc2-b11c-466da61dc7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:20.091671 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33440c5d-263b-4cc2-b11c-466da61dc7fd admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:20.092009 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33440c5d-263b-4cc2-b11c-466da61dc7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:20.092287 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33440c5d-263b-4cc2-b11c-466da61dc7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:20.093011 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33440c5d-263b-4cc2-b11c-466da61dc7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:20.094599 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33440c5d-263b-4cc2-b11c-466da61dc7fd admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:20.095408 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 995/1995] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:19 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:20.099899 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbafe1-af22-4e82-960c-faf6a8282129 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:20.108451 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1001/1996] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:20.109396 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33440c5d-263b-4cc2-b11c-466da61dc7fd admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:20.119164 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33440c5d-263b-4cc2-b11c-466da61dc7fd admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:20.161853 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbafe1-af22-4e82-960c-faf6a8282129 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:20.166992 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a832f-31ec-41c4-8de9-bae33944eea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:20.167738 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a832f-31ec-41c4-8de9-bae33944eea2 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:20.168014 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a832f-31ec-41c4-8de9-bae33944eea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:20.168290 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a832f-31ec-41c4-8de9-bae33944eea2 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:20.168992 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a832f-31ec-41c4-8de9-bae33944eea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:20.170943 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a832f-31ec-41c4-8de9-bae33944eea2 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:20.181763 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740470a4-99d5-402c-9a1f-99b05baf0a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:20.182744 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740470a4-99d5-402c-9a1f-99b05baf0a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:20.183089 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740470a4-99d5-402c-9a1f-99b05baf0a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:20.183374 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740470a4-99d5-402c-9a1f-99b05baf0a0a admin admin] PATH_INFO: `/v3/projects/45f68d056c5c47c3b7ad9db1877b8eed/users/b983b644411a43f2b222c843eaa1702d/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:20.194724 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 996/1997] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:20 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:20.195932 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a832f-31ec-41c4-8de9-bae33944eea2 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:20.200260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740470a4-99d5-402c-9a1f-99b05baf0a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f68d056c5c47c3b7ad9db1877b8eed, user_id=b983b644411a43f2b222c843eaa1702d, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:20.203115 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740470a4-99d5-402c-9a1f-99b05baf0a0a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:20.205469 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a832f-31ec-41c4-8de9-bae33944eea2 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:20.211534 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30acc94-5a1e-4929-8e90-45f4dc479cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:20.212331 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30acc94-5a1e-4929-8e90-45f4dc479cca admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:20.212618 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30acc94-5a1e-4929-8e90-45f4dc479cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:20.212896 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30acc94-5a1e-4929-8e90-45f4dc479cca admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:20.213633 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30acc94-5a1e-4929-8e90-45f4dc479cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:20.215213 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30acc94-5a1e-4929-8e90-45f4dc479cca admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:20.216240 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1002/1998] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:20 2022] PUT /identity/v3/projects/45f68d056c5c47c3b7ad9db1877b8eed/users/b983b644411a43f2b222c843eaa1702d/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:20.220062 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740470a4-99d5-402c-9a1f-99b05baf0a0a admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:20.229116 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 997/1999] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:20.230084 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30acc94-5a1e-4929-8e90-45f4dc479cca admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:20.239352 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30acc94-5a1e-4929-8e90-45f4dc479cca admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:20.278493 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740470a4-99d5-402c-9a1f-99b05baf0a0a admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:20.283180 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbbcc4-61e8-4ad4-930c-caeb86ca5fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:20.283900 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbbcc4-61e8-4ad4-930c-caeb86ca5fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:20.284177 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbbcc4-61e8-4ad4-930c-caeb86ca5fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:20.284451 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbbcc4-61e8-4ad4-930c-caeb86ca5fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:20.285170 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbbcc4-61e8-4ad4-930c-caeb86ca5fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:20.286742 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbbcc4-61e8-4ad4-930c-caeb86ca5fc1 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:20.293733 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59eca05-8702-4e53-830e-ad893b5e4799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:20.294563 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59eca05-8702-4e53-830e-ad893b5e4799 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:20.294881 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59eca05-8702-4e53-830e-ad893b5e4799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:20.295155 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59eca05-8702-4e53-830e-ad893b5e4799 admin admin] PATH_INFO: `/v3/projects/fc780401cd1846d7a52a267dc5029a6b/users/8717495462c349ccb3131d1a2e427d1d/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:20.304496 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1003/2000] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:56:20.308693 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbbcc4-61e8-4ad4-930c-caeb86ca5fc1 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:20.312092 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59eca05-8702-4e53-830e-ad893b5e4799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc780401cd1846d7a52a267dc5029a6b, user_id=8717495462c349ccb3131d1a2e427d1d, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:20.314769 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59eca05-8702-4e53-830e-ad893b5e4799 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:20.318953 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbbcc4-61e8-4ad4-930c-caeb86ca5fc1 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:20.324545 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65310b1d-a511-4f64-9930-0e6f6e1c5327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:20.325811 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65310b1d-a511-4f64-9930-0e6f6e1c5327 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:20.326085 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65310b1d-a511-4f64-9930-0e6f6e1c5327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:20.326373 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65310b1d-a511-4f64-9930-0e6f6e1c5327 admin admin] PATH_INFO: `/v3/projects/45f68d056c5c47c3b7ad9db1877b8eed/users/b983b644411a43f2b222c843eaa1702d/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:20.329418 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65310b1d-a511-4f64-9930-0e6f6e1c5327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f68d056c5c47c3b7ad9db1877b8eed, user_id=b983b644411a43f2b222c843eaa1702d, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:20.329568 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 998/2001] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:20 2022] PUT /identity/v3/projects/fc780401cd1846d7a52a267dc5029a6b/users/8717495462c349ccb3131d1a2e427d1d/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:20.333987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59eca05-8702-4e53-830e-ad893b5e4799 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:20.335727 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65310b1d-a511-4f64-9930-0e6f6e1c5327 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:20.352003 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1004/2002] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:20 2022] PUT /identity/v3/projects/45f68d056c5c47c3b7ad9db1877b8eed/users/b983b644411a43f2b222c843eaa1702d/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:20.364518 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b32f36-f6f1-41cd-b6e5-0365b9e7aba5 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:20.364914 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b32f36-f6f1-41cd-b6e5-0365b9e7aba5 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:20.365200 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b32f36-f6f1-41cd-b6e5-0365b9e7aba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:20.392392 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-f6b32f36-f6f1-41cd-b6e5-0365b9e7aba5 None None] MFA Rules not processed for user `b983b644411a43f2b222c843eaa1702d`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:20.394467 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f6b32f36-f6f1-41cd-b6e5-0365b9e7aba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:20.410704 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59eca05-8702-4e53-830e-ad893b5e4799 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:20.462858 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1005/2003] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:20 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:20.469861 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5183364-3b33-466a-9c91-7a4342405207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:20.470544 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5183364-3b33-466a-9c91-7a4342405207 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:20.470828 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5183364-3b33-466a-9c91-7a4342405207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:20.471105 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5183364-3b33-466a-9c91-7a4342405207 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:20.471987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5183364-3b33-466a-9c91-7a4342405207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:20.473803 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5183364-3b33-466a-9c91-7a4342405207 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:20.474467 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b32f36-f6f1-41cd-b6e5-0365b9e7aba5 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:20.484253 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 999/2004] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:56:20.488354 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5183364-3b33-466a-9c91-7a4342405207 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:20.498133 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5183364-3b33-466a-9c91-7a4342405207 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:20.503346 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82662681-60cf-411a-9a12-410d649f9781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:20.504270 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82662681-60cf-411a-9a12-410d649f9781 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:20.504554 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82662681-60cf-411a-9a12-410d649f9781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:20.504831 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82662681-60cf-411a-9a12-410d649f9781 admin admin] PATH_INFO: `/v3/projects/fc780401cd1846d7a52a267dc5029a6b/users/8717495462c349ccb3131d1a2e427d1d/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:20.506856 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82662681-60cf-411a-9a12-410d649f9781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc780401cd1846d7a52a267dc5029a6b, user_id=8717495462c349ccb3131d1a2e427d1d, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:20.509528 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82662681-60cf-411a-9a12-410d649f9781 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:20.521249 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1000/2005] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:20 2022] PUT /identity/v3/projects/fc780401cd1846d7a52a267dc5029a6b/users/8717495462c349ccb3131d1a2e427d1d/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:20.531958 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b8d25-e416-44fe-b29c-e2a352c5fadb None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:20.532252 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b8d25-e416-44fe-b29c-e2a352c5fadb None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:20.532533 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b8d25-e416-44fe-b29c-e2a352c5fadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:20.532933 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b32f36-f6f1-41cd-b6e5-0365b9e7aba5 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:20.560226 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-7d4b8d25-e416-44fe-b29c-e2a352c5fadb None None] MFA Rules not processed for user `8717495462c349ccb3131d1a2e427d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:20.561494 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7d4b8d25-e416-44fe-b29c-e2a352c5fadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:20.592332 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6250c-07a3-406e-bfd8-e546b09bd6f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:20.593019 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6250c-07a3-406e-bfd8-e546b09bd6f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:20.593301 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6250c-07a3-406e-bfd8-e546b09bd6f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:20.593575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6250c-07a3-406e-bfd8-e546b09bd6f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:20.647863 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1001/2006] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:20.658355 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b8d25-e416-44fe-b29c-e2a352c5fadb None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:20.659876 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7d4b8d25-e416-44fe-b29c-e2a352c5fadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:20.660125 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6250c-07a3-406e-bfd8-e546b09bd6f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:20.661565 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6250c-07a3-406e-bfd8-e546b09bd6f8 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:20.671007 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1006/2007] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:20 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:56:20.671210 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b8d25-e416-44fe-b29c-e2a352c5fadb None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:20.676124 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d57f44-0956-4123-8cf4-f72e689f9da2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:20.676771 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d57f44-0956-4123-8cf4-f72e689f9da2 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:20.677407 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d57f44-0956-4123-8cf4-f72e689f9da2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:20.677407 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d57f44-0956-4123-8cf4-f72e689f9da2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:20.686467 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d57f44-0956-4123-8cf4-f72e689f9da2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:20.687922 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d57f44-0956-4123-8cf4-f72e689f9da2 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:20.700248 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1002/2008] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:56:20.716856 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6250c-07a3-406e-bfd8-e546b09bd6f8 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:20.725736 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6250c-07a3-406e-bfd8-e546b09bd6f8 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:20.729674 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731819ca-7df6-4bcd-87bc-68d8c61626e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:20.730314 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731819ca-7df6-4bcd-87bc-68d8c61626e8 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:20.730594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731819ca-7df6-4bcd-87bc-68d8c61626e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:20.730869 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731819ca-7df6-4bcd-87bc-68d8c61626e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:20.790172 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731819ca-7df6-4bcd-87bc-68d8c61626e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:20.791799 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731819ca-7df6-4bcd-87bc-68d8c61626e8 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:20.802255 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1007/2009] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:20 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:21.181646 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d57f44-0956-4123-8cf4-f72e689f9da2 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:21.245180 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d57f44-0956-4123-8cf4-f72e689f9da2 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:21.249731 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e42ce5-2d4c-4e10-ae67-e85e53ff720b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:21.250604 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e42ce5-2d4c-4e10-ae67-e85e53ff720b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:21.250891 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e42ce5-2d4c-4e10-ae67-e85e53ff720b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:21.251165 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e42ce5-2d4c-4e10-ae67-e85e53ff720b admin admin] PATH_INFO: `/v3/users/68108036518f4673906aa150203ad82d` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:21.252878 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e42ce5-2d4c-4e10-ae67-e85e53ff720b admin admin] RBAC: Authorizing `identity:delete_user(user_id=68108036518f4673906aa150203ad82d)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:21.254956 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e42ce5-2d4c-4e10-ae67-e85e53ff720b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:21.299590 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-44e42ce5-2d4c-4e10-ae67-e85e53ff720b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68108036518f4673906aa150203ad82d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:21.306202 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-44e42ce5-2d4c-4e10-ae67-e85e53ff720b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68108036518f4673906aa150203ad82d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:21.312616 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-44e42ce5-2d4c-4e10-ae67-e85e53ff720b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68108036518f4673906aa150203ad82d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:21.313330 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-44e42ce5-2d4c-4e10-ae67-e85e53ff720b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68108036518f4673906aa150203ad82d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:21.313947 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-44e42ce5-2d4c-4e10-ae67-e85e53ff720b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68108036518f4673906aa150203ad82d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:21.333354 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1003/2010] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:21 2022] DELETE /identity/v3/users/68108036518f4673906aa150203ad82d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:21.338115 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddec196-fcd8-4a0a-a9f9-f17ac63a31fb None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:21.338481 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddec196-fcd8-4a0a-a9f9-f17ac63a31fb None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:21.338829 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddec196-fcd8-4a0a-a9f9-f17ac63a31fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:21.356147 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7ddec196-fcd8-4a0a-a9f9-f17ac63a31fb None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:21.357342 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7ddec196-fcd8-4a0a-a9f9-f17ac63a31fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:21.419392 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1008/2011] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:21.430064 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e42ce5-2d4c-4e10-ae67-e85e53ff720b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:21.431643 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-44e42ce5-2d4c-4e10-ae67-e85e53ff720b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:21.489263 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e42ce5-2d4c-4e10-ae67-e85e53ff720b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:21.492995 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830ab83-f333-4e9d-9eb5-d5ed52d61400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:21.493637 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830ab83-f333-4e9d-9eb5-d5ed52d61400 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:21.493916 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830ab83-f333-4e9d-9eb5-d5ed52d61400 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:21.494189 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830ab83-f333-4e9d-9eb5-d5ed52d61400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:21.503669 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830ab83-f333-4e9d-9eb5-d5ed52d61400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:21.505140 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830ab83-f333-4e9d-9eb5-d5ed52d61400 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:21.514370 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1004/2012] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:22.008658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddec196-fcd8-4a0a-a9f9-f17ac63a31fb None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:22.010472 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7ddec196-fcd8-4a0a-a9f9-f17ac63a31fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:22.026476 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddec196-fcd8-4a0a-a9f9-f17ac63a31fb None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:22.032309 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882c10a-ec68-4f6f-85ce-ee8333367401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:22.033314 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882c10a-ec68-4f6f-85ce-ee8333367401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:22.033727 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882c10a-ec68-4f6f-85ce-ee8333367401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:22.034099 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882c10a-ec68-4f6f-85ce-ee8333367401 admin admin] PATH_INFO: `/v3/projects/0ec9fc40c15d4b7aa0dc0e75eb3b3716` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:22.035493 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882c10a-ec68-4f6f-85ce-ee8333367401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ec9fc40c15d4b7aa0dc0e75eb3b3716)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:22.037586 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882c10a-ec68-4f6f-85ce-ee8333367401 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:22.121929 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a882c10a-ec68-4f6f-85ce-ee8333367401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ec9fc40c15d4b7aa0dc0e75eb3b3716', 'request_id': 'req-a882c10a-ec68-4f6f-85ce-ee8333367401'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:22.132224 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a882c10a-ec68-4f6f-85ce-ee8333367401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ec9fc40c15d4b7aa0dc0e75eb3b3716', 'request_id': 'req-a882c10a-ec68-4f6f-85ce-ee8333367401'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:22.155894 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a882c10a-ec68-4f6f-85ce-ee8333367401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ec9fc40c15d4b7aa0dc0e75eb3b3716', 'request_id': 'req-a882c10a-ec68-4f6f-85ce-ee8333367401'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:22.170450 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a882c10a-ec68-4f6f-85ce-ee8333367401 admin admin] The token cache is being invalidate because project 0ec9fc40c15d4b7aa0dc0e75eb3b3716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:22.170707 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a882c10a-ec68-4f6f-85ce-ee8333367401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:22.171468 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a882c10a-ec68-4f6f-85ce-ee8333367401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:22.173379 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1009/2013] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:22 2022] DELETE /identity/v3/projects/0ec9fc40c15d4b7aa0dc0e75eb3b3716 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:22.178230 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830ab83-f333-4e9d-9eb5-d5ed52d61400 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:22.189178 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830ab83-f333-4e9d-9eb5-d5ed52d61400 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:22.271684 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27107c5d-501a-41d9-b470-40434b9aeff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:22.272646 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27107c5d-501a-41d9-b470-40434b9aeff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:22.272931 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27107c5d-501a-41d9-b470-40434b9aeff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:22.273199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27107c5d-501a-41d9-b470-40434b9aeff9 admin admin] PATH_INFO: `/v3/users/8717495462c349ccb3131d1a2e427d1d` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:22.274535 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27107c5d-501a-41d9-b470-40434b9aeff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8717495462c349ccb3131d1a2e427d1d)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:22.277289 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27107c5d-501a-41d9-b470-40434b9aeff9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:22.339878 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-27107c5d-501a-41d9-b470-40434b9aeff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8717495462c349ccb3131d1a2e427d1d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:22.347314 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-27107c5d-501a-41d9-b470-40434b9aeff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8717495462c349ccb3131d1a2e427d1d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:22.355783 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-27107c5d-501a-41d9-b470-40434b9aeff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8717495462c349ccb3131d1a2e427d1d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:22.356402 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-27107c5d-501a-41d9-b470-40434b9aeff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8717495462c349ccb3131d1a2e427d1d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:22.357104 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-27107c5d-501a-41d9-b470-40434b9aeff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8717495462c349ccb3131d1a2e427d1d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:22.383686 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1005/2014] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:22 2022] DELETE /identity/v3/users/8717495462c349ccb3131d1a2e427d1d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:22.703137 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882c10a-ec68-4f6f-85ce-ee8333367401 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:22.705060 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a882c10a-ec68-4f6f-85ce-ee8333367401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:22.725699 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882c10a-ec68-4f6f-85ce-ee8333367401 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:22.786184 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0facda-5cf5-46bb-a837-d958b7cb1dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:22.787351 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0facda-5cf5-46bb-a837-d958b7cb1dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:22.787796 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0facda-5cf5-46bb-a837-d958b7cb1dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:22.788083 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0facda-5cf5-46bb-a837-d958b7cb1dbc admin admin] PATH_INFO: `/v3/projects/fc780401cd1846d7a52a267dc5029a6b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:22.789495 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0facda-5cf5-46bb-a837-d958b7cb1dbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc780401cd1846d7a52a267dc5029a6b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:22.791819 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0facda-5cf5-46bb-a837-d958b7cb1dbc admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:22.837405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-db0facda-5cf5-46bb-a837-d958b7cb1dbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc780401cd1846d7a52a267dc5029a6b', 'request_id': 'req-db0facda-5cf5-46bb-a837-d958b7cb1dbc'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:22.843287 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-db0facda-5cf5-46bb-a837-d958b7cb1dbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc780401cd1846d7a52a267dc5029a6b', 'request_id': 'req-db0facda-5cf5-46bb-a837-d958b7cb1dbc'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:22.849084 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-db0facda-5cf5-46bb-a837-d958b7cb1dbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc780401cd1846d7a52a267dc5029a6b', 'request_id': 'req-db0facda-5cf5-46bb-a837-d958b7cb1dbc'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:22.860795 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-db0facda-5cf5-46bb-a837-d958b7cb1dbc admin admin] The token cache is being invalidate because project fc780401cd1846d7a52a267dc5029a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:22.861097 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-db0facda-5cf5-46bb-a837-d958b7cb1dbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:22.862328 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-db0facda-5cf5-46bb-a837-d958b7cb1dbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:22.864449 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1010/2015] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:22 2022] DELETE /identity/v3/projects/fc780401cd1846d7a52a267dc5029a6b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:22.870158 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1d20b-94a2-426b-a020-79abfbf5697f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:22.870623 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1d20b-94a2-426b-a020-79abfbf5697f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:22.870726 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec1d20b-94a2-426b-a020-79abfbf5697f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:22.889853 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4ec1d20b-94a2-426b-a020-79abfbf5697f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:22.891094 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4ec1d20b-94a2-426b-a020-79abfbf5697f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:22.950039 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1006/2016] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:22.958628 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d54177-7070-4433-b373-33977852206b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:22.958922 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d54177-7070-4433-b373-33977852206b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:22.959203 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d54177-7070-4433-b373-33977852206b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:22.977792 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-04d54177-7070-4433-b373-33977852206b None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:22.979020 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-04d54177-7070-4433-b373-33977852206b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:22.986938 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1011/2017] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:22.991007 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1d20b-94a2-426b-a020-79abfbf5697f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:23.000710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec1d20b-94a2-426b-a020-79abfbf5697f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:23.005321 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5a899-c23d-4863-ab25-6d065a13ab82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:23.005986 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5a899-c23d-4863-ab25-6d065a13ab82 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:23.006268 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5a899-c23d-4863-ab25-6d065a13ab82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:23.006543 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5a899-c23d-4863-ab25-6d065a13ab82 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:23.007278 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5a899-c23d-4863-ab25-6d065a13ab82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:23.007586 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5a899-c23d-4863-ab25-6d065a13ab82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:23.009235 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5a899-c23d-4863-ab25-6d065a13ab82 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:23.021412 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1007/2018] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:56:23.025751 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d54177-7070-4433-b373-33977852206b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:23.035497 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d54177-7070-4433-b373-33977852206b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:23.040773 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf805e7-60ae-4ca5-932e-76e3564918c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:23.041437 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf805e7-60ae-4ca5-932e-76e3564918c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:23.041727 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf805e7-60ae-4ca5-932e-76e3564918c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:23.042006 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf805e7-60ae-4ca5-932e-76e3564918c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:23.042711 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf805e7-60ae-4ca5-932e-76e3564918c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:23.044649 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf805e7-60ae-4ca5-932e-76e3564918c8 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:23.073245 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1012/2019] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:23 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:23.074464 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5a899-c23d-4863-ab25-6d065a13ab82 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:23.085164 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5a899-c23d-4863-ab25-6d065a13ab82 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:23.146007 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9999554-123d-4957-91c9-24ea76d30c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:23.146904 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9999554-123d-4957-91c9-24ea76d30c2f admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:23.147239 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9999554-123d-4957-91c9-24ea76d30c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:23.147522 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9999554-123d-4957-91c9-24ea76d30c2f admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:23.148250 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9999554-123d-4957-91c9-24ea76d30c2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:23.150194 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9999554-123d-4957-91c9-24ea76d30c2f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:23.178454 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1008/2020] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:23 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:23.183575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf805e7-60ae-4ca5-932e-76e3564918c8 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:23.199148 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf805e7-60ae-4ca5-932e-76e3564918c8 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:23.204472 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0b823-c207-42ea-9fa1-a0e8dfe4b681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:23.205332 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0b823-c207-42ea-9fa1-a0e8dfe4b681 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:23.206178 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0b823-c207-42ea-9fa1-a0e8dfe4b681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:23.206673 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0b823-c207-42ea-9fa1-a0e8dfe4b681 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:23.207470 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0b823-c207-42ea-9fa1-a0e8dfe4b681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:23.209115 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0b823-c207-42ea-9fa1-a0e8dfe4b681 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:23.228620 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1013/2021] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:23.232547 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9999554-123d-4957-91c9-24ea76d30c2f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:23.243199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9999554-123d-4957-91c9-24ea76d30c2f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:23.248357 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c8707-4d7f-44e4-8ff9-ba68296611d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:23.249143 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c8707-4d7f-44e4-8ff9-ba68296611d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:23.249304 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c8707-4d7f-44e4-8ff9-ba68296611d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:23.249631 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c8707-4d7f-44e4-8ff9-ba68296611d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:23.250283 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c8707-4d7f-44e4-8ff9-ba68296611d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:23.251990 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c8707-4d7f-44e4-8ff9-ba68296611d8 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:23.265928 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1009/2022] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:23.271192 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0b823-c207-42ea-9fa1-a0e8dfe4b681 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:23.282744 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0b823-c207-42ea-9fa1-a0e8dfe4b681 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:23.287856 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93aedd-9b1a-49e3-b8ef-e2b961d0415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:23.288778 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93aedd-9b1a-49e3-b8ef-e2b961d0415a admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:23.289088 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93aedd-9b1a-49e3-b8ef-e2b961d0415a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:23.289374 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93aedd-9b1a-49e3-b8ef-e2b961d0415a admin admin] PATH_INFO: `/v3/projects/76cc54ad00a445deaf7a849955d988e4/users/d24b06c23ff2477eb02d20d27005c959/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:23.305082 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93aedd-9b1a-49e3-b8ef-e2b961d0415a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76cc54ad00a445deaf7a849955d988e4, user_id=d24b06c23ff2477eb02d20d27005c959, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:23.307973 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93aedd-9b1a-49e3-b8ef-e2b961d0415a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:23.326146 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1014/2023] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:23 2022] PUT /identity/v3/projects/76cc54ad00a445deaf7a849955d988e4/users/d24b06c23ff2477eb02d20d27005c959/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:23.338930 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7f6b8-2867-4699-a935-c3a1eb72b2ef None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:23.339227 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7f6b8-2867-4699-a935-c3a1eb72b2ef None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:23.339514 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7f6b8-2867-4699-a935-c3a1eb72b2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:23.371884 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-bcc7f6b8-2867-4699-a935-c3a1eb72b2ef None None] MFA Rules not processed for user `d24b06c23ff2477eb02d20d27005c959`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:23.373108 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-bcc7f6b8-2867-4699-a935-c3a1eb72b2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:23.446102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1010/2024] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:23.457964 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93aedd-9b1a-49e3-b8ef-e2b961d0415a admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:23.459763 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5d93aedd-9b1a-49e3-b8ef-e2b961d0415a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:23.524622 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93aedd-9b1a-49e3-b8ef-e2b961d0415a admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:23.528449 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86e4bc-f1b6-4397-9e27-906b0130a4b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:23.529131 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86e4bc-f1b6-4397-9e27-906b0130a4b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:23.529415 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86e4bc-f1b6-4397-9e27-906b0130a4b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:23.529707 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86e4bc-f1b6-4397-9e27-906b0130a4b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:23.538122 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86e4bc-f1b6-4397-9e27-906b0130a4b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:23.539508 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f86e4bc-f1b6-4397-9e27-906b0130a4b1 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:23.548686 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1015/2025] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:23.576782 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7f6b8-2867-4699-a935-c3a1eb72b2ef None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:23.647202 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7f6b8-2867-4699-a935-c3a1eb72b2ef None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:23.652209 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac90e2-6c92-4386-bb77-fdc3cb4493d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:23.653124 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac90e2-6c92-4386-bb77-fdc3cb4493d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:23.653409 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac90e2-6c92-4386-bb77-fdc3cb4493d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:23.653689 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac90e2-6c92-4386-bb77-fdc3cb4493d7 admin admin] PATH_INFO: `/v3/users/d24b06c23ff2477eb02d20d27005c959` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:23.655496 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac90e2-6c92-4386-bb77-fdc3cb4493d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d24b06c23ff2477eb02d20d27005c959)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:23.659690 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac90e2-6c92-4386-bb77-fdc3cb4493d7 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:23.723666 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2dac90e2-6c92-4386-bb77-fdc3cb4493d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd24b06c23ff2477eb02d20d27005c959'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:23.732327 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2dac90e2-6c92-4386-bb77-fdc3cb4493d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd24b06c23ff2477eb02d20d27005c959'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:23.742676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2dac90e2-6c92-4386-bb77-fdc3cb4493d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd24b06c23ff2477eb02d20d27005c959'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:23.743144 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2dac90e2-6c92-4386-bb77-fdc3cb4493d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd24b06c23ff2477eb02d20d27005c959'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:23.743958 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2dac90e2-6c92-4386-bb77-fdc3cb4493d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd24b06c23ff2477eb02d20d27005c959'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:23.766299 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1011/2026] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:23 2022] DELETE /identity/v3/users/d24b06c23ff2477eb02d20d27005c959 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:23.771096 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6593c5-4946-4cb5-bb5f-752e1221ecd9 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:23.771710 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6593c5-4946-4cb5-bb5f-752e1221ecd9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:23.772371 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6593c5-4946-4cb5-bb5f-752e1221ecd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:23.798528 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-ea6593c5-4946-4cb5-bb5f-752e1221ecd9 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:23.801096 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ea6593c5-4946-4cb5-bb5f-752e1221ecd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:23.876516 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1016/2027] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:23.887219 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac90e2-6c92-4386-bb77-fdc3cb4493d7 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:23.888656 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2dac90e2-6c92-4386-bb77-fdc3cb4493d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:23.949471 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac90e2-6c92-4386-bb77-fdc3cb4493d7 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:23.953354 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bca637-dbba-4aba-b654-c609ddb4809e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:23.954193 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bca637-dbba-4aba-b654-c609ddb4809e service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:23.954479 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bca637-dbba-4aba-b654-c609ddb4809e service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:23.954759 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bca637-dbba-4aba-b654-c609ddb4809e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:23.964362 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bca637-dbba-4aba-b654-c609ddb4809e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:23.965941 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bca637-dbba-4aba-b654-c609ddb4809e service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:23.975863 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1012/2028] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:24.304448 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6593c5-4946-4cb5-bb5f-752e1221ecd9 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:24.304448 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ea6593c5-4946-4cb5-bb5f-752e1221ecd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:24.305468 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bca637-dbba-4aba-b654-c609ddb4809e service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:24.307283 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-08bca637-dbba-4aba-b654-c609ddb4809e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:24.316462 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6593c5-4946-4cb5-bb5f-752e1221ecd9 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:24.329348 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bca637-dbba-4aba-b654-c609ddb4809e service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:24.332937 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442092b5-01ff-4032-bd1b-00fc1b351a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:24.334079 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442092b5-01ff-4032-bd1b-00fc1b351a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:24.334931 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442092b5-01ff-4032-bd1b-00fc1b351a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:24.335372 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442092b5-01ff-4032-bd1b-00fc1b351a2a admin admin] PATH_INFO: `/v3/users/ace3cc5cca21458789c99ddbe67ae6ca` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:24.336759 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442092b5-01ff-4032-bd1b-00fc1b351a2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace3cc5cca21458789c99ddbe67ae6ca)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:24.338596 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442092b5-01ff-4032-bd1b-00fc1b351a2a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:24.344463 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbe20f-cfb8-4199-8dfc-982ac0b21f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:24.345762 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbe20f-cfb8-4199-8dfc-982ac0b21f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:24.345762 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbe20f-cfb8-4199-8dfc-982ac0b21f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:24.346475 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbe20f-cfb8-4199-8dfc-982ac0b21f68 admin admin] PATH_INFO: `/v3/projects/76cc54ad00a445deaf7a849955d988e4` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:24.348484 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbe20f-cfb8-4199-8dfc-982ac0b21f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76cc54ad00a445deaf7a849955d988e4)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:24.350433 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbe20f-cfb8-4199-8dfc-982ac0b21f68 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:24.410805 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-442092b5-01ff-4032-bd1b-00fc1b351a2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace3cc5cca21458789c99ddbe67ae6ca'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:24.411731 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-442092b5-01ff-4032-bd1b-00fc1b351a2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace3cc5cca21458789c99ddbe67ae6ca'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:24.417806 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f8cbe20f-cfb8-4199-8dfc-982ac0b21f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76cc54ad00a445deaf7a849955d988e4', 'request_id': 'req-f8cbe20f-cfb8-4199-8dfc-982ac0b21f68'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:24.419189 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-442092b5-01ff-4032-bd1b-00fc1b351a2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace3cc5cca21458789c99ddbe67ae6ca'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:24.426816 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f8cbe20f-cfb8-4199-8dfc-982ac0b21f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76cc54ad00a445deaf7a849955d988e4', 'request_id': 'req-f8cbe20f-cfb8-4199-8dfc-982ac0b21f68'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:24.429664 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-442092b5-01ff-4032-bd1b-00fc1b351a2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace3cc5cca21458789c99ddbe67ae6ca'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:24.430575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-442092b5-01ff-4032-bd1b-00fc1b351a2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace3cc5cca21458789c99ddbe67ae6ca'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:24.432646 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f8cbe20f-cfb8-4199-8dfc-982ac0b21f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76cc54ad00a445deaf7a849955d988e4', 'request_id': 'req-f8cbe20f-cfb8-4199-8dfc-982ac0b21f68'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:24.446146 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f8cbe20f-cfb8-4199-8dfc-982ac0b21f68 admin admin] The token cache is being invalidate because project 76cc54ad00a445deaf7a849955d988e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:24.446439 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f8cbe20f-cfb8-4199-8dfc-982ac0b21f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:24.447207 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f8cbe20f-cfb8-4199-8dfc-982ac0b21f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:24.448650 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1017/2029] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:24 2022] DELETE /identity/v3/users/ace3cc5cca21458789c99ddbe67ae6ca => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:24.448920 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1013/2030] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:24 2022] DELETE /identity/v3/projects/76cc54ad00a445deaf7a849955d988e4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:24.458028 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b34846-a03f-410a-9534-778233528382 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:24.458314 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b34846-a03f-410a-9534-778233528382 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:24.458791 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b34846-a03f-410a-9534-778233528382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:24.482645 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-99b34846-a03f-410a-9534-778233528382 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:24.484178 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-99b34846-a03f-410a-9534-778233528382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:24.572357 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1018/2031] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:24.584361 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbe20f-cfb8-4199-8dfc-982ac0b21f68 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:24.586657 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f8cbe20f-cfb8-4199-8dfc-982ac0b21f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:24.682914 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbe20f-cfb8-4199-8dfc-982ac0b21f68 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:24.706270 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b34846-a03f-410a-9534-778233528382 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:24.708037 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-99b34846-a03f-410a-9534-778233528382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:24.720710 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b34846-a03f-410a-9534-778233528382 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:24.732665 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8efc1-ede8-44b2-b7c7-0c375ad92108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:24.733568 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8efc1-ede8-44b2-b7c7-0c375ad92108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:24.733855 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8efc1-ede8-44b2-b7c7-0c375ad92108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:24.734133 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8efc1-ede8-44b2-b7c7-0c375ad92108 admin admin] PATH_INFO: `/v3/users/ace2f76279c54ec49d4019c96a2c6672` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:24.735338 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8efc1-ede8-44b2-b7c7-0c375ad92108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace2f76279c54ec49d4019c96a2c6672)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:24.735717 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1f876-3d12-4d20-8533-c6d671d11b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:24.738173 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8efc1-ede8-44b2-b7c7-0c375ad92108 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:24.739854 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1f876-3d12-4d20-8533-c6d671d11b85 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:24.740159 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1f876-3d12-4d20-8533-c6d671d11b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:24.740436 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1f876-3d12-4d20-8533-c6d671d11b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:24.750437 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1f876-3d12-4d20-8533-c6d671d11b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:24.751916 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1f876-3d12-4d20-8533-c6d671d11b85 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:24.762158 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1014/2032] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:56:24.787076 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-5bc8efc1-ede8-44b2-b7c7-0c375ad92108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace2f76279c54ec49d4019c96a2c6672'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:24.787775 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-5bc8efc1-ede8-44b2-b7c7-0c375ad92108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace2f76279c54ec49d4019c96a2c6672'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:24.794504 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-5bc8efc1-ede8-44b2-b7c7-0c375ad92108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace2f76279c54ec49d4019c96a2c6672'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:24.802380 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-5bc8efc1-ede8-44b2-b7c7-0c375ad92108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace2f76279c54ec49d4019c96a2c6672'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:24.803069 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-5bc8efc1-ede8-44b2-b7c7-0c375ad92108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace2f76279c54ec49d4019c96a2c6672'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:24.821468 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1019/2033] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:24 2022] DELETE /identity/v3/users/ace2f76279c54ec49d4019c96a2c6672 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:24.826265 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7c9ff-bdec-4dc1-8d42-28e242db6590 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:24.826585 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7c9ff-bdec-4dc1-8d42-28e242db6590 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:24.826867 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7c9ff-bdec-4dc1-8d42-28e242db6590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:24.848072 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c3a7c9ff-bdec-4dc1-8d42-28e242db6590 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:24.849405 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c3a7c9ff-bdec-4dc1-8d42-28e242db6590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:24.948935 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1015/2034] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:24.963319 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8efc1-ede8-44b2-b7c7-0c375ad92108 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:24.964796 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5bc8efc1-ede8-44b2-b7c7-0c375ad92108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:25.025452 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8efc1-ede8-44b2-b7c7-0c375ad92108 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:25.029442 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe63fa-fad5-418e-9431-f019fc3ca3ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:25.030281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe63fa-fad5-418e-9431-f019fc3ca3ab service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:25.030733 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe63fa-fad5-418e-9431-f019fc3ca3ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:25.031169 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe63fa-fad5-418e-9431-f019fc3ca3ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:25.042243 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe63fa-fad5-418e-9431-f019fc3ca3ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:25.043543 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe63fa-fad5-418e-9431-f019fc3ca3ab service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:25.054270 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1020/2035] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:56:25.094394 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7c9ff-bdec-4dc1-8d42-28e242db6590 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:25.096977 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c3a7c9ff-bdec-4dc1-8d42-28e242db6590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:25.109887 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7c9ff-bdec-4dc1-8d42-28e242db6590 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:25.116726 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee312d-efa6-4c6b-87b3-287f10da21e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:25.117604 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee312d-efa6-4c6b-87b3-287f10da21e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:25.117929 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee312d-efa6-4c6b-87b3-287f10da21e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:25.118208 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee312d-efa6-4c6b-87b3-287f10da21e6 admin admin] PATH_INFO: `/v3/projects/428c7db5869949729fbf6e63bfa6dfbe` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:25.119414 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee312d-efa6-4c6b-87b3-287f10da21e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=428c7db5869949729fbf6e63bfa6dfbe)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:25.121396 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee312d-efa6-4c6b-87b3-287f10da21e6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:25.187780 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-e9ee312d-efa6-4c6b-87b3-287f10da21e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '428c7db5869949729fbf6e63bfa6dfbe', 'request_id': 'req-e9ee312d-efa6-4c6b-87b3-287f10da21e6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.197246 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-e9ee312d-efa6-4c6b-87b3-287f10da21e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '428c7db5869949729fbf6e63bfa6dfbe', 'request_id': 'req-e9ee312d-efa6-4c6b-87b3-287f10da21e6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.212663 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-e9ee312d-efa6-4c6b-87b3-287f10da21e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '428c7db5869949729fbf6e63bfa6dfbe', 'request_id': 'req-e9ee312d-efa6-4c6b-87b3-287f10da21e6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.228339 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-e9ee312d-efa6-4c6b-87b3-287f10da21e6 admin admin] The token cache is being invalidate because project 428c7db5869949729fbf6e63bfa6dfbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:25.228339 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-e9ee312d-efa6-4c6b-87b3-287f10da21e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.229343 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-e9ee312d-efa6-4c6b-87b3-287f10da21e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.231909 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1016/2036] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:25 2022] DELETE /identity/v3/projects/428c7db5869949729fbf6e63bfa6dfbe => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:25.237493 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe63fa-fad5-418e-9431-f019fc3ca3ab service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:25.248822 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe63fa-fad5-418e-9431-f019fc3ca3ab service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:25.301827 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee312d-efa6-4c6b-87b3-287f10da21e6 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:25.303494 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e9ee312d-efa6-4c6b-87b3-287f10da21e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:25.317132 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fcd78-cd52-4992-b237-56816b2cf74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:25.318051 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fcd78-cd52-4992-b237-56816b2cf74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:25.318284 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fcd78-cd52-4992-b237-56816b2cf74b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:25.318608 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fcd78-cd52-4992-b237-56816b2cf74b admin admin] PATH_INFO: `/v3/users/b983b644411a43f2b222c843eaa1702d` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:25.319853 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053fcd78-cd52-4992-b237-56816b2cf74b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b983b644411a43f2b222c843eaa1702d)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:25.321815 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053fcd78-cd52-4992-b237-56816b2cf74b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:25.383747 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee312d-efa6-4c6b-87b3-287f10da21e6 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:25.384026 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-053fcd78-cd52-4992-b237-56816b2cf74b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b983b644411a43f2b222c843eaa1702d'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.384026 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-053fcd78-cd52-4992-b237-56816b2cf74b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b983b644411a43f2b222c843eaa1702d'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.393667 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-053fcd78-cd52-4992-b237-56816b2cf74b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b983b644411a43f2b222c843eaa1702d'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.410714 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-053fcd78-cd52-4992-b237-56816b2cf74b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b983b644411a43f2b222c843eaa1702d'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.411685 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-053fcd78-cd52-4992-b237-56816b2cf74b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b983b644411a43f2b222c843eaa1702d'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.413671 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8be6e-2109-48a8-aaed-3667e582906b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:25.414673 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8be6e-2109-48a8-aaed-3667e582906b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:25.414828 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8be6e-2109-48a8-aaed-3667e582906b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:25.415113 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8be6e-2109-48a8-aaed-3667e582906b admin admin] PATH_INFO: `/v3/users/310d46264fcd44ea9c9dcea7a35be975` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:25.416318 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8be6e-2109-48a8-aaed-3667e582906b admin admin] RBAC: Authorizing `identity:delete_user(user_id=310d46264fcd44ea9c9dcea7a35be975)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:25.418247 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8be6e-2109-48a8-aaed-3667e582906b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:25.432609 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1021/2037] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:25 2022] DELETE /identity/v3/users/b983b644411a43f2b222c843eaa1702d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:25.433665 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fcd78-cd52-4992-b237-56816b2cf74b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:25.435071 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-053fcd78-cd52-4992-b237-56816b2cf74b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:25.482278 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ddb8be6e-2109-48a8-aaed-3667e582906b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '310d46264fcd44ea9c9dcea7a35be975'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.489935 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ddb8be6e-2109-48a8-aaed-3667e582906b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '310d46264fcd44ea9c9dcea7a35be975'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.499188 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ddb8be6e-2109-48a8-aaed-3667e582906b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '310d46264fcd44ea9c9dcea7a35be975'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.499897 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ddb8be6e-2109-48a8-aaed-3667e582906b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '310d46264fcd44ea9c9dcea7a35be975'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.501410 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ddb8be6e-2109-48a8-aaed-3667e582906b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '310d46264fcd44ea9c9dcea7a35be975'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.510779 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fcd78-cd52-4992-b237-56816b2cf74b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:25.516181 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5dfaf-986a-4427-8ede-a79b11ff80ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:25.517325 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5dfaf-986a-4427-8ede-a79b11ff80ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:25.517448 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5dfaf-986a-4427-8ede-a79b11ff80ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:25.517807 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5dfaf-986a-4427-8ede-a79b11ff80ee admin admin] PATH_INFO: `/v3/projects/8b6eb49d6cb74605a14093941782541d` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:25.519228 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5dfaf-986a-4427-8ede-a79b11ff80ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b6eb49d6cb74605a14093941782541d)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:25.521249 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5dfaf-986a-4427-8ede-a79b11ff80ee admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:25.525668 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1017/2038] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:25 2022] DELETE /identity/v3/users/310d46264fcd44ea9c9dcea7a35be975 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:25.530322 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89912c-11d1-49c9-8808-d8f9f8b1a6cf None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:25.530618 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89912c-11d1-49c9-8808-d8f9f8b1a6cf None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:25.531037 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89912c-11d1-49c9-8808-d8f9f8b1a6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:25.557267 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-3c89912c-11d1-49c9-8808-d8f9f8b1a6cf None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:25.558582 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3c89912c-11d1-49c9-8808-d8f9f8b1a6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:25.601583 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-11a5dfaf-986a-4427-8ede-a79b11ff80ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b6eb49d6cb74605a14093941782541d', 'request_id': 'req-11a5dfaf-986a-4427-8ede-a79b11ff80ee'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.607964 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-11a5dfaf-986a-4427-8ede-a79b11ff80ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b6eb49d6cb74605a14093941782541d', 'request_id': 'req-11a5dfaf-986a-4427-8ede-a79b11ff80ee'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.614372 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-11a5dfaf-986a-4427-8ede-a79b11ff80ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b6eb49d6cb74605a14093941782541d', 'request_id': 'req-11a5dfaf-986a-4427-8ede-a79b11ff80ee'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.629222 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-11a5dfaf-986a-4427-8ede-a79b11ff80ee admin admin] The token cache is being invalidate because project 8b6eb49d6cb74605a14093941782541d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:25.629509 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-11a5dfaf-986a-4427-8ede-a79b11ff80ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.630207 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-11a5dfaf-986a-4427-8ede-a79b11ff80ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.631818 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1022/2039] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:25 2022] DELETE /identity/v3/projects/8b6eb49d6cb74605a14093941782541d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:25.635778 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5dfaf-986a-4427-8ede-a79b11ff80ee admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:25.637128 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-11a5dfaf-986a-4427-8ede-a79b11ff80ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:25.640663 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1018/2040] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:25.650347 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89912c-11d1-49c9-8808-d8f9f8b1a6cf None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:25.651895 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3c89912c-11d1-49c9-8808-d8f9f8b1a6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:25.717739 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5dfaf-986a-4427-8ede-a79b11ff80ee admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:25.724550 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebff3da-b628-4f3c-94cc-b31b70d7ceb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:25.725290 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89912c-11d1-49c9-8808-d8f9f8b1a6cf None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:25.725845 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebff3da-b628-4f3c-94cc-b31b70d7ceb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:25.726279 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebff3da-b628-4f3c-94cc-b31b70d7ceb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:25.726710 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebff3da-b628-4f3c-94cc-b31b70d7ceb3 admin admin] PATH_INFO: `/v3/users/f7b54dcbeae240868f7b3cc6b31b8919` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:25.728242 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebff3da-b628-4f3c-94cc-b31b70d7ceb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7b54dcbeae240868f7b3cc6b31b8919)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:25.731877 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebff3da-b628-4f3c-94cc-b31b70d7ceb3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:25.791010 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bc89f-1286-4ce1-992f-0cfaa4d33863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:25.791732 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bc89f-1286-4ce1-992f-0cfaa4d33863 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:25.792027 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bc89f-1286-4ce1-992f-0cfaa4d33863 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:25.792384 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bc89f-1286-4ce1-992f-0cfaa4d33863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:25.806046 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9bc89f-1286-4ce1-992f-0cfaa4d33863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:25.807902 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9bc89f-1286-4ce1-992f-0cfaa4d33863 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:25.821596 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1019/2041] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:56:25.822345 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-eebff3da-b628-4f3c-94cc-b31b70d7ceb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7b54dcbeae240868f7b3cc6b31b8919'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.823159 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-eebff3da-b628-4f3c-94cc-b31b70d7ceb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7b54dcbeae240868f7b3cc6b31b8919'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.831006 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-eebff3da-b628-4f3c-94cc-b31b70d7ceb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7b54dcbeae240868f7b3cc6b31b8919'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.838545 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-eebff3da-b628-4f3c-94cc-b31b70d7ceb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7b54dcbeae240868f7b3cc6b31b8919'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.839278 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-eebff3da-b628-4f3c-94cc-b31b70d7ceb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7b54dcbeae240868f7b3cc6b31b8919'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:25.854991 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bc89f-1286-4ce1-992f-0cfaa4d33863 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:25.856642 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ea9bc89f-1286-4ce1-992f-0cfaa4d33863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:25.870893 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1023/2042] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:25 2022] DELETE /identity/v3/users/f7b54dcbeae240868f7b3cc6b31b8919 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:25.875377 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bc89f-1286-4ce1-992f-0cfaa4d33863 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:25.948649 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dfa16-4726-4f9a-a801-cb996c71b6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:25.949760 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dfa16-4726-4f9a-a801-cb996c71b6c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:25.950323 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dfa16-4726-4f9a-a801-cb996c71b6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:25.950323 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dfa16-4726-4f9a-a801-cb996c71b6c0 admin admin] PATH_INFO: `/v3/projects/45f68d056c5c47c3b7ad9db1877b8eed` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:25.952206 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dfa16-4726-4f9a-a801-cb996c71b6c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45f68d056c5c47c3b7ad9db1877b8eed)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:25.955099 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dfa16-4726-4f9a-a801-cb996c71b6c0 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:26.021082 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d92dfa16-4726-4f9a-a801-cb996c71b6c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f68d056c5c47c3b7ad9db1877b8eed', 'request_id': 'req-d92dfa16-4726-4f9a-a801-cb996c71b6c0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.035215 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d92dfa16-4726-4f9a-a801-cb996c71b6c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f68d056c5c47c3b7ad9db1877b8eed', 'request_id': 'req-d92dfa16-4726-4f9a-a801-cb996c71b6c0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.054057 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d92dfa16-4726-4f9a-a801-cb996c71b6c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f68d056c5c47c3b7ad9db1877b8eed', 'request_id': 'req-d92dfa16-4726-4f9a-a801-cb996c71b6c0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.085945 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d92dfa16-4726-4f9a-a801-cb996c71b6c0 admin admin] The token cache is being invalidate because project 45f68d056c5c47c3b7ad9db1877b8eed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:26.086252 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d92dfa16-4726-4f9a-a801-cb996c71b6c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.087443 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d92dfa16-4726-4f9a-a801-cb996c71b6c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.089362 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1020/2043] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:25 2022] DELETE /identity/v3/projects/45f68d056c5c47c3b7ad9db1877b8eed => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:26.094448 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eaf96-6006-4a6d-b026-f6ee6294055d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:26.095214 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eaf96-6006-4a6d-b026-f6ee6294055d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:26.095959 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eaf96-6006-4a6d-b026-f6ee6294055d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:26.134819 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-b32eaf96-6006-4a6d-b026-f6ee6294055d None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:26.136161 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b32eaf96-6006-4a6d-b026-f6ee6294055d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:26.199190 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1024/2044] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:26.215611 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb7727-86e7-4e14-8bba-84076e10f685 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:26.215948 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb7727-86e7-4e14-8bba-84076e10f685 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:26.216196 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb7727-86e7-4e14-8bba-84076e10f685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:26.234433 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32eaf96-6006-4a6d-b026-f6ee6294055d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:26.236109 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-68bb7727-86e7-4e14-8bba-84076e10f685 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:26.236921 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b32eaf96-6006-4a6d-b026-f6ee6294055d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:26.237812 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-68bb7727-86e7-4e14-8bba-84076e10f685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:26.247593 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1021/2045] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:26.250857 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32eaf96-6006-4a6d-b026-f6ee6294055d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:26.251551 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb7727-86e7-4e14-8bba-84076e10f685 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:26.262719 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb7727-86e7-4e14-8bba-84076e10f685 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:26.263807 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ac4b3-7247-4071-a56d-c9f327ec1b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:26.264779 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ac4b3-7247-4071-a56d-c9f327ec1b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:26.266036 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ac4b3-7247-4071-a56d-c9f327ec1b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:26.266332 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ac4b3-7247-4071-a56d-c9f327ec1b58 admin admin] PATH_INFO: `/v3/projects/4e0a5850fb2c4c668b1ba47c7c943097` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:26.267787 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ac4b3-7247-4071-a56d-c9f327ec1b58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e0a5850fb2c4c668b1ba47c7c943097)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:26.269228 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3a4eb-3242-4925-b304-97d70ea8cc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:26.270043 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3a4eb-3242-4925-b304-97d70ea8cc54 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:26.270334 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3a4eb-3242-4925-b304-97d70ea8cc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:26.270738 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3a4eb-3242-4925-b304-97d70ea8cc54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:26.271168 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ac4b3-7247-4071-a56d-c9f327ec1b58 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:26.271525 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3a4eb-3242-4925-b304-97d70ea8cc54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:26.272039 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3a4eb-3242-4925-b304-97d70ea8cc54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:26.274259 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3a4eb-3242-4925-b304-97d70ea8cc54 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:26.289480 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1022/2046] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 13:56:26.290751 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3a4eb-3242-4925-b304-97d70ea8cc54 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:26.293039 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-93f3a4eb-3242-4925-b304-97d70ea8cc54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:26.312571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3a4eb-3242-4925-b304-97d70ea8cc54 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:26.320357 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c87a4-cd66-4781-917c-bbffaa1a50e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:26.321267 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c87a4-cd66-4781-917c-bbffaa1a50e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:26.321552 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c87a4-cd66-4781-917c-bbffaa1a50e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:26.321934 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c87a4-cd66-4781-917c-bbffaa1a50e9 admin admin] PATH_INFO: `/v3/projects/00a1f98456884313b707a656188dc782` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:26.324171 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c87a4-cd66-4781-917c-bbffaa1a50e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00a1f98456884313b707a656188dc782)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:26.326103 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c87a4-cd66-4781-917c-bbffaa1a50e9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:26.334606 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-de0ac4b3-7247-4071-a56d-c9f327ec1b58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e0a5850fb2c4c668b1ba47c7c943097', 'request_id': 'req-de0ac4b3-7247-4071-a56d-c9f327ec1b58'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.340939 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-de0ac4b3-7247-4071-a56d-c9f327ec1b58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e0a5850fb2c4c668b1ba47c7c943097', 'request_id': 'req-de0ac4b3-7247-4071-a56d-c9f327ec1b58'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.347620 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-de0ac4b3-7247-4071-a56d-c9f327ec1b58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e0a5850fb2c4c668b1ba47c7c943097', 'request_id': 'req-de0ac4b3-7247-4071-a56d-c9f327ec1b58'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.363962 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-de0ac4b3-7247-4071-a56d-c9f327ec1b58 admin admin] The token cache is being invalidate because project 4e0a5850fb2c4c668b1ba47c7c943097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:26.364256 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-de0ac4b3-7247-4071-a56d-c9f327ec1b58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.364910 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-de0ac4b3-7247-4071-a56d-c9f327ec1b58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.369557 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1025/2047] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:26 2022] DELETE /identity/v3/projects/4e0a5850fb2c4c668b1ba47c7c943097 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:26.370389 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ac4b3-7247-4071-a56d-c9f327ec1b58 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:26.371999 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-de0ac4b3-7247-4071-a56d-c9f327ec1b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:26.390174 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-561c87a4-cd66-4781-917c-bbffaa1a50e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00a1f98456884313b707a656188dc782', 'request_id': 'req-561c87a4-cd66-4781-917c-bbffaa1a50e9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.402168 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-561c87a4-cd66-4781-917c-bbffaa1a50e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00a1f98456884313b707a656188dc782', 'request_id': 'req-561c87a4-cd66-4781-917c-bbffaa1a50e9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.410720 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-561c87a4-cd66-4781-917c-bbffaa1a50e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00a1f98456884313b707a656188dc782', 'request_id': 'req-561c87a4-cd66-4781-917c-bbffaa1a50e9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.426523 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-561c87a4-cd66-4781-917c-bbffaa1a50e9 admin admin] The token cache is being invalidate because project 00a1f98456884313b707a656188dc782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:26.426815 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-561c87a4-cd66-4781-917c-bbffaa1a50e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.427741 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-561c87a4-cd66-4781-917c-bbffaa1a50e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.429856 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1023/2048] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:26 2022] DELETE /identity/v3/projects/00a1f98456884313b707a656188dc782 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:26.430706 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c87a4-cd66-4781-917c-bbffaa1a50e9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:26.433411 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-561c87a4-cd66-4781-917c-bbffaa1a50e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:26.466712 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ac4b3-7247-4071-a56d-c9f327ec1b58 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:26.498596 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c87a4-cd66-4781-917c-bbffaa1a50e9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:26.503849 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3416b0-f16f-48f1-9312-60bab04066b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:26.504732 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3416b0-f16f-48f1-9312-60bab04066b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:26.505018 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3416b0-f16f-48f1-9312-60bab04066b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:26.505295 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3416b0-f16f-48f1-9312-60bab04066b1 admin admin] PATH_INFO: `/v3/users/2b8f96488fae42d691d2dce8c1923cfb` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:26.506496 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3416b0-f16f-48f1-9312-60bab04066b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8f96488fae42d691d2dce8c1923cfb)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:26.508596 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3416b0-f16f-48f1-9312-60bab04066b1 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:26.523003 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d06d0-1d8f-4d82-9199-dc99250d1697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:26.523754 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d06d0-1d8f-4d82-9199-dc99250d1697 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:26.524077 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d06d0-1d8f-4d82-9199-dc99250d1697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:26.524405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d06d0-1d8f-4d82-9199-dc99250d1697 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:26.525134 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d06d0-1d8f-4d82-9199-dc99250d1697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:26.527056 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d06d0-1d8f-4d82-9199-dc99250d1697 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:26.553416 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1026/2049] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:26 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:26.554967 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6f3416b0-f16f-48f1-9312-60bab04066b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8f96488fae42d691d2dce8c1923cfb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.557094 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d06d0-1d8f-4d82-9199-dc99250d1697 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:26.558698 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ff6d06d0-1d8f-4d82-9199-dc99250d1697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:26.562023 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6f3416b0-f16f-48f1-9312-60bab04066b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8f96488fae42d691d2dce8c1923cfb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.569542 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6f3416b0-f16f-48f1-9312-60bab04066b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8f96488fae42d691d2dce8c1923cfb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.570251 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6f3416b0-f16f-48f1-9312-60bab04066b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8f96488fae42d691d2dce8c1923cfb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.570916 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6f3416b0-f16f-48f1-9312-60bab04066b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8f96488fae42d691d2dce8c1923cfb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.588931 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1024/2050] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:26 2022] DELETE /identity/v3/users/2b8f96488fae42d691d2dce8c1923cfb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:26.591896 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3416b0-f16f-48f1-9312-60bab04066b1 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:26.591896 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6f3416b0-f16f-48f1-9312-60bab04066b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:26.634368 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d06d0-1d8f-4d82-9199-dc99250d1697 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:26.666596 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3416b0-f16f-48f1-9312-60bab04066b1 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:26.672808 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc0681-08f6-429d-ada9-7ef5d23b228a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:26.673698 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc0681-08f6-429d-ada9-7ef5d23b228a admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:26.674718 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc0681-08f6-429d-ada9-7ef5d23b228a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:26.675055 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc0681-08f6-429d-ada9-7ef5d23b228a admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:26.676008 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc0681-08f6-429d-ada9-7ef5d23b228a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:26.677986 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc0681-08f6-429d-ada9-7ef5d23b228a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:26.712763 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1025/2051] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:26 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:26.716294 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc0681-08f6-429d-ada9-7ef5d23b228a admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:26.729223 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc0681-08f6-429d-ada9-7ef5d23b228a admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:26.741352 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327c1ff-a53b-480b-96cb-c0137c2c400a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:26.742035 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327c1ff-a53b-480b-96cb-c0137c2c400a admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:26.742319 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327c1ff-a53b-480b-96cb-c0137c2c400a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:26.742597 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327c1ff-a53b-480b-96cb-c0137c2c400a admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:26.743342 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327c1ff-a53b-480b-96cb-c0137c2c400a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:26.745007 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327c1ff-a53b-480b-96cb-c0137c2c400a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:26.749280 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83068a5d-5f13-447a-99ed-616a7ba4d451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:26.750329 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83068a5d-5f13-447a-99ed-616a7ba4d451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:26.750630 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83068a5d-5f13-447a-99ed-616a7ba4d451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:26.751233 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83068a5d-5f13-447a-99ed-616a7ba4d451 admin admin] PATH_INFO: `/v3/users/5abd29551f1642c9aff64fdef0592fa4` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:26.753101 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83068a5d-5f13-447a-99ed-616a7ba4d451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5abd29551f1642c9aff64fdef0592fa4)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:26.755428 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83068a5d-5f13-447a-99ed-616a7ba4d451 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:26.763285 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1026/2052] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:56:26.766850 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327c1ff-a53b-480b-96cb-c0137c2c400a admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:26.779375 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327c1ff-a53b-480b-96cb-c0137c2c400a admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:26.784576 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998d258-6b21-453d-a587-0f2fa9e7bc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:26.785247 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998d258-6b21-453d-a587-0f2fa9e7bc99 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:26.785538 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998d258-6b21-453d-a587-0f2fa9e7bc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:26.785864 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998d258-6b21-453d-a587-0f2fa9e7bc99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:26.786560 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998d258-6b21-453d-a587-0f2fa9e7bc99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:26.788200 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998d258-6b21-453d-a587-0f2fa9e7bc99 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:26.798841 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1027/2053] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:56:26.804051 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998d258-6b21-453d-a587-0f2fa9e7bc99 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:26.815852 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998d258-6b21-453d-a587-0f2fa9e7bc99 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:26.821931 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadbd1e-6c51-4365-9c24-30cd5a1d7800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:26.822894 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadbd1e-6c51-4365-9c24-30cd5a1d7800 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:26.823351 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadbd1e-6c51-4365-9c24-30cd5a1d7800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:26.823698 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadbd1e-6c51-4365-9c24-30cd5a1d7800 admin admin] PATH_INFO: `/v3/projects/9530130966df4740ab9a41187aa306fd/users/e85ee0fa6dc94d29a79bd1659cd446bf/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:26.846422 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-83068a5d-5f13-447a-99ed-616a7ba4d451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5abd29551f1642c9aff64fdef0592fa4'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.847096 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-83068a5d-5f13-447a-99ed-616a7ba4d451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5abd29551f1642c9aff64fdef0592fa4'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.849489 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadbd1e-6c51-4365-9c24-30cd5a1d7800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9530130966df4740ab9a41187aa306fd, user_id=e85ee0fa6dc94d29a79bd1659cd446bf, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:26.852954 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadbd1e-6c51-4365-9c24-30cd5a1d7800 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:26.854901 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-83068a5d-5f13-447a-99ed-616a7ba4d451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5abd29551f1642c9aff64fdef0592fa4'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.868400 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-83068a5d-5f13-447a-99ed-616a7ba4d451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5abd29551f1642c9aff64fdef0592fa4'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.869114 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-83068a5d-5f13-447a-99ed-616a7ba4d451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5abd29551f1642c9aff64fdef0592fa4'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:26.872839 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1028/2054] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:26 2022] PUT /identity/v3/projects/9530130966df4740ab9a41187aa306fd/users/e85ee0fa6dc94d29a79bd1659cd446bf/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:26.884780 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b7c95-bdb7-4d33-87c1-cae3f84784d7 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:26.885075 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b7c95-bdb7-4d33-87c1-cae3f84784d7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:26.885357 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b7c95-bdb7-4d33-87c1-cae3f84784d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:26.890842 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1027/2055] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:26 2022] DELETE /identity/v3/users/5abd29551f1642c9aff64fdef0592fa4 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:26.915324 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c87b7c95-bdb7-4d33-87c1-cae3f84784d7 None None] MFA Rules not processed for user `e85ee0fa6dc94d29a79bd1659cd446bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:26.916728 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c87b7c95-bdb7-4d33-87c1-cae3f84784d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:27.004167 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1029/2056] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:27.012967 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83068a5d-5f13-447a-99ed-616a7ba4d451 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:27.015279 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-83068a5d-5f13-447a-99ed-616a7ba4d451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:27.106804 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83068a5d-5f13-447a-99ed-616a7ba4d451 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:27.108066 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b7c95-bdb7-4d33-87c1-cae3f84784d7 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:27.109497 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c87b7c95-bdb7-4d33-87c1-cae3f84784d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:27.111922 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974e987-200f-488b-8e45-fb15c58159c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:27.112630 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974e987-200f-488b-8e45-fb15c58159c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:27.112993 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974e987-200f-488b-8e45-fb15c58159c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:27.113247 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974e987-200f-488b-8e45-fb15c58159c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:27.114113 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974e987-200f-488b-8e45-fb15c58159c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:27.116702 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974e987-200f-488b-8e45-fb15c58159c7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:27.132962 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b7c95-bdb7-4d33-87c1-cae3f84784d7 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:27.142005 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48954d42-e884-4e95-b1e0-74d159f409c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:27.145032 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48954d42-e884-4e95-b1e0-74d159f409c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:27.145032 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48954d42-e884-4e95-b1e0-74d159f409c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:27.145467 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48954d42-e884-4e95-b1e0-74d159f409c2 admin admin] PATH_INFO: `/v3/projects/8a5786b26d054fe594102a84e4fa92e6` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:27.147501 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48954d42-e884-4e95-b1e0-74d159f409c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a5786b26d054fe594102a84e4fa92e6)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:27.149463 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48954d42-e884-4e95-b1e0-74d159f409c2 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:27.159043 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1028/2057] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:27 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:27.160678 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974e987-200f-488b-8e45-fb15c58159c7 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:27.238601 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-48954d42-e884-4e95-b1e0-74d159f409c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a5786b26d054fe594102a84e4fa92e6', 'request_id': 'req-48954d42-e884-4e95-b1e0-74d159f409c2'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:27.256110 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-48954d42-e884-4e95-b1e0-74d159f409c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a5786b26d054fe594102a84e4fa92e6', 'request_id': 'req-48954d42-e884-4e95-b1e0-74d159f409c2'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:27.265638 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974e987-200f-488b-8e45-fb15c58159c7 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:27.269914 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-48954d42-e884-4e95-b1e0-74d159f409c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a5786b26d054fe594102a84e4fa92e6', 'request_id': 'req-48954d42-e884-4e95-b1e0-74d159f409c2'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:27.296317 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-48954d42-e884-4e95-b1e0-74d159f409c2 admin admin] The token cache is being invalidate because project 8a5786b26d054fe594102a84e4fa92e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:27.296317 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-48954d42-e884-4e95-b1e0-74d159f409c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:27.297187 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-48954d42-e884-4e95-b1e0-74d159f409c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:27.304734 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1030/2058] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:27 2022] DELETE /identity/v3/projects/8a5786b26d054fe594102a84e4fa92e6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:27.305292 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48954d42-e884-4e95-b1e0-74d159f409c2 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:27.307414 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-48954d42-e884-4e95-b1e0-74d159f409c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:27.329980 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f091645-2d76-49c5-b99d-06e6000aa3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:27.331229 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f091645-2d76-49c5-b99d-06e6000aa3e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:27.331513 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f091645-2d76-49c5-b99d-06e6000aa3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:27.332436 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f091645-2d76-49c5-b99d-06e6000aa3e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:27.332558 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f091645-2d76-49c5-b99d-06e6000aa3e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:27.334559 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f091645-2d76-49c5-b99d-06e6000aa3e3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:27.363077 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1029/2059] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:27 2022] POST /identity/v3/users => generated 296 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:27.365705 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0e2f0-f148-42e5-949d-c3d1fa76af5c None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:27.366161 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0e2f0-f148-42e5-949d-c3d1fa76af5c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:27.366447 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0e2f0-f148-42e5-949d-c3d1fa76af5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:27.387006 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e9d0e2f0-f148-42e5-949d-c3d1fa76af5c None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:27.388276 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e9d0e2f0-f148-42e5-949d-c3d1fa76af5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:27.392482 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48954d42-e884-4e95-b1e0-74d159f409c2 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:27.399385 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1030/2060] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:27.400173 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0e2f0-f148-42e5-949d-c3d1fa76af5c None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:27.406869 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e9d0e2f0-f148-42e5-949d-c3d1fa76af5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:27.409357 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b2363-d78f-4367-992c-cf7cbf1e9a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:27.411316 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b2363-d78f-4367-992c-cf7cbf1e9a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:27.411901 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b2363-d78f-4367-992c-cf7cbf1e9a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:27.412489 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b2363-d78f-4367-992c-cf7cbf1e9a66 admin admin] PATH_INFO: `/v3/projects/528a305d0dae426d8723835a49ac5923` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:27.413943 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b2363-d78f-4367-992c-cf7cbf1e9a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=528a305d0dae426d8723835a49ac5923)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:27.416500 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b2363-d78f-4367-992c-cf7cbf1e9a66 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:27.419903 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0e2f0-f148-42e5-949d-c3d1fa76af5c None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:27.429000 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35eff0-93ec-4086-962e-9c214136054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:27.430213 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35eff0-93ec-4086-962e-9c214136054c admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:27.430645 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35eff0-93ec-4086-962e-9c214136054c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:27.431307 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35eff0-93ec-4086-962e-9c214136054c admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:27.433435 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35eff0-93ec-4086-962e-9c214136054c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:27.436577 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35eff0-93ec-4086-962e-9c214136054c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:27.453574 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1031/2061] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:27.454831 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a2e1e-1891-4483-9448-90d7c58de223 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:27.455329 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a2e1e-1891-4483-9448-90d7c58de223 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:27.455849 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a2e1e-1891-4483-9448-90d7c58de223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:27.473942 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-cd5b2363-d78f-4367-992c-cf7cbf1e9a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '528a305d0dae426d8723835a49ac5923', 'request_id': 'req-cd5b2363-d78f-4367-992c-cf7cbf1e9a66'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:27.476012 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-bf9a2e1e-1891-4483-9448-90d7c58de223 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:27.477195 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-bf9a2e1e-1891-4483-9448-90d7c58de223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:27.484348 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-cd5b2363-d78f-4367-992c-cf7cbf1e9a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '528a305d0dae426d8723835a49ac5923', 'request_id': 'req-cd5b2363-d78f-4367-992c-cf7cbf1e9a66'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:27.491493 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-cd5b2363-d78f-4367-992c-cf7cbf1e9a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '528a305d0dae426d8723835a49ac5923', 'request_id': 'req-cd5b2363-d78f-4367-992c-cf7cbf1e9a66'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:27.507335 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-cd5b2363-d78f-4367-992c-cf7cbf1e9a66 admin admin] The token cache is being invalidate because project 528a305d0dae426d8723835a49ac5923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:27.507857 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-cd5b2363-d78f-4367-992c-cf7cbf1e9a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:27.508729 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-cd5b2363-d78f-4367-992c-cf7cbf1e9a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:27.513568 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1031/2062] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:27 2022] DELETE /identity/v3/projects/528a305d0dae426d8723835a49ac5923 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:27.513568 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b2363-d78f-4367-992c-cf7cbf1e9a66 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:27.513568 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-cd5b2363-d78f-4367-992c-cf7cbf1e9a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:27.563906 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1032/2063] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:27.566262 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb20002-c99b-4841-a7fe-9ecf1aa64037 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:27.566658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb20002-c99b-4841-a7fe-9ecf1aa64037 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:27.567041 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb20002-c99b-4841-a7fe-9ecf1aa64037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:27.602378 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b2363-d78f-4367-992c-cf7cbf1e9a66 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:27.607846 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3b261-2518-4932-84d8-2a45e52e3930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:27.609211 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3b261-2518-4932-84d8-2a45e52e3930 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:27.609599 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3b261-2518-4932-84d8-2a45e52e3930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:27.609975 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3b261-2518-4932-84d8-2a45e52e3930 admin admin] PATH_INFO: `/v3/projects/35baaeb23a204ad593c0055a17a9c412/users/4c40181bc5574da7a0d0b698b2c0c308/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:27.613332 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-8cb20002-c99b-4841-a7fe-9ecf1aa64037 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:27.614939 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8cb20002-c99b-4841-a7fe-9ecf1aa64037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:27.623527 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1033/2064] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:27.624548 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb20002-c99b-4841-a7fe-9ecf1aa64037 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:27.631859 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3b261-2518-4932-84d8-2a45e52e3930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35baaeb23a204ad593c0055a17a9c412, user_id=4c40181bc5574da7a0d0b698b2c0c308, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:27.636594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3b261-2518-4932-84d8-2a45e52e3930 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:27.640519 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb20002-c99b-4841-a7fe-9ecf1aa64037 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:27.646054 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdb43b-cdc4-43aa-ad5d-092d3ab4001b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:27.646602 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdb43b-cdc4-43aa-ad5d-092d3ab4001b admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:27.646884 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdb43b-cdc4-43aa-ad5d-092d3ab4001b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:27.647193 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdb43b-cdc4-43aa-ad5d-092d3ab4001b admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:27.647960 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdb43b-cdc4-43aa-ad5d-092d3ab4001b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:27.648266 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdb43b-cdc4-43aa-ad5d-092d3ab4001b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:27.649774 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1032/2065] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:27 2022] PUT /identity/v3/projects/35baaeb23a204ad593c0055a17a9c412/users/4c40181bc5574da7a0d0b698b2c0c308/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:27.649891 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdb43b-cdc4-43aa-ad5d-092d3ab4001b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:27.653915 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dbbba-1fb3-4902-a308-b784a424e249 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:27.654424 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dbbba-1fb3-4902-a308-b784a424e249 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:27.654892 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dbbba-1fb3-4902-a308-b784a424e249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:27.662481 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1034/2066] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:56:27.663408 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdb43b-cdc4-43aa-ad5d-092d3ab4001b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:27.678705 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-232dbbba-1fb3-4902-a308-b784a424e249 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:27.679951 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-232dbbba-1fb3-4902-a308-b784a424e249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:27.680996 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdb43b-cdc4-43aa-ad5d-092d3ab4001b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:27.738504 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f6eab-fd61-4132-a836-de4633882c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:27.739207 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f6eab-fd61-4132-a836-de4633882c8b admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:27.739514 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f6eab-fd61-4132-a836-de4633882c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:27.739825 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f6eab-fd61-4132-a836-de4633882c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:27.740554 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f6eab-fd61-4132-a836-de4633882c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:27.742149 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f6eab-fd61-4132-a836-de4633882c8b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:27.743835 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1033/2067] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:27.747105 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dbbba-1fb3-4902-a308-b784a424e249 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:27.754266 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dbbba-1fb3-4902-a308-b784a424e249 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:27.758907 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1035/2068] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:27.758907 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f6eab-fd61-4132-a836-de4633882c8b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:27.759169 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc825d94-698d-4e20-b724-ff38692fd9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:27.759602 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc825d94-698d-4e20-b724-ff38692fd9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:27.759913 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc825d94-698d-4e20-b724-ff38692fd9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:27.760192 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc825d94-698d-4e20-b724-ff38692fd9e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:27.760874 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc825d94-698d-4e20-b724-ff38692fd9e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:27.762772 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc825d94-698d-4e20-b724-ff38692fd9e5 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:27.768770 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f6eab-fd61-4132-a836-de4633882c8b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:27.773439 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3074789-7749-432b-97d9-68befc508ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:27.774088 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3074789-7749-432b-97d9-68befc508ccf admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:27.774363 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3074789-7749-432b-97d9-68befc508ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:27.774643 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3074789-7749-432b-97d9-68befc508ccf admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:27.775491 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3074789-7749-432b-97d9-68befc508ccf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:27.775847 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3074789-7749-432b-97d9-68befc508ccf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:27.777425 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3074789-7749-432b-97d9-68befc508ccf admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:27.790999 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1034/2069] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:27 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:27.790999 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc825d94-698d-4e20-b724-ff38692fd9e5 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:27.796656 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1036/2070] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:56:27.796656 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3074789-7749-432b-97d9-68befc508ccf admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:27.804726 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3074789-7749-432b-97d9-68befc508ccf admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:27.870820 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc825d94-698d-4e20-b724-ff38692fd9e5 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:27.878001 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ca28b-0b6d-4e55-a4cf-659d0b1f6bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:27.878821 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4927c-2b6b-4caa-8f04-2ff1b194a329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:27.879099 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ca28b-0b6d-4e55-a4cf-659d0b1f6bed admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:27.879450 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ca28b-0b6d-4e55-a4cf-659d0b1f6bed admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:27.879748 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4927c-2b6b-4caa-8f04-2ff1b194a329 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:27.879883 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ca28b-0b6d-4e55-a4cf-659d0b1f6bed admin admin] PATH_INFO: `/v3/projects/35baaeb23a204ad593c0055a17a9c412/users/4c40181bc5574da7a0d0b698b2c0c308/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:27.880166 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4927c-2b6b-4caa-8f04-2ff1b194a329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:27.880630 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4927c-2b6b-4caa-8f04-2ff1b194a329 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:27.881394 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4927c-2b6b-4caa-8f04-2ff1b194a329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:27.882109 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ca28b-0b6d-4e55-a4cf-659d0b1f6bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=35baaeb23a204ad593c0055a17a9c412, user_id=4c40181bc5574da7a0d0b698b2c0c308, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:27.884191 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4927c-2b6b-4caa-8f04-2ff1b194a329 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:27.885048 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ca28b-0b6d-4e55-a4cf-659d0b1f6bed admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:27.900122 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1035/2071] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:27 2022] PUT /identity/v3/projects/35baaeb23a204ad593c0055a17a9c412/users/4c40181bc5574da7a0d0b698b2c0c308/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:27.901112 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ca28b-0b6d-4e55-a4cf-659d0b1f6bed admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:27.910880 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1037/2072] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:27 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:27.918165 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8450e-58b1-4e93-8e3d-62a42c47487d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:27.918461 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8450e-58b1-4e93-8e3d-62a42c47487d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:27.918739 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8450e-58b1-4e93-8e3d-62a42c47487d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:27.946757 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-07a8450e-58b1-4e93-8e3d-62a42c47487d None None] MFA Rules not processed for user `4c40181bc5574da7a0d0b698b2c0c308`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:27.947914 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-07a8450e-58b1-4e93-8e3d-62a42c47487d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:27.984137 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ca28b-0b6d-4e55-a4cf-659d0b1f6bed admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:27.988999 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b07dcf-37f6-44b7-8ebe-26e3b3ec4d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:27.989659 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b07dcf-37f6-44b7-8ebe-26e3b3ec4d8a admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:27.990062 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b07dcf-37f6-44b7-8ebe-26e3b3ec4d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:27.990339 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b07dcf-37f6-44b7-8ebe-26e3b3ec4d8a admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:27.991036 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b07dcf-37f6-44b7-8ebe-26e3b3ec4d8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:27.992991 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b07dcf-37f6-44b7-8ebe-26e3b3ec4d8a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:28.031167 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1036/2073] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:27 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:28.032580 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b07dcf-37f6-44b7-8ebe-26e3b3ec4d8a admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:28.047371 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1038/2074] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:28.047371 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8450e-58b1-4e93-8e3d-62a42c47487d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:28.068554 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8450e-58b1-4e93-8e3d-62a42c47487d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:28.108730 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b07dcf-37f6-44b7-8ebe-26e3b3ec4d8a admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:28.113793 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f81afe-3cef-4d64-a947-da350fee88da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:28.114804 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f81afe-3cef-4d64-a947-da350fee88da admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:28.115090 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f81afe-3cef-4d64-a947-da350fee88da admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:28.115521 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f81afe-3cef-4d64-a947-da350fee88da admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:28.116661 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f81afe-3cef-4d64-a947-da350fee88da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:28.118019 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f81afe-3cef-4d64-a947-da350fee88da admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:28.128640 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1037/2075] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:28.129774 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c205af-dbca-4018-a0f9-4128fffae238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:28.130466 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c205af-dbca-4018-a0f9-4128fffae238 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:28.130757 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c205af-dbca-4018-a0f9-4128fffae238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:28.131548 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c205af-dbca-4018-a0f9-4128fffae238 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:28.132921 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f81afe-3cef-4d64-a947-da350fee88da admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:28.133365 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c205af-dbca-4018-a0f9-4128fffae238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:28.134964 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d9f81afe-3cef-4d64-a947-da350fee88da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:28.135642 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c205af-dbca-4018-a0f9-4128fffae238 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:28.163687 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1039/2076] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:28 2022] POST /identity/v3/users => generated 285 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:28.163687 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c205af-dbca-4018-a0f9-4128fffae238 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:28.173445 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c205af-dbca-4018-a0f9-4128fffae238 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:28.178750 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db617421-92ed-4a12-8d6d-6e91235d0be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:28.179400 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db617421-92ed-4a12-8d6d-6e91235d0be4 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:28.179895 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db617421-92ed-4a12-8d6d-6e91235d0be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:28.180182 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db617421-92ed-4a12-8d6d-6e91235d0be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:28.180905 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db617421-92ed-4a12-8d6d-6e91235d0be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:28.182489 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db617421-92ed-4a12-8d6d-6e91235d0be4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:28.192709 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1040/2077] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:28.194294 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db617421-92ed-4a12-8d6d-6e91235d0be4 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:28.197888 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f81afe-3cef-4d64-a947-da350fee88da admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:28.201502 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e4c8c-a94b-4a34-ae37-14a9cd222e21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:28.202143 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e4c8c-a94b-4a34-ae37-14a9cd222e21 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:28.202427 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e4c8c-a94b-4a34-ae37-14a9cd222e21 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:28.202700 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e4c8c-a94b-4a34-ae37-14a9cd222e21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:28.204194 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db617421-92ed-4a12-8d6d-6e91235d0be4 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:28.209349 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00195a-b0d2-4681-b8cb-7b5b7d017e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:28.210142 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00195a-b0d2-4681-b8cb-7b5b7d017e35 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:28.210438 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00195a-b0d2-4681-b8cb-7b5b7d017e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:28.210726 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00195a-b0d2-4681-b8cb-7b5b7d017e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:28.211477 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00195a-b0d2-4681-b8cb-7b5b7d017e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:28.213089 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00195a-b0d2-4681-b8cb-7b5b7d017e35 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:28.223863 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1041/2078] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:28.224778 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00195a-b0d2-4681-b8cb-7b5b7d017e35 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:28.234929 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00195a-b0d2-4681-b8cb-7b5b7d017e35 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:28.240339 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e0c6d-ad10-4715-a0ac-40eae26fe8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:28.241379 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e0c6d-ad10-4715-a0ac-40eae26fe8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:28.241666 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e0c6d-ad10-4715-a0ac-40eae26fe8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:28.241942 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e0c6d-ad10-4715-a0ac-40eae26fe8e0 admin admin] PATH_INFO: `/v3/projects/3245e9200dcb4694bef6b0c75c909d34/users/1067a80de73b4a6b8066633a6ef32fc2/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:28.256457 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e0c6d-ad10-4715-a0ac-40eae26fe8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3245e9200dcb4694bef6b0c75c909d34, user_id=1067a80de73b4a6b8066633a6ef32fc2, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:28.259138 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e0c6d-ad10-4715-a0ac-40eae26fe8e0 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:28.265562 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e4c8c-a94b-4a34-ae37-14a9cd222e21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:28.267088 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e4c8c-a94b-4a34-ae37-14a9cd222e21 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:28.272972 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1042/2079] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:28 2022] PUT /identity/v3/projects/3245e9200dcb4694bef6b0c75c909d34/users/1067a80de73b4a6b8066633a6ef32fc2/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:28.276488 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e0c6d-ad10-4715-a0ac-40eae26fe8e0 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:28.277973 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1038/2080] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:28.284042 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3c7b9-72cd-4fa4-b188-fd0012117b73 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:28.284389 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3c7b9-72cd-4fa4-b188-fd0012117b73 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:28.284638 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3c7b9-72cd-4fa4-b188-fd0012117b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:28.321058 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-18d3c7b9-72cd-4fa4-b188-fd0012117b73 None None] MFA Rules not processed for user `1067a80de73b4a6b8066633a6ef32fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:28.323750 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-18d3c7b9-72cd-4fa4-b188-fd0012117b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:28.345796 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e0c6d-ad10-4715-a0ac-40eae26fe8e0 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:28.376456 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820dc53-8931-4c94-b698-03a3b103a021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:28.380391 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820dc53-8931-4c94-b698-03a3b103a021 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:28.387755 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820dc53-8931-4c94-b698-03a3b103a021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:28.388080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820dc53-8931-4c94-b698-03a3b103a021 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:28.399490 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820dc53-8931-4c94-b698-03a3b103a021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:28.399490 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820dc53-8931-4c94-b698-03a3b103a021 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:28.415615 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1039/2081] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:28.420008 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3c7b9-72cd-4fa4-b188-fd0012117b73 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:28.433583 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1043/2082] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:28.438542 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820dc53-8931-4c94-b698-03a3b103a021 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:28.442295 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3c7b9-72cd-4fa4-b188-fd0012117b73 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:28.452637 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec93750-44dd-47bc-9862-b39323fefba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:28.456011 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec93750-44dd-47bc-9862-b39323fefba9 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:28.456558 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec93750-44dd-47bc-9862-b39323fefba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:28.456849 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec93750-44dd-47bc-9862-b39323fefba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:28.457590 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec93750-44dd-47bc-9862-b39323fefba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:28.473414 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec93750-44dd-47bc-9862-b39323fefba9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:28.479809 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820dc53-8931-4c94-b698-03a3b103a021 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:28.498362 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04a448-18e1-4b0d-804c-ae4875a6f02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:28.499069 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04a448-18e1-4b0d-804c-ae4875a6f02a admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:28.499368 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04a448-18e1-4b0d-804c-ae4875a6f02a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:28.499691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04a448-18e1-4b0d-804c-ae4875a6f02a admin admin] PATH_INFO: `/v3/projects/c5af82040fc442d5af58796feb36a041/users/5cdfdeae35e84a719111d77bb9488d80/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:28.528034 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04a448-18e1-4b0d-804c-ae4875a6f02a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5af82040fc442d5af58796feb36a041, user_id=5cdfdeae35e84a719111d77bb9488d80, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:28.531610 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04a448-18e1-4b0d-804c-ae4875a6f02a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:28.538184 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1040/2083] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:28 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:56:28.541798 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec93750-44dd-47bc-9862-b39323fefba9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:28.550572 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1044/2084] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:28 2022] PUT /identity/v3/projects/c5af82040fc442d5af58796feb36a041/users/5cdfdeae35e84a719111d77bb9488d80/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:28.561959 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7058a-971a-47de-b6b1-f86e4d9e7ace None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:28.562254 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7058a-971a-47de-b6b1-f86e4d9e7ace None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:28.562557 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7058a-971a-47de-b6b1-f86e4d9e7ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:28.595338 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-ade7058a-971a-47de-b6b1-f86e4d9e7ace None None] MFA Rules not processed for user `5cdfdeae35e84a719111d77bb9488d80`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:28.596858 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ade7058a-971a-47de-b6b1-f86e4d9e7ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:28.610848 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec93750-44dd-47bc-9862-b39323fefba9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:28.682113 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b81186-0598-4b14-a543-a1c9a762c0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:28.682660 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1045/2085] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:28.682785 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b81186-0598-4b14-a543-a1c9a762c0ea admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:28.683053 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b81186-0598-4b14-a543-a1c9a762c0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:28.683324 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b81186-0598-4b14-a543-a1c9a762c0ea admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:28.683408 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7058a-971a-47de-b6b1-f86e4d9e7ace None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:28.684048 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b81186-0598-4b14-a543-a1c9a762c0ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:28.685992 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b81186-0598-4b14-a543-a1c9a762c0ea admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:28.709119 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1041/2086] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:28 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:28.709119 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b81186-0598-4b14-a543-a1c9a762c0ea admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:28.721088 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b81186-0598-4b14-a543-a1c9a762c0ea admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:28.726083 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d84438-2fab-48dc-9228-bb0bc3b3b439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:28.726743 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d84438-2fab-48dc-9228-bb0bc3b3b439 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:28.727049 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d84438-2fab-48dc-9228-bb0bc3b3b439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:28.727320 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d84438-2fab-48dc-9228-bb0bc3b3b439 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:28.728048 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d84438-2fab-48dc-9228-bb0bc3b3b439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:28.729962 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d84438-2fab-48dc-9228-bb0bc3b3b439 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:28.746068 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7058a-971a-47de-b6b1-f86e4d9e7ace None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:28.753201 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf5b6b-0d1a-47b9-a765-ff667a6fa4b6 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c40181bc5574da7a0d0b698b2c0c308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35baaeb23a204ad593c0055a17a9c412', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:28.754251 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf5b6b-0d1a-47b9-a765-ff667a6fa4b6 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:28.754499 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf5b6b-0d1a-47b9-a765-ff667a6fa4b6 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:28.754808 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf5b6b-0d1a-47b9-a765-ff667a6fa4b6 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:28.755735 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf5b6b-0d1a-47b9-a765-ff667a6fa4b6 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:28.756127 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf5b6b-0d1a-47b9-a765-ff667a6fa4b6 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:28.757818 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf5b6b-0d1a-47b9-a765-ff667a6fa4b6 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:28.758745 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1042/2087] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:28 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:28.759749 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d84438-2fab-48dc-9228-bb0bc3b3b439 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:28.778535 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1046/2088] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:56:28.778535 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf5b6b-0d1a-47b9-a765-ff667a6fa4b6 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:28.790458 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf5b6b-0d1a-47b9-a765-ff667a6fa4b6 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:28.834353 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d84438-2fab-48dc-9228-bb0bc3b3b439 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:28.839241 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e43a4-420d-4692-838a-f873ad5dfdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:28.839941 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e43a4-420d-4692-838a-f873ad5dfdfd admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:28.840251 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e43a4-420d-4692-838a-f873ad5dfdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:28.840523 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e43a4-420d-4692-838a-f873ad5dfdfd admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:28.841257 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e43a4-420d-4692-838a-f873ad5dfdfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:28.842867 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e43a4-420d-4692-838a-f873ad5dfdfd admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:28.852962 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1043/2089] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:28.853831 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e43a4-420d-4692-838a-f873ad5dfdfd admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:28.874199 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c389353-5d78-4b9d-9271-03e76aab496d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:28.877857 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c389353-5d78-4b9d-9271-03e76aab496d admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:28.878359 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c389353-5d78-4b9d-9271-03e76aab496d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:28.878835 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c389353-5d78-4b9d-9271-03e76aab496d admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:28.880263 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c389353-5d78-4b9d-9271-03e76aab496d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:28.883175 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c389353-5d78-4b9d-9271-03e76aab496d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:28.909743 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1047/2090] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:28 2022] POST /identity/v3/users => generated 291 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:28.909953 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c389353-5d78-4b9d-9271-03e76aab496d admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:28.921670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c389353-5d78-4b9d-9271-03e76aab496d admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:28.927427 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd6319-f54b-4dbb-8b5b-3c85458cf9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:28.928272 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd6319-f54b-4dbb-8b5b-3c85458cf9bc admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:28.928679 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd6319-f54b-4dbb-8b5b-3c85458cf9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:28.929028 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd6319-f54b-4dbb-8b5b-3c85458cf9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:28.929914 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd6319-f54b-4dbb-8b5b-3c85458cf9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:28.932005 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd6319-f54b-4dbb-8b5b-3c85458cf9bc admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:28.944048 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1048/2091] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:28.944882 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd6319-f54b-4dbb-8b5b-3c85458cf9bc admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:28.948437 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e43a4-420d-4692-838a-f873ad5dfdfd admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:28.955561 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd6319-f54b-4dbb-8b5b-3c85458cf9bc admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:28.957454 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5ab81-ec7b-40fe-9336-7e39de04e6f7 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c40181bc5574da7a0d0b698b2c0c308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35baaeb23a204ad593c0055a17a9c412', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:28.958234 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5ab81-ec7b-40fe-9336-7e39de04e6f7 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:28.959006 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5ab81-ec7b-40fe-9336-7e39de04e6f7 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:28.959006 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5ab81-ec7b-40fe-9336-7e39de04e6f7 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:28.959664 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5ab81-ec7b-40fe-9336-7e39de04e6f7 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:28.961684 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba2446-30ff-4c57-8fb6-836c1ccbb332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:28.961851 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5ab81-ec7b-40fe-9336-7e39de04e6f7 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:28.962465 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba2446-30ff-4c57-8fb6-836c1ccbb332 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:28.962834 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba2446-30ff-4c57-8fb6-836c1ccbb332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:28.963119 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba2446-30ff-4c57-8fb6-836c1ccbb332 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:28.964081 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba2446-30ff-4c57-8fb6-836c1ccbb332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:28.965743 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba2446-30ff-4c57-8fb6-836c1ccbb332 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:28.976853 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1049/2092] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:28.977646 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba2446-30ff-4c57-8fb6-836c1ccbb332 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:28.987585 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba2446-30ff-4c57-8fb6-836c1ccbb332 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:28.989940 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1044/2093] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:28 2022] POST /identity/v3/projects => generated 355 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:28.990808 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5ab81-ec7b-40fe-9336-7e39de04e6f7 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:28.992158 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074f0a0-e962-4e32-bc1d-cd33c8fa1d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:28.993026 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074f0a0-e962-4e32-bc1d-cd33c8fa1d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:28.993311 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074f0a0-e962-4e32-bc1d-cd33c8fa1d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:28.993591 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074f0a0-e962-4e32-bc1d-cd33c8fa1d9c admin admin] PATH_INFO: `/v3/projects/7a13d56546e845fbbe16c2e4c3052fe8/users/df09eb6be73147d494d066abb7ee5ffd/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:29.007932 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074f0a0-e962-4e32-bc1d-cd33c8fa1d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a13d56546e845fbbe16c2e4c3052fe8, user_id=df09eb6be73147d494d066abb7ee5ffd, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:29.010644 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074f0a0-e962-4e32-bc1d-cd33c8fa1d9c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:29.023522 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1050/2094] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:28 2022] PUT /identity/v3/projects/7a13d56546e845fbbe16c2e4c3052fe8/users/df09eb6be73147d494d066abb7ee5ffd/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:29.032501 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074f0a0-e962-4e32-bc1d-cd33c8fa1d9c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:29.056472 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5ab81-ec7b-40fe-9336-7e39de04e6f7 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:29.084327 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074f0a0-e962-4e32-bc1d-cd33c8fa1d9c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:29.089081 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1a121-49ed-47c6-ad60-509ca2b83c9b tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c40181bc5574da7a0d0b698b2c0c308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35baaeb23a204ad593c0055a17a9c412', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:29.089737 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1a121-49ed-47c6-ad60-509ca2b83c9b tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:29.090021 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1a121-49ed-47c6-ad60-509ca2b83c9b tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:29.090300 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1a121-49ed-47c6-ad60-509ca2b83c9b tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:29.091032 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1a121-49ed-47c6-ad60-509ca2b83c9b tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:29.091341 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1a121-49ed-47c6-ad60-509ca2b83c9b tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:29.092975 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1a121-49ed-47c6-ad60-509ca2b83c9b tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:29.107525 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1051/2095] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:56:29.107525 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446153a-f996-4c5a-88c0-163d958513e2 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:29.107525 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446153a-f996-4c5a-88c0-163d958513e2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:29.107525 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446153a-f996-4c5a-88c0-163d958513e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:29.119042 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddd7ef-ce81-4403-8d91-00d146ee3447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:29.120257 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddd7ef-ce81-4403-8d91-00d146ee3447 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:29.120546 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddd7ef-ce81-4403-8d91-00d146ee3447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:29.120830 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddd7ef-ce81-4403-8d91-00d146ee3447 admin admin] PATH_INFO: `/v3/projects/de5430a52da8464c91d815241dfab7dc/users/05b844e06ea84d3b89733f25440d623c/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:29.143416 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7446153a-f996-4c5a-88c0-163d958513e2 None None] MFA Rules not processed for user `df09eb6be73147d494d066abb7ee5ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:29.144827 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7446153a-f996-4c5a-88c0-163d958513e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:29.152429 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eddd7ef-ce81-4403-8d91-00d146ee3447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5430a52da8464c91d815241dfab7dc, user_id=05b844e06ea84d3b89733f25440d623c, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:29.155374 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eddd7ef-ce81-4403-8d91-00d146ee3447 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:29.170610 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1045/2096] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:28 2022] PUT /identity/v3/projects/de5430a52da8464c91d815241dfab7dc/users/05b844e06ea84d3b89733f25440d623c/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:29.174809 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddd7ef-ce81-4403-8d91-00d146ee3447 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:29.219123 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1052/2097] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:29.219937 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446153a-f996-4c5a-88c0-163d958513e2 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:29.231666 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446153a-f996-4c5a-88c0-163d958513e2 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:29.240473 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddd7ef-ce81-4403-8d91-00d146ee3447 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:29.245132 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e2efc-2c64-460c-8add-9f3b7cc44647 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c40181bc5574da7a0d0b698b2c0c308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35baaeb23a204ad593c0055a17a9c412', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:29.246271 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e2efc-2c64-460c-8add-9f3b7cc44647 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:29.246386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e2efc-2c64-460c-8add-9f3b7cc44647 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:29.246582 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e2efc-2c64-460c-8add-9f3b7cc44647 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] PATH_INFO: `/v3/projects/3c1bc36364144008b173a9cd5e2c4f01` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:29.247815 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e2efc-2c64-460c-8add-9f3b7cc44647 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3c1bc36364144008b173a9cd5e2c4f01)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:29.249751 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e2efc-2c64-460c-8add-9f3b7cc44647 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:29.292638 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5770c-84c8-431a-8bfc-1093e149b56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:29.293340 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5770c-84c8-431a-8bfc-1093e149b56b admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:29.293626 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5770c-84c8-431a-8bfc-1093e149b56b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:29.293903 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5770c-84c8-431a-8bfc-1093e149b56b admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:29.294632 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5770c-84c8-431a-8bfc-1093e149b56b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:29.296268 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5770c-84c8-431a-8bfc-1093e149b56b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:29.300034 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d84e2efc-2c64-460c-8add-9f3b7cc44647 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c1bc36364144008b173a9cd5e2c4f01', 'request_id': 'req-d84e2efc-2c64-460c-8add-9f3b7cc44647'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:29.307275 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d84e2efc-2c64-460c-8add-9f3b7cc44647 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c1bc36364144008b173a9cd5e2c4f01', 'request_id': 'req-d84e2efc-2c64-460c-8add-9f3b7cc44647'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:29.310740 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1053/2098] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:29.310740 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5770c-84c8-431a-8bfc-1093e149b56b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:29.313933 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d84e2efc-2c64-460c-8add-9f3b7cc44647 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c1bc36364144008b173a9cd5e2c4f01', 'request_id': 'req-d84e2efc-2c64-460c-8add-9f3b7cc44647'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:29.318961 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5770c-84c8-431a-8bfc-1093e149b56b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:29.325952 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d84e2efc-2c64-460c-8add-9f3b7cc44647 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] The token cache is being invalidate because project 3c1bc36364144008b173a9cd5e2c4f01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:29.326346 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d84e2efc-2c64-460c-8add-9f3b7cc44647 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:29.328316 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d84e2efc-2c64-460c-8add-9f3b7cc44647 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:29.330081 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1046/2099] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:29 2022] DELETE /identity/v3/projects/3c1bc36364144008b173a9cd5e2c4f01 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:29.330960 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e2efc-2c64-460c-8add-9f3b7cc44647 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:29.332378 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d84e2efc-2c64-460c-8add-9f3b7cc44647 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:29.382543 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446e1de-a10a-47ae-ad49-9a874a3f3fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:29.383352 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446e1de-a10a-47ae-ad49-9a874a3f3fcb admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:29.384129 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446e1de-a10a-47ae-ad49-9a874a3f3fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:29.384129 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446e1de-a10a-47ae-ad49-9a874a3f3fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:29.387368 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446e1de-a10a-47ae-ad49-9a874a3f3fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:29.389374 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446e1de-a10a-47ae-ad49-9a874a3f3fcb admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:29.402802 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e2efc-2c64-460c-8add-9f3b7cc44647 tempest-VolumeQuotaClassesTest-684843756 tempest-VolumeQuotaClassesTest-684843756-project-admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:29.410102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce049ac-d4c3-4165-93c0-3ecd18e30ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:29.411802 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce049ac-d4c3-4165-93c0-3ecd18e30ade admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:29.412088 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce049ac-d4c3-4165-93c0-3ecd18e30ade admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:29.413747 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce049ac-d4c3-4165-93c0-3ecd18e30ade admin admin] PATH_INFO: `/v3/projects/de5430a52da8464c91d815241dfab7dc/users/05b844e06ea84d3b89733f25440d623c/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:29.414629 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce049ac-d4c3-4165-93c0-3ecd18e30ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5430a52da8464c91d815241dfab7dc, user_id=05b844e06ea84d3b89733f25440d623c, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:29.417601 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce049ac-d4c3-4165-93c0-3ecd18e30ade admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:29.425434 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1054/2100] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:29 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:29.430063 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446e1de-a10a-47ae-ad49-9a874a3f3fcb admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:29.430644 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1047/2101] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:29 2022] PUT /identity/v3/projects/de5430a52da8464c91d815241dfab7dc/users/05b844e06ea84d3b89733f25440d623c/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:29.433610 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b446e1de-a10a-47ae-ad49-9a874a3f3fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:29.443228 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0b1a6-eb9d-48e0-b437-dfe8fe93b492 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:29.443519 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0b1a6-eb9d-48e0-b437-dfe8fe93b492 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:29.443830 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0b1a6-eb9d-48e0-b437-dfe8fe93b492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:29.474411 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-78e0b1a6-eb9d-48e0-b437-dfe8fe93b492 None None] MFA Rules not processed for user `05b844e06ea84d3b89733f25440d623c`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:29.475700 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-78e0b1a6-eb9d-48e0-b437-dfe8fe93b492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:29.535849 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446e1de-a10a-47ae-ad49-9a874a3f3fcb admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:29.585990 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1048/2102] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:29 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:29.592849 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0b1a6-eb9d-48e0-b437-dfe8fe93b492 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:29.599319 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-78e0b1a6-eb9d-48e0-b437-dfe8fe93b492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:29.628721 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2852bf-0f2f-4159-b823-32b95792f6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:29.629460 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2852bf-0f2f-4159-b823-32b95792f6cc admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:29.629751 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2852bf-0f2f-4159-b823-32b95792f6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:29.630029 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2852bf-0f2f-4159-b823-32b95792f6cc admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:29.630727 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2852bf-0f2f-4159-b823-32b95792f6cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:29.633722 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2852bf-0f2f-4159-b823-32b95792f6cc admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:29.666434 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1055/2103] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:29 2022] POST /identity/v3/users => generated 299 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:29.667420 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2852bf-0f2f-4159-b823-32b95792f6cc admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:29.670750 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-da2852bf-0f2f-4159-b823-32b95792f6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:29.686742 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0b1a6-eb9d-48e0-b437-dfe8fe93b492 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:29.693697 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bf350-0c08-4224-ab05-b0ac03b5cfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:29.694622 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bf350-0c08-4224-ab05-b0ac03b5cfe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:29.694879 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bf350-0c08-4224-ab05-b0ac03b5cfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:29.695153 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bf350-0c08-4224-ab05-b0ac03b5cfe1 admin admin] PATH_INFO: `/v3/users/e85ee0fa6dc94d29a79bd1659cd446bf` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:29.697279 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bf350-0c08-4224-ab05-b0ac03b5cfe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e85ee0fa6dc94d29a79bd1659cd446bf)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:29.699246 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bf350-0c08-4224-ab05-b0ac03b5cfe1 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:29.761752 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2852bf-0f2f-4159-b823-32b95792f6cc admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:29.768185 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c9c29-51b8-4ed6-826c-2541405b8d34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:29.768865 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c9c29-51b8-4ed6-826c-2541405b8d34 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:29.769134 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c9c29-51b8-4ed6-826c-2541405b8d34 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:29.769413 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c9c29-51b8-4ed6-826c-2541405b8d34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:29.778971 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c9c29-51b8-4ed6-826c-2541405b8d34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:29.780567 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c9c29-51b8-4ed6-826c-2541405b8d34 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:29.783766 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-642bf350-0c08-4224-ab05-b0ac03b5cfe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e85ee0fa6dc94d29a79bd1659cd446bf'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:29.790492 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1056/2104] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:29 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:29.791362 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c9c29-51b8-4ed6-826c-2541405b8d34 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:29.795614 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-642bf350-0c08-4224-ab05-b0ac03b5cfe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e85ee0fa6dc94d29a79bd1659cd446bf'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:29.803182 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c9c29-51b8-4ed6-826c-2541405b8d34 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:29.809702 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-642bf350-0c08-4224-ab05-b0ac03b5cfe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e85ee0fa6dc94d29a79bd1659cd446bf'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:29.810660 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36edea8-dae6-4dbd-8ab4-faf54bc1dae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:29.810813 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-642bf350-0c08-4224-ab05-b0ac03b5cfe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e85ee0fa6dc94d29a79bd1659cd446bf'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:29.811426 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-642bf350-0c08-4224-ab05-b0ac03b5cfe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e85ee0fa6dc94d29a79bd1659cd446bf'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:29.812390 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36edea8-dae6-4dbd-8ab4-faf54bc1dae8 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:29.816188 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36edea8-dae6-4dbd-8ab4-faf54bc1dae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:29.816789 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36edea8-dae6-4dbd-8ab4-faf54bc1dae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:29.817717 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36edea8-dae6-4dbd-8ab4-faf54bc1dae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:29.822541 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36edea8-dae6-4dbd-8ab4-faf54bc1dae8 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:29.838605 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1057/2105] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:29.840106 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1049/2106] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:29 2022] DELETE /identity/v3/users/e85ee0fa6dc94d29a79bd1659cd446bf => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:29.850482 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36edea8-dae6-4dbd-8ab4-faf54bc1dae8 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:29.850797 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9969c-6e9d-4257-9f2a-f5b06805f51c None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:29.850886 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c36edea8-dae6-4dbd-8ab4-faf54bc1dae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:29.855895 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9969c-6e9d-4257-9f2a-f5b06805f51c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:29.856855 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9969c-6e9d-4257-9f2a-f5b06805f51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:29.877049 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ebf9969c-6e9d-4257-9f2a-f5b06805f51c None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:29.878847 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ebf9969c-6e9d-4257-9f2a-f5b06805f51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:29.880496 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36edea8-dae6-4dbd-8ab4-faf54bc1dae8 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:29.950275 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9c65a-19e9-4a5a-a347-9d03940774c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:29.951185 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9c65a-19e9-4a5a-a347-9d03940774c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:29.951828 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9c65a-19e9-4a5a-a347-9d03940774c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:29.952174 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9c65a-19e9-4a5a-a347-9d03940774c6 admin admin] PATH_INFO: `/v3/projects/a9b19064da474769a8e1a3099ca97a8f/users/db35fbb1b7b3442e9be21727c8276309/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:29.956001 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1050/2107] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:29.964097 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9969c-6e9d-4257-9f2a-f5b06805f51c None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:29.967258 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ebf9969c-6e9d-4257-9f2a-f5b06805f51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:29.974581 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9c65a-19e9-4a5a-a347-9d03940774c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b19064da474769a8e1a3099ca97a8f, user_id=db35fbb1b7b3442e9be21727c8276309, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:29.977237 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9c65a-19e9-4a5a-a347-9d03940774c6 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:29.996904 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1058/2108] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:29 2022] PUT /identity/v3/projects/a9b19064da474769a8e1a3099ca97a8f/users/db35fbb1b7b3442e9be21727c8276309/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:30.000574 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9c65a-19e9-4a5a-a347-9d03940774c6 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:30.046489 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9969c-6e9d-4257-9f2a-f5b06805f51c None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:30.083165 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9c65a-19e9-4a5a-a347-9d03940774c6 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:30.090492 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f3385-fb22-4c59-989d-ab8a02e204ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:30.090492 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f3385-fb22-4c59-989d-ab8a02e204ad admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:30.090492 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f3385-fb22-4c59-989d-ab8a02e204ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:30.090492 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f3385-fb22-4c59-989d-ab8a02e204ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:30.093025 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f3385-fb22-4c59-989d-ab8a02e204ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:30.095742 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f3385-fb22-4c59-989d-ab8a02e204ad admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:30.108550 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1059/2109] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:30.113831 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f3385-fb22-4c59-989d-ab8a02e204ad admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:30.127790 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f3385-fb22-4c59-989d-ab8a02e204ad admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:30.132758 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed0363-d18c-475b-896e-a30b9680424b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:30.134286 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed0363-d18c-475b-896e-a30b9680424b admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:30.134680 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed0363-d18c-475b-896e-a30b9680424b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:30.134957 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed0363-d18c-475b-896e-a30b9680424b admin admin] PATH_INFO: `/v3/projects/a9b19064da474769a8e1a3099ca97a8f/users/db35fbb1b7b3442e9be21727c8276309/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:30.137193 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed0363-d18c-475b-896e-a30b9680424b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b19064da474769a8e1a3099ca97a8f, user_id=db35fbb1b7b3442e9be21727c8276309, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:30.139840 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123b4c8-eb9d-45ef-be17-e5f63f34aab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:30.140327 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed0363-d18c-475b-896e-a30b9680424b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:30.140595 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123b4c8-eb9d-45ef-be17-e5f63f34aab0 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:30.141057 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123b4c8-eb9d-45ef-be17-e5f63f34aab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:30.141395 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123b4c8-eb9d-45ef-be17-e5f63f34aab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:30.153045 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1060/2110] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:30 2022] PUT /identity/v3/projects/a9b19064da474769a8e1a3099ca97a8f/users/db35fbb1b7b3442e9be21727c8276309/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:30.162943 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123b4c8-eb9d-45ef-be17-e5f63f34aab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:30.164642 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b11dd9-96ed-4e61-9f90-68be95ea70df None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:30.164919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123b4c8-eb9d-45ef-be17-e5f63f34aab0 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:30.165037 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b11dd9-96ed-4e61-9f90-68be95ea70df None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:30.165212 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b11dd9-96ed-4e61-9f90-68be95ea70df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:30.186679 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1051/2111] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:56:30.204400 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c5b11dd9-96ed-4e61-9f90-68be95ea70df None None] MFA Rules not processed for user `db35fbb1b7b3442e9be21727c8276309`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:30.206876 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c5b11dd9-96ed-4e61-9f90-68be95ea70df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:30.310764 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1061/2112] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:30.323550 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123b4c8-eb9d-45ef-be17-e5f63f34aab0 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:30.325219 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e123b4c8-eb9d-45ef-be17-e5f63f34aab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:30.411377 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123b4c8-eb9d-45ef-be17-e5f63f34aab0 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:30.505132 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3d003-bb4e-4d83-85f9-4a511c091e33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:30.505816 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3d003-bb4e-4d83-85f9-4a511c091e33 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:30.506175 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3d003-bb4e-4d83-85f9-4a511c091e33 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:30.508616 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3d003-bb4e-4d83-85f9-4a511c091e33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:30.511098 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d4d3d003-bb4e-4d83-85f9-4a511c091e33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:30.601331 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3d003-bb4e-4d83-85f9-4a511c091e33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:30.603358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3d003-bb4e-4d83-85f9-4a511c091e33 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:30.619711 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1052/2113] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:30.629313 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b11dd9-96ed-4e61-9f90-68be95ea70df None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:30.631479 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c5b11dd9-96ed-4e61-9f90-68be95ea70df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:30.705650 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b11dd9-96ed-4e61-9f90-68be95ea70df None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:30.710609 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d68d08-f5fc-4bf2-bd6e-0f8890660167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:30.711785 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d68d08-f5fc-4bf2-bd6e-0f8890660167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:30.715090 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d68d08-f5fc-4bf2-bd6e-0f8890660167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:30.715484 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d68d08-f5fc-4bf2-bd6e-0f8890660167 admin admin] PATH_INFO: `/v3/projects/9530130966df4740ab9a41187aa306fd` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:30.724914 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d68d08-f5fc-4bf2-bd6e-0f8890660167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9530130966df4740ab9a41187aa306fd)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:30.728807 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d68d08-f5fc-4bf2-bd6e-0f8890660167 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:30.787374 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-60d68d08-f5fc-4bf2-bd6e-0f8890660167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9530130966df4740ab9a41187aa306fd', 'request_id': 'req-60d68d08-f5fc-4bf2-bd6e-0f8890660167'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:30.793734 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-60d68d08-f5fc-4bf2-bd6e-0f8890660167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9530130966df4740ab9a41187aa306fd', 'request_id': 'req-60d68d08-f5fc-4bf2-bd6e-0f8890660167'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:30.800084 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-60d68d08-f5fc-4bf2-bd6e-0f8890660167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9530130966df4740ab9a41187aa306fd', 'request_id': 'req-60d68d08-f5fc-4bf2-bd6e-0f8890660167'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:30.814779 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-60d68d08-f5fc-4bf2-bd6e-0f8890660167 admin admin] The token cache is being invalidate because project 9530130966df4740ab9a41187aa306fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:30.815472 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-60d68d08-f5fc-4bf2-bd6e-0f8890660167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:30.816503 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-60d68d08-f5fc-4bf2-bd6e-0f8890660167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:30.818283 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1062/2114] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:30 2022] DELETE /identity/v3/projects/9530130966df4740ab9a41187aa306fd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:30.826983 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3d003-bb4e-4d83-85f9-4a511c091e33 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:30.839427 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3d003-bb4e-4d83-85f9-4a511c091e33 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:30.912822 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cbf7b-56de-4465-9e1c-1c4435962b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:30.913626 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cbf7b-56de-4465-9e1c-1c4435962b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:30.913901 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cbf7b-56de-4465-9e1c-1c4435962b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:30.914363 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cbf7b-56de-4465-9e1c-1c4435962b27 admin admin] PATH_INFO: `/v3/users/4c40181bc5574da7a0d0b698b2c0c308` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:30.915782 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cbf7b-56de-4465-9e1c-1c4435962b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c40181bc5574da7a0d0b698b2c0c308)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:30.917748 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cbf7b-56de-4465-9e1c-1c4435962b27 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:30.980733 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b73cbf7b-56de-4465-9e1c-1c4435962b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c40181bc5574da7a0d0b698b2c0c308'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:30.989350 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b73cbf7b-56de-4465-9e1c-1c4435962b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c40181bc5574da7a0d0b698b2c0c308'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:31.006032 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b73cbf7b-56de-4465-9e1c-1c4435962b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c40181bc5574da7a0d0b698b2c0c308'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:31.006795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b73cbf7b-56de-4465-9e1c-1c4435962b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c40181bc5574da7a0d0b698b2c0c308'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:31.007432 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b73cbf7b-56de-4465-9e1c-1c4435962b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c40181bc5574da7a0d0b698b2c0c308'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:31.030123 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1053/2115] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:30 2022] DELETE /identity/v3/users/4c40181bc5574da7a0d0b698b2c0c308 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:31.492147 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d68d08-f5fc-4bf2-bd6e-0f8890660167 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:31.493850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-60d68d08-f5fc-4bf2-bd6e-0f8890660167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:31.500290 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cbf7b-56de-4465-9e1c-1c4435962b27 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:31.503132 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b73cbf7b-56de-4465-9e1c-1c4435962b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:31.510532 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d68d08-f5fc-4bf2-bd6e-0f8890660167 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:31.577846 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a33f0c-d111-4052-8bd6-c91f64a6214a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:31.579384 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a33f0c-d111-4052-8bd6-c91f64a6214a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:31.579384 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a33f0c-d111-4052-8bd6-c91f64a6214a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:31.579384 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a33f0c-d111-4052-8bd6-c91f64a6214a admin admin] PATH_INFO: `/v3/users/5cdfdeae35e84a719111d77bb9488d80` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:31.581387 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a33f0c-d111-4052-8bd6-c91f64a6214a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cdfdeae35e84a719111d77bb9488d80)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:31.583327 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a33f0c-d111-4052-8bd6-c91f64a6214a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:31.621979 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cbf7b-56de-4465-9e1c-1c4435962b27 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:31.630868 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf9876-0a59-4168-b477-ec6b5b7b5ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:31.631791 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf9876-0a59-4168-b477-ec6b5b7b5ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:31.632079 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf9876-0a59-4168-b477-ec6b5b7b5ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:31.632360 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf9876-0a59-4168-b477-ec6b5b7b5ca1 admin admin] PATH_INFO: `/v3/projects/35baaeb23a204ad593c0055a17a9c412` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:31.633820 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf9876-0a59-4168-b477-ec6b5b7b5ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35baaeb23a204ad593c0055a17a9c412)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:31.635873 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf9876-0a59-4168-b477-ec6b5b7b5ca1 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:31.640493 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e4a33f0c-d111-4052-8bd6-c91f64a6214a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cdfdeae35e84a719111d77bb9488d80'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:31.641661 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e4a33f0c-d111-4052-8bd6-c91f64a6214a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cdfdeae35e84a719111d77bb9488d80'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:31.650642 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e4a33f0c-d111-4052-8bd6-c91f64a6214a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cdfdeae35e84a719111d77bb9488d80'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:31.662231 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e4a33f0c-d111-4052-8bd6-c91f64a6214a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cdfdeae35e84a719111d77bb9488d80'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:31.678413 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e4a33f0c-d111-4052-8bd6-c91f64a6214a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cdfdeae35e84a719111d77bb9488d80'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:31.696128 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bedf9876-0a59-4168-b477-ec6b5b7b5ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35baaeb23a204ad593c0055a17a9c412', 'request_id': 'req-bedf9876-0a59-4168-b477-ec6b5b7b5ca1'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:31.708687 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bedf9876-0a59-4168-b477-ec6b5b7b5ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35baaeb23a204ad593c0055a17a9c412', 'request_id': 'req-bedf9876-0a59-4168-b477-ec6b5b7b5ca1'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:31.712654 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1063/2116] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:31 2022] DELETE /identity/v3/users/5cdfdeae35e84a719111d77bb9488d80 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:31.717051 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d2bae-7535-4a41-bdea-ba308aac3fa2 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:31.717361 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d2bae-7535-4a41-bdea-ba308aac3fa2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:31.717659 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d2bae-7535-4a41-bdea-ba308aac3fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:31.718135 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bedf9876-0a59-4168-b477-ec6b5b7b5ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35baaeb23a204ad593c0055a17a9c412', 'request_id': 'req-bedf9876-0a59-4168-b477-ec6b5b7b5ca1'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:31.736206 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bedf9876-0a59-4168-b477-ec6b5b7b5ca1 admin admin] The token cache is being invalidate because project 35baaeb23a204ad593c0055a17a9c412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:31.736754 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bedf9876-0a59-4168-b477-ec6b5b7b5ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:31.737627 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-bedf9876-0a59-4168-b477-ec6b5b7b5ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:31.742817 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1054/2117] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:31 2022] DELETE /identity/v3/projects/35baaeb23a204ad593c0055a17a9c412 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:31.744617 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec1b74-dbf4-4d44-9b6b-93143ffb0aa4 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:31.744617 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec1b74-dbf4-4d44-9b6b-93143ffb0aa4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:31.744889 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec1b74-dbf4-4d44-9b6b-93143ffb0aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:31.745112 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-fd4d2bae-7535-4a41-bdea-ba308aac3fa2 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:31.746464 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-fd4d2bae-7535-4a41-bdea-ba308aac3fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:31.766484 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-acec1b74-dbf4-4d44-9b6b-93143ffb0aa4 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:31.767975 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-acec1b74-dbf4-4d44-9b6b-93143ffb0aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:31.808939 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1064/2118] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:31.819550 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d2bae-7535-4a41-bdea-ba308aac3fa2 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:31.821210 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-fd4d2bae-7535-4a41-bdea-ba308aac3fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:31.831165 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1055/2119] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:31.838682 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b85c0-586a-4e93-8f6a-a9d9b7306a95 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:31.838974 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b85c0-586a-4e93-8f6a-a9d9b7306a95 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:31.839253 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b85c0-586a-4e93-8f6a-a9d9b7306a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:31.857893 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4a3b85c0-586a-4e93-8f6a-a9d9b7306a95 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:31.859103 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4a3b85c0-586a-4e93-8f6a-a9d9b7306a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:31.869831 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1056/2120] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:31.873819 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b85c0-586a-4e93-8f6a-a9d9b7306a95 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:31.880534 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d2bae-7535-4a41-bdea-ba308aac3fa2 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:31.883596 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b85c0-586a-4e93-8f6a-a9d9b7306a95 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:31.884391 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1de71-ed43-40e6-85d0-028a834c1e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:31.885051 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1de71-ed43-40e6-85d0-028a834c1e9b service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:31.885339 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1de71-ed43-40e6-85d0-028a834c1e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:31.885616 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1de71-ed43-40e6-85d0-028a834c1e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:31.888284 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d4e33-d674-4934-a683-f2c2fa4b4966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:31.888929 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d4e33-d674-4934-a683-f2c2fa4b4966 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:31.889210 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d4e33-d674-4934-a683-f2c2fa4b4966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:31.889484 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d4e33-d674-4934-a683-f2c2fa4b4966 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:31.890211 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d4e33-d674-4934-a683-f2c2fa4b4966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:31.890515 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d4e33-d674-4934-a683-f2c2fa4b4966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:31.892684 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d4e33-d674-4934-a683-f2c2fa4b4966 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:31.896171 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1de71-ed43-40e6-85d0-028a834c1e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:31.897609 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1de71-ed43-40e6-85d0-028a834c1e9b service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:31.903927 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1057/2121] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:56:31.907293 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1065/2122] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:56:31.910757 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d4e33-d674-4934-a683-f2c2fa4b4966 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:31.920674 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d4e33-d674-4934-a683-f2c2fa4b4966 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:31.926773 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84c084-0cc9-4fc6-acdd-7aa4f5913ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:31.927516 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84c084-0cc9-4fc6-acdd-7aa4f5913ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:31.927800 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84c084-0cc9-4fc6-acdd-7aa4f5913ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:31.928274 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84c084-0cc9-4fc6-acdd-7aa4f5913ba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:31.928945 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84c084-0cc9-4fc6-acdd-7aa4f5913ba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:31.931735 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84c084-0cc9-4fc6-acdd-7aa4f5913ba8 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:31.960903 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1058/2123] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:31 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:56:31.961785 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1de71-ed43-40e6-85d0-028a834c1e9b service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:31.973780 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1de71-ed43-40e6-85d0-028a834c1e9b service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:32.008316 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84c084-0cc9-4fc6-acdd-7aa4f5913ba8 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:32.010293 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6b84c084-0cc9-4fc6-acdd-7aa4f5913ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:32.052443 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48814c3d-5d2f-4705-aa0c-3ee2cff4befa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:32.053116 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48814c3d-5d2f-4705-aa0c-3ee2cff4befa admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:32.053867 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48814c3d-5d2f-4705-aa0c-3ee2cff4befa admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:32.054340 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48814c3d-5d2f-4705-aa0c-3ee2cff4befa admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:32.055343 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48814c3d-5d2f-4705-aa0c-3ee2cff4befa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:32.057568 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48814c3d-5d2f-4705-aa0c-3ee2cff4befa admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:32.093356 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1066/2124] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:31 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:32.094277 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48814c3d-5d2f-4705-aa0c-3ee2cff4befa admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:32.107041 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48814c3d-5d2f-4705-aa0c-3ee2cff4befa admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:32.108738 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84c084-0cc9-4fc6-acdd-7aa4f5913ba8 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:32.114182 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b9ac2-bd44-412d-83de-7a48032cd263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:32.114890 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b9ac2-bd44-412d-83de-7a48032cd263 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:32.115406 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b9ac2-bd44-412d-83de-7a48032cd263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:32.115912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b9ac2-bd44-412d-83de-7a48032cd263 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:32.117140 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b9ac2-bd44-412d-83de-7a48032cd263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:32.118781 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b9ac2-bd44-412d-83de-7a48032cd263 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:32.120219 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc1fd1-68ed-4d0c-9bb3-67c321e595dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:32.121147 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc1fd1-68ed-4d0c-9bb3-67c321e595dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:32.121938 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc1fd1-68ed-4d0c-9bb3-67c321e595dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:32.122244 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc1fd1-68ed-4d0c-9bb3-67c321e595dd admin admin] PATH_INFO: `/v3/users/6b10dd2bce99432abf55a8d348cf1ad9` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:32.129358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc1fd1-68ed-4d0c-9bb3-67c321e595dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b10dd2bce99432abf55a8d348cf1ad9)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:32.134689 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1067/2125] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:32.135877 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc1fd1-68ed-4d0c-9bb3-67c321e595dd admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:32.136307 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b9ac2-bd44-412d-83de-7a48032cd263 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:32.148995 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b9ac2-bd44-412d-83de-7a48032cd263 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:32.155052 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc04953-c9f4-48de-971f-57d437ce94fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:32.155930 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc04953-c9f4-48de-971f-57d437ce94fc admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:32.156285 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc04953-c9f4-48de-971f-57d437ce94fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:32.156628 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc04953-c9f4-48de-971f-57d437ce94fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:32.157631 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc04953-c9f4-48de-971f-57d437ce94fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:32.159587 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc04953-c9f4-48de-971f-57d437ce94fc admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:32.174787 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1068/2126] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:56:32.179912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc04953-c9f4-48de-971f-57d437ce94fc admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:32.192207 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc04953-c9f4-48de-971f-57d437ce94fc admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:32.197699 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9d45c-14ef-48a8-a330-a327b2c19b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:32.198669 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9d45c-14ef-48a8-a330-a327b2c19b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:32.199026 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9d45c-14ef-48a8-a330-a327b2c19b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:32.199395 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9d45c-14ef-48a8-a330-a327b2c19b84 admin admin] PATH_INFO: `/v3/projects/d7e752476c474502b5d5c702859f7ed6/users/4ec3413ad8f44193bc5c749e0904af12/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:32.223016 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1ddc1fd1-68ed-4d0c-9bb3-67c321e595dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b10dd2bce99432abf55a8d348cf1ad9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:32.226393 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9d45c-14ef-48a8-a330-a327b2c19b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e752476c474502b5d5c702859f7ed6, user_id=4ec3413ad8f44193bc5c749e0904af12, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:32.229504 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9d45c-14ef-48a8-a330-a327b2c19b84 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:32.232708 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1ddc1fd1-68ed-4d0c-9bb3-67c321e595dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b10dd2bce99432abf55a8d348cf1ad9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:32.246433 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1069/2127] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:32 2022] PUT /identity/v3/projects/d7e752476c474502b5d5c702859f7ed6/users/4ec3413ad8f44193bc5c749e0904af12/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:32.247753 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9d45c-14ef-48a8-a330-a327b2c19b84 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:32.249540 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a3d9d45c-14ef-48a8-a330-a327b2c19b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:32.259264 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1ddc1fd1-68ed-4d0c-9bb3-67c321e595dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b10dd2bce99432abf55a8d348cf1ad9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:32.260012 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1ddc1fd1-68ed-4d0c-9bb3-67c321e595dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b10dd2bce99432abf55a8d348cf1ad9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:32.260773 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1ddc1fd1-68ed-4d0c-9bb3-67c321e595dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b10dd2bce99432abf55a8d348cf1ad9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:32.279257 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1059/2128] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:32 2022] DELETE /identity/v3/users/6b10dd2bce99432abf55a8d348cf1ad9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:32.280998 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29cecd-b6f5-438d-b620-ad64c78f947a None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:32.281281 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29cecd-b6f5-438d-b620-ad64c78f947a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:32.281555 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29cecd-b6f5-438d-b620-ad64c78f947a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:32.311619 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-df29cecd-b6f5-438d-b620-ad64c78f947a None None] MFA Rules not processed for user `4ec3413ad8f44193bc5c749e0904af12`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:32.312877 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-df29cecd-b6f5-438d-b620-ad64c78f947a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:32.323006 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9d45c-14ef-48a8-a330-a327b2c19b84 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:32.382041 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1060/2129] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:32.383362 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29cecd-b6f5-438d-b620-ad64c78f947a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:32.384933 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-df29cecd-b6f5-438d-b620-ad64c78f947a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:32.408096 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62281c-d67a-4834-bdb5-8a9d14e41f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:32.409182 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62281c-d67a-4834-bdb5-8a9d14e41f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:32.409466 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62281c-d67a-4834-bdb5-8a9d14e41f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:32.409739 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62281c-d67a-4834-bdb5-8a9d14e41f9b admin admin] PATH_INFO: `/v3/projects/c5af82040fc442d5af58796feb36a041` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:32.410970 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62281c-d67a-4834-bdb5-8a9d14e41f9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5af82040fc442d5af58796feb36a041)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:32.412954 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62281c-d67a-4834-bdb5-8a9d14e41f9b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:32.444848 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29cecd-b6f5-438d-b620-ad64c78f947a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:32.449857 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301374f-ea60-456c-b724-6c048a147752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:32.450618 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301374f-ea60-456c-b724-6c048a147752 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:32.450975 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301374f-ea60-456c-b724-6c048a147752 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:32.451328 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301374f-ea60-456c-b724-6c048a147752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:32.453495 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c301374f-ea60-456c-b724-6c048a147752 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:32.473219 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9f62281c-d67a-4834-bdb5-8a9d14e41f9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5af82040fc442d5af58796feb36a041', 'request_id': 'req-9f62281c-d67a-4834-bdb5-8a9d14e41f9b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:32.482807 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9f62281c-d67a-4834-bdb5-8a9d14e41f9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5af82040fc442d5af58796feb36a041', 'request_id': 'req-9f62281c-d67a-4834-bdb5-8a9d14e41f9b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:32.488600 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9f62281c-d67a-4834-bdb5-8a9d14e41f9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5af82040fc442d5af58796feb36a041', 'request_id': 'req-9f62281c-d67a-4834-bdb5-8a9d14e41f9b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:32.503585 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9f62281c-d67a-4834-bdb5-8a9d14e41f9b admin admin] The token cache is being invalidate because project c5af82040fc442d5af58796feb36a041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:32.504022 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9f62281c-d67a-4834-bdb5-8a9d14e41f9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:32.504849 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-9f62281c-d67a-4834-bdb5-8a9d14e41f9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:32.506681 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1070/2130] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:32 2022] DELETE /identity/v3/projects/c5af82040fc442d5af58796feb36a041 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:32.507486 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62281c-d67a-4834-bdb5-8a9d14e41f9b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:32.509060 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9f62281c-d67a-4834-bdb5-8a9d14e41f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:32.523003 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301374f-ea60-456c-b724-6c048a147752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:32.524493 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301374f-ea60-456c-b724-6c048a147752 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:32.533663 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1061/2131] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:32.534477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301374f-ea60-456c-b724-6c048a147752 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:32.535924 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c301374f-ea60-456c-b724-6c048a147752 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:32.550770 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301374f-ea60-456c-b724-6c048a147752 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:32.576964 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62281c-d67a-4834-bdb5-8a9d14e41f9b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:32.583238 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa791ad-e41e-4286-8ae9-c47d9df81ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:32.584193 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa791ad-e41e-4286-8ae9-c47d9df81ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:32.584547 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa791ad-e41e-4286-8ae9-c47d9df81ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:32.584900 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa791ad-e41e-4286-8ae9-c47d9df81ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:32.586190 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa791ad-e41e-4286-8ae9-c47d9df81ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:32.588890 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa791ad-e41e-4286-8ae9-c47d9df81ad2 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:32.616674 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270163b-e44a-4ab1-9797-ccb401781cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:32.616890 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1071/2132] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:32 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:32.616987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270163b-e44a-4ab1-9797-ccb401781cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:32.616987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270163b-e44a-4ab1-9797-ccb401781cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:32.617239 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa791ad-e41e-4286-8ae9-c47d9df81ad2 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:32.617337 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270163b-e44a-4ab1-9797-ccb401781cf9 admin admin] PATH_INFO: `/v3/projects/93aa1a74c2fc48ce81fde5490e3604bf` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:32.617337 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270163b-e44a-4ab1-9797-ccb401781cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93aa1a74c2fc48ce81fde5490e3604bf)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:32.617488 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1fa791ad-e41e-4286-8ae9-c47d9df81ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:32.618423 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270163b-e44a-4ab1-9797-ccb401781cf9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:32.674732 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b270163b-e44a-4ab1-9797-ccb401781cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93aa1a74c2fc48ce81fde5490e3604bf', 'request_id': 'req-b270163b-e44a-4ab1-9797-ccb401781cf9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:32.683458 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b270163b-e44a-4ab1-9797-ccb401781cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93aa1a74c2fc48ce81fde5490e3604bf', 'request_id': 'req-b270163b-e44a-4ab1-9797-ccb401781cf9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:32.686091 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa791ad-e41e-4286-8ae9-c47d9df81ad2 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:32.692472 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b270163b-e44a-4ab1-9797-ccb401781cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93aa1a74c2fc48ce81fde5490e3604bf', 'request_id': 'req-b270163b-e44a-4ab1-9797-ccb401781cf9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:32.704889 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b270163b-e44a-4ab1-9797-ccb401781cf9 admin admin] The token cache is being invalidate because project 93aa1a74c2fc48ce81fde5490e3604bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:32.705097 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b270163b-e44a-4ab1-9797-ccb401781cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:32.705830 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b270163b-e44a-4ab1-9797-ccb401781cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:32.707622 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1062/2133] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:32 2022] DELETE /identity/v3/projects/93aa1a74c2fc48ce81fde5490e3604bf => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:32.708502 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270163b-e44a-4ab1-9797-ccb401781cf9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:32.709699 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b270163b-e44a-4ab1-9797-ccb401781cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:32.749638 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92dccd9-f54e-4c0d-95e3-32adcd9833da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:32.750756 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dccd9-f54e-4c0d-95e3-32adcd9833da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:32.751328 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dccd9-f54e-4c0d-95e3-32adcd9833da admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:32.752509 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dccd9-f54e-4c0d-95e3-32adcd9833da admin admin] PATH_INFO: `/v3/users/05b844e06ea84d3b89733f25440d623c` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:32.753984 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92dccd9-f54e-4c0d-95e3-32adcd9833da admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b844e06ea84d3b89733f25440d623c)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:32.757454 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92dccd9-f54e-4c0d-95e3-32adcd9833da admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:32.793753 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270163b-e44a-4ab1-9797-ccb401781cf9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:32.803600 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351979e3-4532-4faf-a704-785180423663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:32.805850 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351979e3-4532-4faf-a704-785180423663 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:32.807894 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351979e3-4532-4faf-a704-785180423663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:32.808283 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351979e3-4532-4faf-a704-785180423663 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:32.811932 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351979e3-4532-4faf-a704-785180423663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:32.825213 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f92dccd9-f54e-4c0d-95e3-32adcd9833da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b844e06ea84d3b89733f25440d623c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:32.825529 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351979e3-4532-4faf-a704-785180423663 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:32.825631 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f92dccd9-f54e-4c0d-95e3-32adcd9833da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b844e06ea84d3b89733f25440d623c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:32.827583 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f92dccd9-f54e-4c0d-95e3-32adcd9833da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b844e06ea84d3b89733f25440d623c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:32.837932 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f92dccd9-f54e-4c0d-95e3-32adcd9833da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b844e06ea84d3b89733f25440d623c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:32.838571 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f92dccd9-f54e-4c0d-95e3-32adcd9833da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b844e06ea84d3b89733f25440d623c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:32.848257 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1063/2134] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:32 2022] POST /identity/v3/users => generated 301 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:32.848257 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07057943-1989-4369-8f62-f7d1efd573f2 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:32.848257 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07057943-1989-4369-8f62-f7d1efd573f2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:32.848257 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07057943-1989-4369-8f62-f7d1efd573f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:32.858830 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1072/2135] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:32 2022] DELETE /identity/v3/users/05b844e06ea84d3b89733f25440d623c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:32.859858 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92dccd9-f54e-4c0d-95e3-32adcd9833da admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:32.862823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f92dccd9-f54e-4c0d-95e3-32adcd9833da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:32.871016 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-07057943-1989-4369-8f62-f7d1efd573f2 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:32.872621 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-07057943-1989-4369-8f62-f7d1efd573f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:32.972297 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1064/2136] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:32.974884 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd8ea4-0083-4017-a176-7a46003491fc None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:32.975011 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92dccd9-f54e-4c0d-95e3-32adcd9833da admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:32.975178 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd8ea4-0083-4017-a176-7a46003491fc None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:32.975452 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd8ea4-0083-4017-a176-7a46003491fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:32.980462 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f041ff-3f38-46c0-b32b-eed47e2741a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:32.981176 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f041ff-3f38-46c0-b32b-eed47e2741a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:32.981489 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f041ff-3f38-46c0-b32b-eed47e2741a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:32.981768 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f041ff-3f38-46c0-b32b-eed47e2741a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:32.982545 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f041ff-3f38-46c0-b32b-eed47e2741a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:32.984595 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f041ff-3f38-46c0-b32b-eed47e2741a8 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:32.997611 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1073/2137] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:33.001614 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f041ff-3f38-46c0-b32b-eed47e2741a8 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:33.003334 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-bdfd8ea4-0083-4017-a176-7a46003491fc None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:33.004564 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-bdfd8ea4-0083-4017-a176-7a46003491fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:33.012825 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f041ff-3f38-46c0-b32b-eed47e2741a8 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:33.012998 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1065/2138] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:33.017573 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd8ea4-0083-4017-a176-7a46003491fc None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:33.019122 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fb9f0-7090-4325-8796-f56fd94c72f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:33.019994 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fb9f0-7090-4325-8796-f56fd94c72f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.020304 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fb9f0-7090-4325-8796-f56fd94c72f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.021172 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fb9f0-7090-4325-8796-f56fd94c72f4 admin admin] PATH_INFO: `/v3/projects/3591c6311b8b48e8aa443eb756a4c88e/users/325271be4aae4837b1d95dddc04c0cb6/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.028116 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd8ea4-0083-4017-a176-7a46003491fc None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:33.033907 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4cba7-e08a-419d-a613-a95e359d5d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:33.034829 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4cba7-e08a-419d-a613-a95e359d5d18 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.035155 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4cba7-e08a-419d-a613-a95e359d5d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.035446 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4cba7-e08a-419d-a613-a95e359d5d18 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.036250 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4cba7-e08a-419d-a613-a95e359d5d18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:33.036602 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4cba7-e08a-419d-a613-a95e359d5d18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:33.038610 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4cba7-e08a-419d-a613-a95e359d5d18 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:33.042630 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fb9f0-7090-4325-8796-f56fd94c72f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3591c6311b8b48e8aa443eb756a4c88e, user_id=325271be4aae4837b1d95dddc04c0cb6, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:33.052676 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fb9f0-7090-4325-8796-f56fd94c72f4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:33.054885 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1066/2139] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:56:33.058901 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4cba7-e08a-419d-a613-a95e359d5d18 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:33.070584 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4cba7-e08a-419d-a613-a95e359d5d18 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:33.076179 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1074/2140] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:33 2022] PUT /identity/v3/projects/3591c6311b8b48e8aa443eb756a4c88e/users/325271be4aae4837b1d95dddc04c0cb6/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:33.080735 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fb9f0-7090-4325-8796-f56fd94c72f4 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:33.152075 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f301d1-0938-428e-8b49-487d8103ecb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:33.152753 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f301d1-0938-428e-8b49-487d8103ecb0 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.153035 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f301d1-0938-428e-8b49-487d8103ecb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.153318 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f301d1-0938-428e-8b49-487d8103ecb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.154018 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f301d1-0938-428e-8b49-487d8103ecb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:33.156091 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f301d1-0938-428e-8b49-487d8103ecb0 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:33.177725 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fb9f0-7090-4325-8796-f56fd94c72f4 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:33.183220 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf40401-69d4-49c1-9d21-cd0e6f88270e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:33.183933 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf40401-69d4-49c1-9d21-cd0e6f88270e admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.184223 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf40401-69d4-49c1-9d21-cd0e6f88270e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.184676 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf40401-69d4-49c1-9d21-cd0e6f88270e admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.185416 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf40401-69d4-49c1-9d21-cd0e6f88270e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:33.187145 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf40401-69d4-49c1-9d21-cd0e6f88270e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:33.193841 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1067/2141] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:33 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:33.195088 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f301d1-0938-428e-8b49-487d8103ecb0 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:33.205953 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1075/2142] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:33.205953 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf40401-69d4-49c1-9d21-cd0e6f88270e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:33.207081 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ddf40401-69d4-49c1-9d21-cd0e6f88270e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:33.271443 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f301d1-0938-428e-8b49-487d8103ecb0 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:33.277223 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763aeadc-815d-43b4-9bed-310fac531353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:33.277897 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aeadc-815d-43b4-9bed-310fac531353 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.278181 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aeadc-815d-43b4-9bed-310fac531353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.278454 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aeadc-815d-43b4-9bed-310fac531353 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.279156 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763aeadc-815d-43b4-9bed-310fac531353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:33.281127 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763aeadc-815d-43b4-9bed-310fac531353 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:33.283113 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf40401-69d4-49c1-9d21-cd0e6f88270e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:33.301746 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1068/2143] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:33 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:56:33.302550 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763aeadc-815d-43b4-9bed-310fac531353 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:33.311945 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763aeadc-815d-43b4-9bed-310fac531353 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:33.317356 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d5f69-26fa-4062-a9db-dfcef8038c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:33.318231 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d5f69-26fa-4062-a9db-dfcef8038c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.318514 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d5f69-26fa-4062-a9db-dfcef8038c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.318793 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d5f69-26fa-4062-a9db-dfcef8038c63 admin admin] PATH_INFO: `/v3/projects/3591c6311b8b48e8aa443eb756a4c88e/users/325271be4aae4837b1d95dddc04c0cb6/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.320825 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d5f69-26fa-4062-a9db-dfcef8038c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3591c6311b8b48e8aa443eb756a4c88e, user_id=325271be4aae4837b1d95dddc04c0cb6, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:33.323495 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d5f69-26fa-4062-a9db-dfcef8038c63 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:33.334490 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1069/2144] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:33 2022] PUT /identity/v3/projects/3591c6311b8b48e8aa443eb756a4c88e/users/325271be4aae4837b1d95dddc04c0cb6/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:33.335224 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d5f69-26fa-4062-a9db-dfcef8038c63 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:33.336882 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-158d5f69-26fa-4062-a9db-dfcef8038c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:33.337455 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c33bb2-a29b-4534-84c4-7d3170493fcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:33.338387 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c33bb2-a29b-4534-84c4-7d3170493fcd service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.338796 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c33bb2-a29b-4534-84c4-7d3170493fcd service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.339227 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c33bb2-a29b-4534-84c4-7d3170493fcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.341128 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f8c33bb2-a29b-4534-84c4-7d3170493fcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:33.400348 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d5f69-26fa-4062-a9db-dfcef8038c63 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:33.403947 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c33bb2-a29b-4534-84c4-7d3170493fcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:33.405137 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bc333-94f9-4511-b0c5-15aeda59c253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:33.405400 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c33bb2-a29b-4534-84c4-7d3170493fcd service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:33.406004 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bc333-94f9-4511-b0c5-15aeda59c253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.406288 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bc333-94f9-4511-b0c5-15aeda59c253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.406563 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bc333-94f9-4511-b0c5-15aeda59c253 admin admin] PATH_INFO: `/v3/projects/de5430a52da8464c91d815241dfab7dc` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.407826 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bc333-94f9-4511-b0c5-15aeda59c253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de5430a52da8464c91d815241dfab7dc)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:33.409955 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bc333-94f9-4511-b0c5-15aeda59c253 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:33.415306 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1076/2145] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:33.418022 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c33bb2-a29b-4534-84c4-7d3170493fcd service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:33.430346 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c33bb2-a29b-4534-84c4-7d3170493fcd service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:33.435237 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c833184-8f8b-46db-a185-60784a459949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:33.435937 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c833184-8f8b-46db-a185-60784a459949 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.436226 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c833184-8f8b-46db-a185-60784a459949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.436738 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c833184-8f8b-46db-a185-60784a459949 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.437476 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c833184-8f8b-46db-a185-60784a459949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:33.439685 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c833184-8f8b-46db-a185-60784a459949 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:33.450539 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1077/2146] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:33.452535 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26976a-80ab-4b68-a875-e37d69c58ab1 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.453085 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26976a-80ab-4b68-a875-e37d69c58ab1 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.453522 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26976a-80ab-4b68-a875-e37d69c58ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.460867 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d72bc333-94f9-4511-b0c5-15aeda59c253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de5430a52da8464c91d815241dfab7dc', 'request_id': 'req-d72bc333-94f9-4511-b0c5-15aeda59c253'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:33.469586 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d72bc333-94f9-4511-b0c5-15aeda59c253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de5430a52da8464c91d815241dfab7dc', 'request_id': 'req-d72bc333-94f9-4511-b0c5-15aeda59c253'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:33.479160 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d72bc333-94f9-4511-b0c5-15aeda59c253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de5430a52da8464c91d815241dfab7dc', 'request_id': 'req-d72bc333-94f9-4511-b0c5-15aeda59c253'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:33.484148 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-3b26976a-80ab-4b68-a875-e37d69c58ab1 None None] MFA Rules not processed for user `325271be4aae4837b1d95dddc04c0cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:33.486386 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3b26976a-80ab-4b68-a875-e37d69c58ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:33.491794 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d72bc333-94f9-4511-b0c5-15aeda59c253 admin admin] The token cache is being invalidate because project de5430a52da8464c91d815241dfab7dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:33.492192 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d72bc333-94f9-4511-b0c5-15aeda59c253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:33.493658 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d72bc333-94f9-4511-b0c5-15aeda59c253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:33.495375 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1070/2147] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:33 2022] DELETE /identity/v3/projects/de5430a52da8464c91d815241dfab7dc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:33.496304 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bc333-94f9-4511-b0c5-15aeda59c253 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:33.497702 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d72bc333-94f9-4511-b0c5-15aeda59c253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:33.559045 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1078/2148] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:33.560478 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857d3e5-5709-4405-9d73-2a748745e713 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.560766 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857d3e5-5709-4405-9d73-2a748745e713 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.561044 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857d3e5-5709-4405-9d73-2a748745e713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.566152 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bc333-94f9-4511-b0c5-15aeda59c253 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:33.572249 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b06905-500e-4ce5-9ad5-914719b02b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:33.573051 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b06905-500e-4ce5-9ad5-914719b02b8e admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.573392 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b06905-500e-4ce5-9ad5-914719b02b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.573721 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b06905-500e-4ce5-9ad5-914719b02b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.574556 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b06905-500e-4ce5-9ad5-914719b02b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:33.576242 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b06905-500e-4ce5-9ad5-914719b02b8e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:33.580704 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c857d3e5-5709-4405-9d73-2a748745e713 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:33.581901 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c857d3e5-5709-4405-9d73-2a748745e713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:33.589733 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1071/2149] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:33.589733 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b06905-500e-4ce5-9ad5-914719b02b8e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:33.589733 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c1b06905-500e-4ce5-9ad5-914719b02b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:33.592550 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1079/2150] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:33.593708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857d3e5-5709-4405-9d73-2a748745e713 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:33.604340 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857d3e5-5709-4405-9d73-2a748745e713 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:33.609245 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7357be8-ef29-4fac-a70e-b89a66376821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:33.610125 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7357be8-ef29-4fac-a70e-b89a66376821 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.610541 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7357be8-ef29-4fac-a70e-b89a66376821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.611370 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7357be8-ef29-4fac-a70e-b89a66376821 admin admin] PATH_INFO: `/v3/projects/f8720d1d0e26443d96a5f29175402af6/users/1bcde529b708471eb9c1b74e15b588b7/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.627148 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7357be8-ef29-4fac-a70e-b89a66376821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8720d1d0e26443d96a5f29175402af6, user_id=1bcde529b708471eb9c1b74e15b588b7, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:33.630611 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7357be8-ef29-4fac-a70e-b89a66376821 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:33.643475 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1080/2151] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:33 2022] PUT /identity/v3/projects/f8720d1d0e26443d96a5f29175402af6/users/1bcde529b708471eb9c1b74e15b588b7/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:33.644909 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6180f60-135d-44c3-84ef-bc4988971b34 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.645780 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6180f60-135d-44c3-84ef-bc4988971b34 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.646012 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6180f60-135d-44c3-84ef-bc4988971b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.650371 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b06905-500e-4ce5-9ad5-914719b02b8e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:33.666805 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-f6180f60-135d-44c3-84ef-bc4988971b34 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:33.668037 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f6180f60-135d-44c3-84ef-bc4988971b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:33.702546 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d5216-c358-48da-905b-9df46fc1ca7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:33.703202 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d5216-c358-48da-905b-9df46fc1ca7a service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.703481 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d5216-c358-48da-905b-9df46fc1ca7a service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.703793 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d5216-c358-48da-905b-9df46fc1ca7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.727783 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1081/2152] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:33.732391 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95616d-8d17-4568-9ef7-9c1c34614399 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.732682 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95616d-8d17-4568-9ef7-9c1c34614399 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.732963 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95616d-8d17-4568-9ef7-9c1c34614399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.750109 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-6e95616d-8d17-4568-9ef7-9c1c34614399 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:33.751286 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6e95616d-8d17-4568-9ef7-9c1c34614399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:33.759543 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1082/2153] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:33.763463 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d5216-c358-48da-905b-9df46fc1ca7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:33.763577 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95616d-8d17-4568-9ef7-9c1c34614399 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:33.764623 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d5216-c358-48da-905b-9df46fc1ca7a service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:33.772743 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95616d-8d17-4568-9ef7-9c1c34614399 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:33.774990 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1072/2154] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:33.775950 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d5216-c358-48da-905b-9df46fc1ca7a service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:33.777376 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ffce8-ee30-4a03-8d0e-3c7a760ebd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:33.777638 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e96d5216-c358-48da-905b-9df46fc1ca7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:33.778206 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ffce8-ee30-4a03-8d0e-3c7a760ebd7b admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.778490 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ffce8-ee30-4a03-8d0e-3c7a760ebd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.778760 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ffce8-ee30-4a03-8d0e-3c7a760ebd7b admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.779599 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ffce8-ee30-4a03-8d0e-3c7a760ebd7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:33.779938 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ffce8-ee30-4a03-8d0e-3c7a760ebd7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:33.781518 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ffce8-ee30-4a03-8d0e-3c7a760ebd7b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:33.796365 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1083/2155] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:56:33.799539 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ffce8-ee30-4a03-8d0e-3c7a760ebd7b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:33.809254 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ffce8-ee30-4a03-8d0e-3c7a760ebd7b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:33.818281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4fc14-e4a3-41be-8b85-1f1bf653e618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:33.818953 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4fc14-e4a3-41be-8b85-1f1bf653e618 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.819239 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4fc14-e4a3-41be-8b85-1f1bf653e618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.819515 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4fc14-e4a3-41be-8b85-1f1bf653e618 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.820414 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4fc14-e4a3-41be-8b85-1f1bf653e618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:33.822154 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4fc14-e4a3-41be-8b85-1f1bf653e618 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:33.841487 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d5216-c358-48da-905b-9df46fc1ca7a service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:33.848892 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521e4ed-d2c5-40d9-a940-dfc062be1623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:33.849668 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521e4ed-d2c5-40d9-a940-dfc062be1623 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.849958 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521e4ed-d2c5-40d9-a940-dfc062be1623 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.850299 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521e4ed-d2c5-40d9-a940-dfc062be1623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.862844 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1084/2156] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:33 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:56:33.866665 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521e4ed-d2c5-40d9-a940-dfc062be1623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:33.866823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4fc14-e4a3-41be-8b85-1f1bf653e618 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:33.868414 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521e4ed-d2c5-40d9-a940-dfc062be1623 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:33.879680 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1073/2157] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:33.917569 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521e4ed-d2c5-40d9-a940-dfc062be1623 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:33.919124 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2521e4ed-d2c5-40d9-a940-dfc062be1623 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:33.933678 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521e4ed-d2c5-40d9-a940-dfc062be1623 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:33.939199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58a418-27aa-4140-9c52-5a27991174fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:33.939479 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4fc14-e4a3-41be-8b85-1f1bf653e618 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:33.940213 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58a418-27aa-4140-9c52-5a27991174fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.941252 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58a418-27aa-4140-9c52-5a27991174fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.941625 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58a418-27aa-4140-9c52-5a27991174fb admin admin] PATH_INFO: `/v3/users/4ec3413ad8f44193bc5c749e0904af12` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.943098 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58a418-27aa-4140-9c52-5a27991174fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ec3413ad8f44193bc5c749e0904af12)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:33.944419 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8af3c7-4018-45e2-bbd7-bcd67f732f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:33.945324 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8af3c7-4018-45e2-bbd7-bcd67f732f53 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.945444 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58a418-27aa-4140-9c52-5a27991174fb admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:33.945554 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8af3c7-4018-45e2-bbd7-bcd67f732f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.945897 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8af3c7-4018-45e2-bbd7-bcd67f732f53 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.946697 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8af3c7-4018-45e2-bbd7-bcd67f732f53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:33.948915 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8af3c7-4018-45e2-bbd7-bcd67f732f53 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:33.972043 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1085/2158] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:33 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:33.975965 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8af3c7-4018-45e2-bbd7-bcd67f732f53 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:33.986737 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8af3c7-4018-45e2-bbd7-bcd67f732f53 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:33.991958 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fa85c-5603-470e-b518-e618487a6396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:33.992627 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fa85c-5603-470e-b518-e618487a6396 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:33.992919 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fa85c-5603-470e-b518-e618487a6396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:33.993200 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fa85c-5603-470e-b518-e618487a6396 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:33.993982 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fa85c-5603-470e-b518-e618487a6396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:33.995581 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fa85c-5603-470e-b518-e618487a6396 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:33.996422 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ca58a418-27aa-4140-9c52-5a27991174fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ec3413ad8f44193bc5c749e0904af12'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:34.004307 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ca58a418-27aa-4140-9c52-5a27991174fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ec3413ad8f44193bc5c749e0904af12'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:34.007361 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1086/2159] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:56:34.011658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fa85c-5603-470e-b518-e618487a6396 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:34.016066 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ca58a418-27aa-4140-9c52-5a27991174fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ec3413ad8f44193bc5c749e0904af12'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:34.017126 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ca58a418-27aa-4140-9c52-5a27991174fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ec3413ad8f44193bc5c749e0904af12'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:34.018192 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ca58a418-27aa-4140-9c52-5a27991174fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ec3413ad8f44193bc5c749e0904af12'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:34.023809 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fa85c-5603-470e-b518-e618487a6396 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:34.028936 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54ccb4-acd2-4ef4-b440-880947d3d257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:34.029673 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54ccb4-acd2-4ef4-b440-880947d3d257 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:34.029992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54ccb4-acd2-4ef4-b440-880947d3d257 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:34.030270 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54ccb4-acd2-4ef4-b440-880947d3d257 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:34.031177 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54ccb4-acd2-4ef4-b440-880947d3d257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:34.033335 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54ccb4-acd2-4ef4-b440-880947d3d257 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:34.041706 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1074/2160] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:33 2022] DELETE /identity/v3/users/4ec3413ad8f44193bc5c749e0904af12 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:56:34.045957 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3168c-364d-48d6-92e3-01e011d6f194 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:34.050184 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1087/2161] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:34.050427 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3168c-364d-48d6-92e3-01e011d6f194 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:34.050427 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3168c-364d-48d6-92e3-01e011d6f194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:34.051579 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54ccb4-acd2-4ef4-b440-880947d3d257 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:34.053367 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-df54ccb4-acd2-4ef4-b440-880947d3d257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:34.066411 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4cd3168c-364d-48d6-92e3-01e011d6f194 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:34.067750 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4cd3168c-364d-48d6-92e3-01e011d6f194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:34.068148 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54ccb4-acd2-4ef4-b440-880947d3d257 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:34.133794 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb00156-753d-44d1-87c9-8e26e06eae6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:34.134945 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb00156-753d-44d1-87c9-8e26e06eae6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:34.135206 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb00156-753d-44d1-87c9-8e26e06eae6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:34.135513 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb00156-753d-44d1-87c9-8e26e06eae6b admin admin] PATH_INFO: `/v3/projects/36155df9b348437d83f3d5b8d1ee23e6/users/bacd465368044995aad32678aa0089b7/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:34.140463 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1075/2162] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:34.154045 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb00156-753d-44d1-87c9-8e26e06eae6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=36155df9b348437d83f3d5b8d1ee23e6, user_id=bacd465368044995aad32678aa0089b7, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:34.156285 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb00156-753d-44d1-87c9-8e26e06eae6b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:34.157930 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3168c-364d-48d6-92e3-01e011d6f194 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:34.160735 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4cd3168c-364d-48d6-92e3-01e011d6f194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:34.172997 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1088/2163] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:34 2022] PUT /identity/v3/projects/36155df9b348437d83f3d5b8d1ee23e6/users/bacd465368044995aad32678aa0089b7/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:34.184803 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259a905-6557-40b5-ba89-f101c07a0831 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:34.185258 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259a905-6557-40b5-ba89-f101c07a0831 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:34.185604 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259a905-6557-40b5-ba89-f101c07a0831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:34.214432 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-3259a905-6557-40b5-ba89-f101c07a0831 None None] MFA Rules not processed for user `bacd465368044995aad32678aa0089b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:34.215827 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3259a905-6557-40b5-ba89-f101c07a0831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:34.223093 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3168c-364d-48d6-92e3-01e011d6f194 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:34.277604 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ec982-ed53-4743-9bae-4eaaa00485a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:34.278783 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ec982-ed53-4743-9bae-4eaaa00485a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:34.279271 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ec982-ed53-4743-9bae-4eaaa00485a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:34.279773 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ec982-ed53-4743-9bae-4eaaa00485a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:34.283786 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1089/2164] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:34.287869 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259a905-6557-40b5-ba89-f101c07a0831 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:34.357125 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ec982-ed53-4743-9bae-4eaaa00485a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:34.357929 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259a905-6557-40b5-ba89-f101c07a0831 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:34.358587 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ec982-ed53-4743-9bae-4eaaa00485a8 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:34.363470 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e672d3-79d0-4bc6-a986-06bb98da5b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:34.364182 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e672d3-79d0-4bc6-a986-06bb98da5b06 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:34.364467 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e672d3-79d0-4bc6-a986-06bb98da5b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:34.364757 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e672d3-79d0-4bc6-a986-06bb98da5b06 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:34.365951 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e672d3-79d0-4bc6-a986-06bb98da5b06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:34.368482 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e672d3-79d0-4bc6-a986-06bb98da5b06 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:34.376762 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1076/2165] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:34.408694 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1090/2166] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:34 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:34.412931 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ec982-ed53-4743-9bae-4eaaa00485a8 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:34.426786 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ec982-ed53-4743-9bae-4eaaa00485a8 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:34.487723 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2de90b-8ada-48c7-bcd2-4faf4e42ddd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:34.488793 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2de90b-8ada-48c7-bcd2-4faf4e42ddd3 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:34.489254 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2de90b-8ada-48c7-bcd2-4faf4e42ddd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:34.489682 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2de90b-8ada-48c7-bcd2-4faf4e42ddd3 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:34.490747 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2de90b-8ada-48c7-bcd2-4faf4e42ddd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:34.492796 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2de90b-8ada-48c7-bcd2-4faf4e42ddd3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:34.516820 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1077/2167] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:34 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:34.518992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e672d3-79d0-4bc6-a986-06bb98da5b06 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:34.530850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e672d3-79d0-4bc6-a986-06bb98da5b06 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:34.537233 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7efffa-6cf9-46a3-8fad-70343876fd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:34.538092 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7efffa-6cf9-46a3-8fad-70343876fd5e admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:34.538528 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7efffa-6cf9-46a3-8fad-70343876fd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:34.538895 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7efffa-6cf9-46a3-8fad-70343876fd5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:34.539726 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7efffa-6cf9-46a3-8fad-70343876fd5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:34.541418 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7efffa-6cf9-46a3-8fad-70343876fd5e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:34.555440 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1091/2168] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:34.559937 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2de90b-8ada-48c7-bcd2-4faf4e42ddd3 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:34.571279 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2de90b-8ada-48c7-bcd2-4faf4e42ddd3 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:34.576215 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b2d0e-ee42-41c8-bef2-b45e1d949f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:34.577589 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b2d0e-ee42-41c8-bef2-b45e1d949f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:34.577589 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b2d0e-ee42-41c8-bef2-b45e1d949f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:34.577781 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b2d0e-ee42-41c8-bef2-b45e1d949f3d admin admin] PATH_INFO: `/v3/projects/5d8093e3f4a7474c86d70dc77934038e/users/1a0574ed075e418e8be1a58478a9a3c6/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:34.593812 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b2d0e-ee42-41c8-bef2-b45e1d949f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8093e3f4a7474c86d70dc77934038e, user_id=1a0574ed075e418e8be1a58478a9a3c6, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:34.596710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b2d0e-ee42-41c8-bef2-b45e1d949f3d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:34.615589 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1078/2169] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:34 2022] PUT /identity/v3/projects/5d8093e3f4a7474c86d70dc77934038e/users/1a0574ed075e418e8be1a58478a9a3c6/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:34.616917 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7efffa-6cf9-46a3-8fad-70343876fd5e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:34.627574 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7efffa-6cf9-46a3-8fad-70343876fd5e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:34.689646 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f249061-da24-49cb-9535-a6cff2da686b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:34.690404 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f249061-da24-49cb-9535-a6cff2da686b admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:34.690603 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f249061-da24-49cb-9535-a6cff2da686b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:34.690871 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f249061-da24-49cb-9535-a6cff2da686b admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:34.691597 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f249061-da24-49cb-9535-a6cff2da686b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:34.693216 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f249061-da24-49cb-9535-a6cff2da686b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:34.704225 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1092/2170] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:34.709573 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b2d0e-ee42-41c8-bef2-b45e1d949f3d admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:34.738170 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b2d0e-ee42-41c8-bef2-b45e1d949f3d admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:34.747854 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aaa632-2c9e-493e-aa3d-bf6b159142d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:34.748793 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aaa632-2c9e-493e-aa3d-bf6b159142d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:34.749059 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aaa632-2c9e-493e-aa3d-bf6b159142d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:34.749335 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aaa632-2c9e-493e-aa3d-bf6b159142d6 admin admin] PATH_INFO: `/v3/projects/5d8093e3f4a7474c86d70dc77934038e/users/1a0574ed075e418e8be1a58478a9a3c6/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:34.751569 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aaa632-2c9e-493e-aa3d-bf6b159142d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8093e3f4a7474c86d70dc77934038e, user_id=1a0574ed075e418e8be1a58478a9a3c6, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:34.754832 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aaa632-2c9e-493e-aa3d-bf6b159142d6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:34.768079 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1079/2171] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:34 2022] PUT /identity/v3/projects/5d8093e3f4a7474c86d70dc77934038e/users/1a0574ed075e418e8be1a58478a9a3c6/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:34.779074 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e47492-3473-48d7-9e6f-66d43a34ba0f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:34.779672 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e47492-3473-48d7-9e6f-66d43a34ba0f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:34.779889 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e47492-3473-48d7-9e6f-66d43a34ba0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:34.824377 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-88e47492-3473-48d7-9e6f-66d43a34ba0f None None] MFA Rules not processed for user `1a0574ed075e418e8be1a58478a9a3c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:34.826057 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-88e47492-3473-48d7-9e6f-66d43a34ba0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:34.922590 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1093/2172] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:34.935697 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aaa632-2c9e-493e-aa3d-bf6b159142d6 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:34.941053 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-92aaa632-2c9e-493e-aa3d-bf6b159142d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:34.961202 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e47492-3473-48d7-9e6f-66d43a34ba0f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:34.965884 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-88e47492-3473-48d7-9e6f-66d43a34ba0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:35.036229 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aaa632-2c9e-493e-aa3d-bf6b159142d6 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:35.042586 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef08f6-c455-4233-9082-46abd587adb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:35.043711 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef08f6-c455-4233-9082-46abd587adb2 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:35.044300 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef08f6-c455-4233-9082-46abd587adb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:35.044854 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef08f6-c455-4233-9082-46abd587adb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:35.052495 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e47492-3473-48d7-9e6f-66d43a34ba0f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:35.059123 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbf526-e4a8-4e11-a6f9-5ef0d193123f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:35.060864 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbf526-e4a8-4e11-a6f9-5ef0d193123f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:35.061310 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbf526-e4a8-4e11-a6f9-5ef0d193123f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:35.062010 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbf526-e4a8-4e11-a6f9-5ef0d193123f admin admin] PATH_INFO: `/v3/projects/d7e752476c474502b5d5c702859f7ed6` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:35.063766 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cbf526-e4a8-4e11-a6f9-5ef0d193123f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e752476c474502b5d5c702859f7ed6)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:35.067061 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cbf526-e4a8-4e11-a6f9-5ef0d193123f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:35.118589 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef08f6-c455-4233-9082-46abd587adb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:35.120457 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef08f6-c455-4233-9082-46abd587adb2 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:35.139673 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c0cbf526-e4a8-4e11-a6f9-5ef0d193123f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e752476c474502b5d5c702859f7ed6', 'request_id': 'req-c0cbf526-e4a8-4e11-a6f9-5ef0d193123f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:35.143946 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1080/2173] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:35.151119 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c0cbf526-e4a8-4e11-a6f9-5ef0d193123f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e752476c474502b5d5c702859f7ed6', 'request_id': 'req-c0cbf526-e4a8-4e11-a6f9-5ef0d193123f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:35.160499 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c0cbf526-e4a8-4e11-a6f9-5ef0d193123f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e752476c474502b5d5c702859f7ed6', 'request_id': 'req-c0cbf526-e4a8-4e11-a6f9-5ef0d193123f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:35.181760 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c0cbf526-e4a8-4e11-a6f9-5ef0d193123f admin admin] The token cache is being invalidate because project d7e752476c474502b5d5c702859f7ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:35.182146 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c0cbf526-e4a8-4e11-a6f9-5ef0d193123f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:35.182945 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c0cbf526-e4a8-4e11-a6f9-5ef0d193123f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:35.187906 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1094/2174] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:34 2022] DELETE /identity/v3/projects/d7e752476c474502b5d5c702859f7ed6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:35.191107 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef08f6-c455-4233-9082-46abd587adb2 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:35.204524 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef08f6-c455-4233-9082-46abd587adb2 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:35.309498 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f0aa7-7f53-46bd-894a-0e1ced945100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:35.310441 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f0aa7-7f53-46bd-894a-0e1ced945100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:35.310724 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f0aa7-7f53-46bd-894a-0e1ced945100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:35.310999 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f0aa7-7f53-46bd-894a-0e1ced945100 admin admin] PATH_INFO: `/v3/users/325271be4aae4837b1d95dddc04c0cb6` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:35.317039 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f0aa7-7f53-46bd-894a-0e1ced945100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=325271be4aae4837b1d95dddc04c0cb6)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:35.320620 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f0aa7-7f53-46bd-894a-0e1ced945100 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:35.406085 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1d9f0aa7-7f53-46bd-894a-0e1ced945100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325271be4aae4837b1d95dddc04c0cb6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:35.414777 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1d9f0aa7-7f53-46bd-894a-0e1ced945100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325271be4aae4837b1d95dddc04c0cb6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:35.426373 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1d9f0aa7-7f53-46bd-894a-0e1ced945100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325271be4aae4837b1d95dddc04c0cb6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:35.427060 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1d9f0aa7-7f53-46bd-894a-0e1ced945100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325271be4aae4837b1d95dddc04c0cb6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:35.435481 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1d9f0aa7-7f53-46bd-894a-0e1ced945100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325271be4aae4837b1d95dddc04c0cb6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:35.457968 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1081/2175] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:35 2022] DELETE /identity/v3/users/325271be4aae4837b1d95dddc04c0cb6 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:35.818346 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbf526-e4a8-4e11-a6f9-5ef0d193123f admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:35.820467 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c0cbf526-e4a8-4e11-a6f9-5ef0d193123f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:35.842984 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbf526-e4a8-4e11-a6f9-5ef0d193123f admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:35.912229 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a7681-c4a8-4e0c-b719-5d5d75054456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:35.913182 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a7681-c4a8-4e0c-b719-5d5d75054456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:35.913533 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a7681-c4a8-4e0c-b719-5d5d75054456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:35.913875 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a7681-c4a8-4e0c-b719-5d5d75054456 admin admin] PATH_INFO: `/v3/projects/3591c6311b8b48e8aa443eb756a4c88e` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:35.915276 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a7681-c4a8-4e0c-b719-5d5d75054456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3591c6311b8b48e8aa443eb756a4c88e)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:35.917664 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a7681-c4a8-4e0c-b719-5d5d75054456 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:36.213927 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-470a7681-c4a8-4e0c-b719-5d5d75054456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3591c6311b8b48e8aa443eb756a4c88e', 'request_id': 'req-470a7681-c4a8-4e0c-b719-5d5d75054456'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:36.221603 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-470a7681-c4a8-4e0c-b719-5d5d75054456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3591c6311b8b48e8aa443eb756a4c88e', 'request_id': 'req-470a7681-c4a8-4e0c-b719-5d5d75054456'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:36.231196 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-470a7681-c4a8-4e0c-b719-5d5d75054456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3591c6311b8b48e8aa443eb756a4c88e', 'request_id': 'req-470a7681-c4a8-4e0c-b719-5d5d75054456'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:36.252816 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-470a7681-c4a8-4e0c-b719-5d5d75054456 admin admin] The token cache is being invalidate because project 3591c6311b8b48e8aa443eb756a4c88e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:36.253111 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-470a7681-c4a8-4e0c-b719-5d5d75054456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:36.253773 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-470a7681-c4a8-4e0c-b719-5d5d75054456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:36.256525 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1095/2176] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:35 2022] DELETE /identity/v3/projects/3591c6311b8b48e8aa443eb756a4c88e => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:36.261724 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31564c8-e896-4c67-a9a7-85570df69bee None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:36.262161 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31564c8-e896-4c67-a9a7-85570df69bee None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:36.262312 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31564c8-e896-4c67-a9a7-85570df69bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:36.289905 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c31564c8-e896-4c67-a9a7-85570df69bee None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:36.291406 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c31564c8-e896-4c67-a9a7-85570df69bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:36.383506 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1082/2177] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:36.386403 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81381f94-1ed0-4818-b6a4-3add299d343f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:36.387032 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81381f94-1ed0-4818-b6a4-3add299d343f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:36.387558 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81381f94-1ed0-4818-b6a4-3add299d343f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:36.428694 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-81381f94-1ed0-4818-b6a4-3add299d343f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:36.429144 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-81381f94-1ed0-4818-b6a4-3add299d343f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:36.443853 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1096/2178] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:36.448247 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31564c8-e896-4c67-a9a7-85570df69bee None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:36.460017 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31564c8-e896-4c67-a9a7-85570df69bee None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:36.466021 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e568208-ca49-465d-a7df-fd2b480e400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:36.466758 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e568208-ca49-465d-a7df-fd2b480e400f admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:36.467181 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e568208-ca49-465d-a7df-fd2b480e400f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:36.467463 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e568208-ca49-465d-a7df-fd2b480e400f admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:36.468416 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e568208-ca49-465d-a7df-fd2b480e400f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:36.469003 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e568208-ca49-465d-a7df-fd2b480e400f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:36.470924 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e568208-ca49-465d-a7df-fd2b480e400f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:36.484813 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1083/2179] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:56:36.490131 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81381f94-1ed0-4818-b6a4-3add299d343f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:36.505175 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81381f94-1ed0-4818-b6a4-3add299d343f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:36.511351 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368600d-885c-4157-b8c6-dfc2957d7c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:36.512141 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368600d-885c-4157-b8c6-dfc2957d7c83 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:36.512530 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368600d-885c-4157-b8c6-dfc2957d7c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:36.512908 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368600d-885c-4157-b8c6-dfc2957d7c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:36.513740 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368600d-885c-4157-b8c6-dfc2957d7c83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:36.515808 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368600d-885c-4157-b8c6-dfc2957d7c83 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:36.565856 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1097/2180] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:36 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:36.570770 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e568208-ca49-465d-a7df-fd2b480e400f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:36.588775 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e568208-ca49-465d-a7df-fd2b480e400f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:36.717258 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5219a3-3fd1-444b-93a2-548d81adee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:36.718007 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5219a3-3fd1-444b-93a2-548d81adee2c admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:36.718261 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5219a3-3fd1-444b-93a2-548d81adee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:36.718647 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5219a3-3fd1-444b-93a2-548d81adee2c admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:36.719833 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5219a3-3fd1-444b-93a2-548d81adee2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:36.722274 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5219a3-3fd1-444b-93a2-548d81adee2c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:36.753572 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1084/2181] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:36 2022] POST /identity/v3/users => generated 291 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:36.754954 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368600d-885c-4157-b8c6-dfc2957d7c83 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:36.769583 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368600d-885c-4157-b8c6-dfc2957d7c83 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:36.777736 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c85c3-1333-472a-b6a0-de104a6c4344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:36.778428 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c85c3-1333-472a-b6a0-de104a6c4344 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:36.778709 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c85c3-1333-472a-b6a0-de104a6c4344 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:36.779089 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c85c3-1333-472a-b6a0-de104a6c4344 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:36.780575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c85c3-1333-472a-b6a0-de104a6c4344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:36.782341 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c85c3-1333-472a-b6a0-de104a6c4344 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:36.800838 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1098/2182] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:36.813630 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5219a3-3fd1-444b-93a2-548d81adee2c admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:36.844613 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5219a3-3fd1-444b-93a2-548d81adee2c admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:36.856990 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e363d-425e-449d-9672-97feff6cc7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:36.858070 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e363d-425e-449d-9672-97feff6cc7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:36.858530 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e363d-425e-449d-9672-97feff6cc7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:36.859676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e363d-425e-449d-9672-97feff6cc7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:36.862875 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e363d-425e-449d-9672-97feff6cc7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:36.865100 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e363d-425e-449d-9672-97feff6cc7c8 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:36.898194 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1085/2183] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:36.912109 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c85c3-1333-472a-b6a0-de104a6c4344 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:36.927102 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c85c3-1333-472a-b6a0-de104a6c4344 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:36.933564 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356f35d-c7c8-4bdb-b2ba-bfe3c744c249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:36.935424 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356f35d-c7c8-4bdb-b2ba-bfe3c744c249 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:36.935667 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356f35d-c7c8-4bdb-b2ba-bfe3c744c249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:36.936011 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356f35d-c7c8-4bdb-b2ba-bfe3c744c249 admin admin] PATH_INFO: `/v3/projects/907f81636eda4677a18c78a2d26a7448/users/8b50a0cee0734d79b2620ce97192fe55/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:36.968227 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356f35d-c7c8-4bdb-b2ba-bfe3c744c249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=907f81636eda4677a18c78a2d26a7448, user_id=8b50a0cee0734d79b2620ce97192fe55, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:36.976571 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356f35d-c7c8-4bdb-b2ba-bfe3c744c249 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:36.995665 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1099/2184] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:36 2022] PUT /identity/v3/projects/907f81636eda4677a18c78a2d26a7448/users/8b50a0cee0734d79b2620ce97192fe55/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:37.007209 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce94f1-432a-469e-be1d-c9504d5c4b2e None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:37.007742 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce94f1-432a-469e-be1d-c9504d5c4b2e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:37.008092 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce94f1-432a-469e-be1d-c9504d5c4b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:37.039569 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-32ce94f1-432a-469e-be1d-c9504d5c4b2e None None] MFA Rules not processed for user `8b50a0cee0734d79b2620ce97192fe55`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:37.041275 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-32ce94f1-432a-469e-be1d-c9504d5c4b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:37.119500 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1086/2185] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:37.124170 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356f35d-c7c8-4bdb-b2ba-bfe3c744c249 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:37.195644 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356f35d-c7c8-4bdb-b2ba-bfe3c744c249 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:37.200268 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e667ea-2e1c-435d-b5b7-e20c6051019f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:37.201094 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e667ea-2e1c-435d-b5b7-e20c6051019f admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:37.201383 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e667ea-2e1c-435d-b5b7-e20c6051019f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:37.201658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e667ea-2e1c-435d-b5b7-e20c6051019f admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:37.202348 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e667ea-2e1c-435d-b5b7-e20c6051019f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:37.204271 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e667ea-2e1c-435d-b5b7-e20c6051019f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:37.246622 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1100/2186] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:37 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:37.251542 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce94f1-432a-469e-be1d-c9504d5c4b2e None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:37.275352 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce94f1-432a-469e-be1d-c9504d5c4b2e None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:37.405882 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9f437-2507-46be-a9e2-848d1f4b15ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:37.406794 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9f437-2507-46be-a9e2-848d1f4b15ae admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:37.407084 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9f437-2507-46be-a9e2-848d1f4b15ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:37.407363 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9f437-2507-46be-a9e2-848d1f4b15ae admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:37.409434 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9f437-2507-46be-a9e2-848d1f4b15ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:37.412188 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9f437-2507-46be-a9e2-848d1f4b15ae admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:37.453550 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1087/2187] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:37 2022] POST /identity/v3/users => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:37.454039 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e667ea-2e1c-435d-b5b7-e20c6051019f admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:37.467979 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e667ea-2e1c-435d-b5b7-e20c6051019f admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:37.475049 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00056c-071c-40a4-99d3-46c9d71a0d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:37.476386 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00056c-071c-40a4-99d3-46c9d71a0d89 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:37.476858 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00056c-071c-40a4-99d3-46c9d71a0d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:37.477384 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00056c-071c-40a4-99d3-46c9d71a0d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:37.478590 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00056c-071c-40a4-99d3-46c9d71a0d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:37.480658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00056c-071c-40a4-99d3-46c9d71a0d89 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:37.494531 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1101/2188] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:56:37.506891 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9f437-2507-46be-a9e2-848d1f4b15ae admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:37.526382 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9f437-2507-46be-a9e2-848d1f4b15ae admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:37.532948 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b7c0c-83fe-469e-8a9d-eb6fab4265fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:37.534001 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b7c0c-83fe-469e-8a9d-eb6fab4265fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:37.534804 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b7c0c-83fe-469e-8a9d-eb6fab4265fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:37.543321 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b7c0c-83fe-469e-8a9d-eb6fab4265fe admin admin] PATH_INFO: `/v3/projects/4bae0604a8414561b18c1af715d3243c/users/88874f1413ec40be8a97e6581a78a564/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:37.572483 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b7c0c-83fe-469e-8a9d-eb6fab4265fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bae0604a8414561b18c1af715d3243c, user_id=88874f1413ec40be8a97e6581a78a564, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:37.575964 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b7c0c-83fe-469e-8a9d-eb6fab4265fe admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:37.591490 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1088/2189] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:37 2022] PUT /identity/v3/projects/4bae0604a8414561b18c1af715d3243c/users/88874f1413ec40be8a97e6581a78a564/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:37.595425 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00056c-071c-40a4-99d3-46c9d71a0d89 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:37.606281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00056c-071c-40a4-99d3-46c9d71a0d89 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:37.618595 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b7c0c-83fe-469e-8a9d-eb6fab4265fe admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:37.621457 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-af5b7c0c-83fe-469e-8a9d-eb6fab4265fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:37.709548 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b7c0c-83fe-469e-8a9d-eb6fab4265fe admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:37.721901 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f247b-238d-43df-a5b1-666db720c9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:37.723834 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f247b-238d-43df-a5b1-666db720c9b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:37.723834 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f247b-238d-43df-a5b1-666db720c9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:37.723834 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f247b-238d-43df-a5b1-666db720c9b6 admin admin] PATH_INFO: `/v3/users/1067a80de73b4a6b8066633a6ef32fc2` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:37.725808 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f247b-238d-43df-a5b1-666db720c9b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1067a80de73b4a6b8066633a6ef32fc2)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:37.728100 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f247b-238d-43df-a5b1-666db720c9b6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:37.736091 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66ec1f-b947-47b0-a210-10ae30c448a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:37.738428 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66ec1f-b947-47b0-a210-10ae30c448a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:37.738721 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66ec1f-b947-47b0-a210-10ae30c448a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:37.739148 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66ec1f-b947-47b0-a210-10ae30c448a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:37.739940 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66ec1f-b947-47b0-a210-10ae30c448a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:37.742903 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66ec1f-b947-47b0-a210-10ae30c448a7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:37.766926 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1102/2190] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:56:37.772029 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66ec1f-b947-47b0-a210-10ae30c448a7 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:37.777832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2a66ec1f-b947-47b0-a210-10ae30c448a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:37.808608 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66ec1f-b947-47b0-a210-10ae30c448a7 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:37.815957 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7d8f247b-238d-43df-a5b1-666db720c9b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1067a80de73b4a6b8066633a6ef32fc2'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:37.816845 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccdc4d-c621-40e9-b7e7-beefda3dbd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:37.817788 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccdc4d-c621-40e9-b7e7-beefda3dbd8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:37.818646 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccdc4d-c621-40e9-b7e7-beefda3dbd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:37.819252 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccdc4d-c621-40e9-b7e7-beefda3dbd8a admin admin] PATH_INFO: `/v3/users/7c83d35e769e4431b887cd91d0ba0717` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:37.820595 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccdc4d-c621-40e9-b7e7-beefda3dbd8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c83d35e769e4431b887cd91d0ba0717)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:37.823246 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccdc4d-c621-40e9-b7e7-beefda3dbd8a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:37.824087 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7d8f247b-238d-43df-a5b1-666db720c9b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1067a80de73b4a6b8066633a6ef32fc2'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:37.833831 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7d8f247b-238d-43df-a5b1-666db720c9b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1067a80de73b4a6b8066633a6ef32fc2'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:37.834581 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7d8f247b-238d-43df-a5b1-666db720c9b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1067a80de73b4a6b8066633a6ef32fc2'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:37.835312 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7d8f247b-238d-43df-a5b1-666db720c9b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1067a80de73b4a6b8066633a6ef32fc2'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:37.864500 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1089/2191] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:37 2022] DELETE /identity/v3/users/1067a80de73b4a6b8066633a6ef32fc2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:37.869837 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f247b-238d-43df-a5b1-666db720c9b6 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:37.872527 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7d8f247b-238d-43df-a5b1-666db720c9b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:37.901764 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-16ccdc4d-c621-40e9-b7e7-beefda3dbd8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c83d35e769e4431b887cd91d0ba0717'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:37.902811 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-16ccdc4d-c621-40e9-b7e7-beefda3dbd8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c83d35e769e4431b887cd91d0ba0717'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:37.931877 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-16ccdc4d-c621-40e9-b7e7-beefda3dbd8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c83d35e769e4431b887cd91d0ba0717'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:37.959220 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-16ccdc4d-c621-40e9-b7e7-beefda3dbd8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c83d35e769e4431b887cd91d0ba0717'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:37.961918 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-16ccdc4d-c621-40e9-b7e7-beefda3dbd8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c83d35e769e4431b887cd91d0ba0717'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:37.966428 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f247b-238d-43df-a5b1-666db720c9b6 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:37.971714 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8cfe5-5d47-4cf8-9719-8f399c04e037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:37.972937 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8cfe5-5d47-4cf8-9719-8f399c04e037 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:37.973219 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8cfe5-5d47-4cf8-9719-8f399c04e037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:37.973549 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8cfe5-5d47-4cf8-9719-8f399c04e037 admin admin] PATH_INFO: `/v3/projects/4bae0604a8414561b18c1af715d3243c/users/88874f1413ec40be8a97e6581a78a564/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:37.975820 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8cfe5-5d47-4cf8-9719-8f399c04e037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bae0604a8414561b18c1af715d3243c, user_id=88874f1413ec40be8a97e6581a78a564, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:37.979505 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8cfe5-5d47-4cf8-9719-8f399c04e037 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:37.994381 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1090/2192] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:37 2022] PUT /identity/v3/projects/4bae0604a8414561b18c1af715d3243c/users/88874f1413ec40be8a97e6581a78a564/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:37.995985 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad13d00-63d1-414a-9df1-c48582fe160b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:37.996278 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad13d00-63d1-414a-9df1-c48582fe160b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:37.996744 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad13d00-63d1-414a-9df1-c48582fe160b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:38.007928 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1103/2193] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:37 2022] DELETE /identity/v3/users/7c83d35e769e4431b887cd91d0ba0717 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:38.009668 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c3133-e0e9-46a9-bc3c-61858aee5e49 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:38.010172 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c3133-e0e9-46a9-bc3c-61858aee5e49 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:38.010650 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c3133-e0e9-46a9-bc3c-61858aee5e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:38.032579 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-5ad13d00-63d1-414a-9df1-c48582fe160b None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:38.034956 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5ad13d00-63d1-414a-9df1-c48582fe160b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:38.090505 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-543c3133-e0e9-46a9-bc3c-61858aee5e49 None None] MFA Rules not processed for user `88874f1413ec40be8a97e6581a78a564`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:38.092107 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-543c3133-e0e9-46a9-bc3c-61858aee5e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:38.136119 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1091/2194] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:38.139835 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ea9b4-5bcd-4255-b91b-3adff1da7664 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:38.139835 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ea9b4-5bcd-4255-b91b-3adff1da7664 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:38.139835 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ea9b4-5bcd-4255-b91b-3adff1da7664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:38.179790 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ab3ea9b4-5bcd-4255-b91b-3adff1da7664 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:38.181019 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ab3ea9b4-5bcd-4255-b91b-3adff1da7664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:38.201195 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1092/2195] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:38.202365 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ea9b4-5bcd-4255-b91b-3adff1da7664 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:38.210584 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ab3ea9b4-5bcd-4255-b91b-3adff1da7664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:38.241455 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1104/2196] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:38.245650 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c3133-e0e9-46a9-bc3c-61858aee5e49 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:38.245650 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-543c3133-e0e9-46a9-bc3c-61858aee5e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:38.306450 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ea9b4-5bcd-4255-b91b-3adff1da7664 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:38.313401 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61332b-b1b5-44a8-9836-78a7a0eba796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:38.313987 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c3133-e0e9-46a9-bc3c-61858aee5e49 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:38.316002 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61332b-b1b5-44a8-9836-78a7a0eba796 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:38.316978 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61332b-b1b5-44a8-9836-78a7a0eba796 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:38.317584 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61332b-b1b5-44a8-9836-78a7a0eba796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:38.319051 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e5265-1b23-4340-b4eb-f410ddf10dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:38.320124 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e5265-1b23-4340-b4eb-f410ddf10dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:38.320417 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e5265-1b23-4340-b4eb-f410ddf10dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:38.321239 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e5265-1b23-4340-b4eb-f410ddf10dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:38.329806 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61332b-b1b5-44a8-9836-78a7a0eba796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:38.332615 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61332b-b1b5-44a8-9836-78a7a0eba796 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:38.333158 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e5265-1b23-4340-b4eb-f410ddf10dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:38.334587 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5e5265-1b23-4340-b4eb-f410ddf10dd6 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:38.346570 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1093/2198] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:38.346763 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1105/2198] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:38.347433 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e5265-1b23-4340-b4eb-f410ddf10dd6 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:38.349334 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ae5e5265-1b23-4340-b4eb-f410ddf10dd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:38.432295 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e5265-1b23-4340-b4eb-f410ddf10dd6 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:38.437696 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f105363-a4b3-4c43-8b68-e816a150bdc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:38.439239 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f105363-a4b3-4c43-8b68-e816a150bdc6 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:38.440489 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f105363-a4b3-4c43-8b68-e816a150bdc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:38.440944 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f105363-a4b3-4c43-8b68-e816a150bdc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:38.452106 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f105363-a4b3-4c43-8b68-e816a150bdc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:38.453905 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f105363-a4b3-4c43-8b68-e816a150bdc6 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:38.466735 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1106/2199] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:38.615548 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61332b-b1b5-44a8-9836-78a7a0eba796 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:38.628421 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61332b-b1b5-44a8-9836-78a7a0eba796 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:38.632570 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e323e-2c46-4faf-a0fb-cc5ad3011a32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:38.633396 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e323e-2c46-4faf-a0fb-cc5ad3011a32 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:38.633679 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e323e-2c46-4faf-a0fb-cc5ad3011a32 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:38.633951 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e323e-2c46-4faf-a0fb-cc5ad3011a32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:38.641489 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6f6e323e-2c46-4faf-a0fb-cc5ad3011a32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:38.746761 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e323e-2c46-4faf-a0fb-cc5ad3011a32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:38.752777 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e323e-2c46-4faf-a0fb-cc5ad3011a32 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:38.767423 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1094/2200] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:38.906962 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f105363-a4b3-4c43-8b68-e816a150bdc6 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:38.908847 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1f105363-a4b3-4c43-8b68-e816a150bdc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:38.953365 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f105363-a4b3-4c43-8b68-e816a150bdc6 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:38.961086 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951c207-754b-46ac-8c0b-c7db0765b495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:38.962770 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951c207-754b-46ac-8c0b-c7db0765b495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:38.963152 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951c207-754b-46ac-8c0b-c7db0765b495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:38.963695 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951c207-754b-46ac-8c0b-c7db0765b495 admin admin] PATH_INFO: `/v3/projects/49f34e81c61849e4a8881b1439acd42c` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:38.965776 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b951c207-754b-46ac-8c0b-c7db0765b495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49f34e81c61849e4a8881b1439acd42c)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:38.983484 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b951c207-754b-46ac-8c0b-c7db0765b495 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:39.071580 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e323e-2c46-4faf-a0fb-cc5ad3011a32 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:39.073602 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6f6e323e-2c46-4faf-a0fb-cc5ad3011a32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:39.122836 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e323e-2c46-4faf-a0fb-cc5ad3011a32 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:39.136804 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b951c207-754b-46ac-8c0b-c7db0765b495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49f34e81c61849e4a8881b1439acd42c', 'request_id': 'req-b951c207-754b-46ac-8c0b-c7db0765b495'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:39.149808 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b951c207-754b-46ac-8c0b-c7db0765b495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49f34e81c61849e4a8881b1439acd42c', 'request_id': 'req-b951c207-754b-46ac-8c0b-c7db0765b495'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:39.163291 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b951c207-754b-46ac-8c0b-c7db0765b495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49f34e81c61849e4a8881b1439acd42c', 'request_id': 'req-b951c207-754b-46ac-8c0b-c7db0765b495'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:39.213748 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b951c207-754b-46ac-8c0b-c7db0765b495 admin admin] The token cache is being invalidate because project 49f34e81c61849e4a8881b1439acd42c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:39.214071 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b951c207-754b-46ac-8c0b-c7db0765b495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:39.215383 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b951c207-754b-46ac-8c0b-c7db0765b495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:39.220845 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1107/2201] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:38 2022] DELETE /identity/v3/projects/49f34e81c61849e4a8881b1439acd42c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:39.223215 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86927a20-965e-4a60-a590-6cbc5274d166 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:39.224904 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86927a20-965e-4a60-a590-6cbc5274d166 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:39.227723 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86927a20-965e-4a60-a590-6cbc5274d166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:39.299516 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53323b88-3c49-4067-9bcd-742cb1cc2e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:39.299916 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-86927a20-965e-4a60-a590-6cbc5274d166 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:39.301476 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-86927a20-965e-4a60-a590-6cbc5274d166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:39.302017 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53323b88-3c49-4067-9bcd-742cb1cc2e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:39.302497 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53323b88-3c49-4067-9bcd-742cb1cc2e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:39.302969 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53323b88-3c49-4067-9bcd-742cb1cc2e31 admin admin] PATH_INFO: `/v3/projects/3245e9200dcb4694bef6b0c75c909d34` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:39.304714 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53323b88-3c49-4067-9bcd-742cb1cc2e31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3245e9200dcb4694bef6b0c75c909d34)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:39.307781 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53323b88-3c49-4067-9bcd-742cb1cc2e31 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:39.317685 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1108/2202] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:39.317685 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86927a20-965e-4a60-a590-6cbc5274d166 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:39.318742 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-86927a20-965e-4a60-a590-6cbc5274d166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:39.338091 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86927a20-965e-4a60-a590-6cbc5274d166 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:39.343319 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7c95d-8e2c-4c02-b449-6e0940584005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:39.344633 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7c95d-8e2c-4c02-b449-6e0940584005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:39.345622 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7c95d-8e2c-4c02-b449-6e0940584005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:39.345717 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7c95d-8e2c-4c02-b449-6e0940584005 admin admin] PATH_INFO: `/v3/users/8b50a0cee0734d79b2620ce97192fe55` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:39.347146 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7c95d-8e2c-4c02-b449-6e0940584005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b50a0cee0734d79b2620ce97192fe55)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:39.349670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7c95d-8e2c-4c02-b449-6e0940584005 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:39.386951 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-53323b88-3c49-4067-9bcd-742cb1cc2e31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3245e9200dcb4694bef6b0c75c909d34', 'request_id': 'req-53323b88-3c49-4067-9bcd-742cb1cc2e31'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:39.396236 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-53323b88-3c49-4067-9bcd-742cb1cc2e31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3245e9200dcb4694bef6b0c75c909d34', 'request_id': 'req-53323b88-3c49-4067-9bcd-742cb1cc2e31'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:39.409317 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-53323b88-3c49-4067-9bcd-742cb1cc2e31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3245e9200dcb4694bef6b0c75c909d34', 'request_id': 'req-53323b88-3c49-4067-9bcd-742cb1cc2e31'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:39.425620 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-53323b88-3c49-4067-9bcd-742cb1cc2e31 admin admin] The token cache is being invalidate because project 3245e9200dcb4694bef6b0c75c909d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:39.426028 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-53323b88-3c49-4067-9bcd-742cb1cc2e31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:39.426793 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-53323b88-3c49-4067-9bcd-742cb1cc2e31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:39.428640 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1095/2203] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:39 2022] DELETE /identity/v3/projects/3245e9200dcb4694bef6b0c75c909d34 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:39.431456 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6402df-61bb-4d6f-b5c8-84e7a1b5d9c3 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:39.431456 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6402df-61bb-4d6f-b5c8-84e7a1b5d9c3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:39.431456 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6402df-61bb-4d6f-b5c8-84e7a1b5d9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:39.431836 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-91c7c95d-8e2c-4c02-b449-6e0940584005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b50a0cee0734d79b2620ce97192fe55'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:39.432593 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-91c7c95d-8e2c-4c02-b449-6e0940584005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b50a0cee0734d79b2620ce97192fe55'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:39.446027 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-91c7c95d-8e2c-4c02-b449-6e0940584005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b50a0cee0734d79b2620ce97192fe55'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:39.457201 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ff6402df-61bb-4d6f-b5c8-84e7a1b5d9c3 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:39.459323 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ff6402df-61bb-4d6f-b5c8-84e7a1b5d9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:39.461197 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-91c7c95d-8e2c-4c02-b449-6e0940584005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b50a0cee0734d79b2620ce97192fe55'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:39.462119 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-91c7c95d-8e2c-4c02-b449-6e0940584005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b50a0cee0734d79b2620ce97192fe55'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:39.494533 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1109/2204] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:39 2022] DELETE /identity/v3/users/8b50a0cee0734d79b2620ce97192fe55 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:39.495609 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7c95d-8e2c-4c02-b449-6e0940584005 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:39.498208 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-91c7c95d-8e2c-4c02-b449-6e0940584005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:39.576544 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1096/2205] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:39.578597 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6079b3b-1a97-4dc1-ba41-71698f25c93d None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:39.579606 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6079b3b-1a97-4dc1-ba41-71698f25c93d None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:39.580030 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6079b3b-1a97-4dc1-ba41-71698f25c93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:39.609120 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-f6079b3b-1a97-4dc1-ba41-71698f25c93d None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:39.612688 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f6079b3b-1a97-4dc1-ba41-71698f25c93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:39.620701 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1097/2206] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:39.625032 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6079b3b-1a97-4dc1-ba41-71698f25c93d None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:39.635168 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7c95d-8e2c-4c02-b449-6e0940584005 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:39.640078 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6079b3b-1a97-4dc1-ba41-71698f25c93d None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:39.641828 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689fae4-3d08-466b-8f5e-b53fe29310ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:39.643080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689fae4-3d08-466b-8f5e-b53fe29310ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:39.643533 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689fae4-3d08-466b-8f5e-b53fe29310ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:39.643994 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689fae4-3d08-466b-8f5e-b53fe29310ef admin admin] PATH_INFO: `/v3/users/df09eb6be73147d494d066abb7ee5ffd` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:39.645108 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067276f0-7a15-4a98-b61e-b8033df2bb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:39.645811 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689fae4-3d08-466b-8f5e-b53fe29310ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=df09eb6be73147d494d066abb7ee5ffd)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:39.645932 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067276f0-7a15-4a98-b61e-b8033df2bb98 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:39.646237 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067276f0-7a15-4a98-b61e-b8033df2bb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:39.646574 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067276f0-7a15-4a98-b61e-b8033df2bb98 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:39.647379 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067276f0-7a15-4a98-b61e-b8033df2bb98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:39.647795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067276f0-7a15-4a98-b61e-b8033df2bb98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:39.649358 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689fae4-3d08-466b-8f5e-b53fe29310ef admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:39.649506 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067276f0-7a15-4a98-b61e-b8033df2bb98 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:39.662158 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1098/2207] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:56:39.666538 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067276f0-7a15-4a98-b61e-b8033df2bb98 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:39.668247 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-067276f0-7a15-4a98-b61e-b8033df2bb98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:39.739739 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c689fae4-3d08-466b-8f5e-b53fe29310ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df09eb6be73147d494d066abb7ee5ffd'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:39.740437 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c689fae4-3d08-466b-8f5e-b53fe29310ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df09eb6be73147d494d066abb7ee5ffd'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:39.754328 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c689fae4-3d08-466b-8f5e-b53fe29310ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df09eb6be73147d494d066abb7ee5ffd'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:39.760375 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067276f0-7a15-4a98-b61e-b8033df2bb98 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:39.766332 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b25dc2-72db-4ce6-ad45-52f2608659b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:39.767360 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b25dc2-72db-4ce6-ad45-52f2608659b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:39.767862 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b25dc2-72db-4ce6-ad45-52f2608659b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:39.768050 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b25dc2-72db-4ce6-ad45-52f2608659b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:39.769243 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c689fae4-3d08-466b-8f5e-b53fe29310ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df09eb6be73147d494d066abb7ee5ffd'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:39.770224 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c689fae4-3d08-466b-8f5e-b53fe29310ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df09eb6be73147d494d066abb7ee5ffd'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:39.779522 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b25dc2-72db-4ce6-ad45-52f2608659b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:39.781094 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b25dc2-72db-4ce6-ad45-52f2608659b6 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:39.794258 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1099/2209] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:39.795199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b25dc2-72db-4ce6-ad45-52f2608659b6 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:39.801599 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1110/2209] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:39 2022] DELETE /identity/v3/users/df09eb6be73147d494d066abb7ee5ffd => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:39.806468 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b25dc2-72db-4ce6-ad45-52f2608659b6 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:39.845616 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61925d-63a5-4e7b-9fad-36c7b481e261 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:39.845987 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61925d-63a5-4e7b-9fad-36c7b481e261 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:39.847355 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61925d-63a5-4e7b-9fad-36c7b481e261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:39.884507 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-9f61925d-63a5-4e7b-9fad-36c7b481e261 None None] MFA Rules not processed for user `1bcde529b708471eb9c1b74e15b588b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:39.885518 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9f61925d-63a5-4e7b-9fad-36c7b481e261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:39.930194 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a51324-72d6-4044-a457-7528381da438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:39.931853 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a51324-72d6-4044-a457-7528381da438 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:39.932917 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a51324-72d6-4044-a457-7528381da438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:39.933394 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a51324-72d6-4044-a457-7528381da438 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:39.934427 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a51324-72d6-4044-a457-7528381da438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:39.937518 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a51324-72d6-4044-a457-7528381da438 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:39.977978 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1100/2210] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:39 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:39.979385 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a51324-72d6-4044-a457-7528381da438 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:39.981587 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b7a51324-72d6-4044-a457-7528381da438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:39.985093 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1111/2211] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:39.997896 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61925d-63a5-4e7b-9fad-36c7b481e261 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:40.000326 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9f61925d-63a5-4e7b-9fad-36c7b481e261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:40.114775 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a51324-72d6-4044-a457-7528381da438 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:40.125289 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251c15a-4786-49c5-953f-0b3a00204381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:40.126178 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251c15a-4786-49c5-953f-0b3a00204381 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:40.126660 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251c15a-4786-49c5-953f-0b3a00204381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:40.127054 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251c15a-4786-49c5-953f-0b3a00204381 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:40.128171 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251c15a-4786-49c5-953f-0b3a00204381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:40.130513 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251c15a-4786-49c5-953f-0b3a00204381 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:40.164391 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1101/2212] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:39 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:40.164391 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251c15a-4786-49c5-953f-0b3a00204381 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:40.164391 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5251c15a-4786-49c5-953f-0b3a00204381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:40.180234 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61925d-63a5-4e7b-9fad-36c7b481e261 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:40.246816 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251c15a-4786-49c5-953f-0b3a00204381 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:40.251982 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308ebe8-0753-4a41-b9a2-947aad146877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:40.252657 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308ebe8-0753-4a41-b9a2-947aad146877 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:40.253118 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308ebe8-0753-4a41-b9a2-947aad146877 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:40.253404 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308ebe8-0753-4a41-b9a2-947aad146877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:40.255655 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d308ebe8-0753-4a41-b9a2-947aad146877 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:40.276370 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a4f54-24cb-42ba-8ee8-c286fbc668a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:40.277030 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a4f54-24cb-42ba-8ee8-c286fbc668a0 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:40.277313 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a4f54-24cb-42ba-8ee8-c286fbc668a0 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:40.277585 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a4f54-24cb-42ba-8ee8-c286fbc668a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:40.322854 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308ebe8-0753-4a41-b9a2-947aad146877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:40.324380 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308ebe8-0753-4a41-b9a2-947aad146877 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:40.334456 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1102/2213] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:40.335369 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308ebe8-0753-4a41-b9a2-947aad146877 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:40.335583 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a4f54-24cb-42ba-8ee8-c286fbc668a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:40.337247 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a4f54-24cb-42ba-8ee8-c286fbc668a0 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:40.345782 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308ebe8-0753-4a41-b9a2-947aad146877 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:40.347442 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1112/2214] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:40.348299 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a4f54-24cb-42ba-8ee8-c286fbc668a0 service nova] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:40.349781 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e77a4f54-24cb-42ba-8ee8-c286fbc668a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:40.350908 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a267554-85fe-4c3c-8352-a95849a74e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:40.351765 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a267554-85fe-4c3c-8352-a95849a74e53 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:40.352145 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a267554-85fe-4c3c-8352-a95849a74e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:40.352522 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a267554-85fe-4c3c-8352-a95849a74e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:40.353532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a267554-85fe-4c3c-8352-a95849a74e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:40.355175 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a267554-85fe-4c3c-8352-a95849a74e53 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:40.365463 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a4f54-24cb-42ba-8ee8-c286fbc668a0 service nova] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:40.366403 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1103/2215] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:40.367264 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a267554-85fe-4c3c-8352-a95849a74e53 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:40.369186 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4a267554-85fe-4c3c-8352-a95849a74e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:40.378382 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa870b-b7bc-4a85-bb11-54d6ad76c74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:40.379287 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa870b-b7bc-4a85-bb11-54d6ad76c74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:40.379737 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa870b-b7bc-4a85-bb11-54d6ad76c74f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:40.380020 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa870b-b7bc-4a85-bb11-54d6ad76c74f admin admin] PATH_INFO: `/v3/projects/7a13d56546e845fbbe16c2e4c3052fe8` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:40.384769 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa870b-b7bc-4a85-bb11-54d6ad76c74f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a13d56546e845fbbe16c2e4c3052fe8)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:40.387708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa870b-b7bc-4a85-bb11-54d6ad76c74f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:40.389716 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a267554-85fe-4c3c-8352-a95849a74e53 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:40.395474 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686de6d-3886-4e8b-845f-88cdaa5e026f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:40.396381 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686de6d-3886-4e8b-845f-88cdaa5e026f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:40.396677 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686de6d-3886-4e8b-845f-88cdaa5e026f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:40.396947 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686de6d-3886-4e8b-845f-88cdaa5e026f admin admin] PATH_INFO: `/v3/projects/907f81636eda4677a18c78a2d26a7448` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:40.398163 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686de6d-3886-4e8b-845f-88cdaa5e026f admin admin] RBAC: Authorizing `identity:delete_project(project_id=907f81636eda4677a18c78a2d26a7448)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:40.402075 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686de6d-3886-4e8b-845f-88cdaa5e026f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:40.450543 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d0fa870b-b7bc-4a85-bb11-54d6ad76c74f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a13d56546e845fbbe16c2e4c3052fe8', 'request_id': 'req-d0fa870b-b7bc-4a85-bb11-54d6ad76c74f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:40.459497 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d0fa870b-b7bc-4a85-bb11-54d6ad76c74f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a13d56546e845fbbe16c2e4c3052fe8', 'request_id': 'req-d0fa870b-b7bc-4a85-bb11-54d6ad76c74f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:40.468276 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d0fa870b-b7bc-4a85-bb11-54d6ad76c74f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a13d56546e845fbbe16c2e4c3052fe8', 'request_id': 'req-d0fa870b-b7bc-4a85-bb11-54d6ad76c74f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:40.468419 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-8686de6d-3886-4e8b-845f-88cdaa5e026f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '907f81636eda4677a18c78a2d26a7448', 'request_id': 'req-8686de6d-3886-4e8b-845f-88cdaa5e026f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:40.479361 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-8686de6d-3886-4e8b-845f-88cdaa5e026f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '907f81636eda4677a18c78a2d26a7448', 'request_id': 'req-8686de6d-3886-4e8b-845f-88cdaa5e026f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:40.488715 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-8686de6d-3886-4e8b-845f-88cdaa5e026f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '907f81636eda4677a18c78a2d26a7448', 'request_id': 'req-8686de6d-3886-4e8b-845f-88cdaa5e026f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:40.490166 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d0fa870b-b7bc-4a85-bb11-54d6ad76c74f admin admin] The token cache is being invalidate because project 7a13d56546e845fbbe16c2e4c3052fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:40.491429 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d0fa870b-b7bc-4a85-bb11-54d6ad76c74f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:40.492345 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d0fa870b-b7bc-4a85-bb11-54d6ad76c74f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:40.497504 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1113/2216] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:40 2022] DELETE /identity/v3/projects/7a13d56546e845fbbe16c2e4c3052fe8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:40.499290 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa870b-b7bc-4a85-bb11-54d6ad76c74f admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:40.502487 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d0fa870b-b7bc-4a85-bb11-54d6ad76c74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:40.507913 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-8686de6d-3886-4e8b-845f-88cdaa5e026f admin admin] The token cache is being invalidate because project 907f81636eda4677a18c78a2d26a7448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:40.507913 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-8686de6d-3886-4e8b-845f-88cdaa5e026f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:40.509112 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-8686de6d-3886-4e8b-845f-88cdaa5e026f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:40.511082 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1104/2217] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:40 2022] DELETE /identity/v3/projects/907f81636eda4677a18c78a2d26a7448 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:40.511698 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686de6d-3886-4e8b-845f-88cdaa5e026f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:40.513382 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-8686de6d-3886-4e8b-845f-88cdaa5e026f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:40.600978 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686de6d-3886-4e8b-845f-88cdaa5e026f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:40.604647 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa870b-b7bc-4a85-bb11-54d6ad76c74f admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:40.607358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84190553-cb20-4c27-bdfd-836663c92f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:40.608537 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84190553-cb20-4c27-bdfd-836663c92f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:40.609238 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84190553-cb20-4c27-bdfd-836663c92f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:40.609748 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84190553-cb20-4c27-bdfd-836663c92f32 admin admin] PATH_INFO: `/v3/users/db35fbb1b7b3442e9be21727c8276309` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:40.610563 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5fc56-16fa-4dd8-b550-d1f5631dfb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:40.611521 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5fc56-16fa-4dd8-b550-d1f5631dfb8c admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:40.611853 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5fc56-16fa-4dd8-b550-d1f5631dfb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:40.612247 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84190553-cb20-4c27-bdfd-836663c92f32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db35fbb1b7b3442e9be21727c8276309)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:40.612355 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5fc56-16fa-4dd8-b550-d1f5631dfb8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:40.613109 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5fc56-16fa-4dd8-b550-d1f5631dfb8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:40.614783 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84190553-cb20-4c27-bdfd-836663c92f32 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:40.614965 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5fc56-16fa-4dd8-b550-d1f5631dfb8c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:40.635674 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1114/2218] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:40.637615 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5fc56-16fa-4dd8-b550-d1f5631dfb8c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:40.643551 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5ae5fc56-16fa-4dd8-b550-d1f5631dfb8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:40.669220 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5fc56-16fa-4dd8-b550-d1f5631dfb8c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:40.682435 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47780b6a-955e-43e0-aa98-cab72f8ff1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:40.683384 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47780b6a-955e-43e0-aa98-cab72f8ff1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:40.683701 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47780b6a-955e-43e0-aa98-cab72f8ff1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:40.684001 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47780b6a-955e-43e0-aa98-cab72f8ff1d4 admin admin] PATH_INFO: `/v3/users/88874f1413ec40be8a97e6581a78a564` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:40.687700 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47780b6a-955e-43e0-aa98-cab72f8ff1d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88874f1413ec40be8a97e6581a78a564)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:40.694344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-84190553-cb20-4c27-bdfd-836663c92f32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db35fbb1b7b3442e9be21727c8276309'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:40.695932 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47780b6a-955e-43e0-aa98-cab72f8ff1d4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:40.707595 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-84190553-cb20-4c27-bdfd-836663c92f32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db35fbb1b7b3442e9be21727c8276309'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:40.722392 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-84190553-cb20-4c27-bdfd-836663c92f32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db35fbb1b7b3442e9be21727c8276309'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:40.723263 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-84190553-cb20-4c27-bdfd-836663c92f32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db35fbb1b7b3442e9be21727c8276309'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:40.724343 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-84190553-cb20-4c27-bdfd-836663c92f32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db35fbb1b7b3442e9be21727c8276309'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:40.757617 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1105/2219] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:40 2022] DELETE /identity/v3/users/db35fbb1b7b3442e9be21727c8276309 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:40.758393 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84190553-cb20-4c27-bdfd-836663c92f32 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:40.760055 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-84190553-cb20-4c27-bdfd-836663c92f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:40.813398 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-47780b6a-955e-43e0-aa98-cab72f8ff1d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88874f1413ec40be8a97e6581a78a564'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:40.815451 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-47780b6a-955e-43e0-aa98-cab72f8ff1d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88874f1413ec40be8a97e6581a78a564'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:40.824966 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-47780b6a-955e-43e0-aa98-cab72f8ff1d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88874f1413ec40be8a97e6581a78a564'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:40.840220 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-47780b6a-955e-43e0-aa98-cab72f8ff1d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88874f1413ec40be8a97e6581a78a564'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:40.841139 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-47780b6a-955e-43e0-aa98-cab72f8ff1d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88874f1413ec40be8a97e6581a78a564'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:40.867042 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1115/2220] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:40 2022] DELETE /identity/v3/users/88874f1413ec40be8a97e6581a78a564 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:40.882399 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84190553-cb20-4c27-bdfd-836663c92f32 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:40.971726 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6d4c9-ab8b-4bcd-8557-568179cffb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:40.972710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6d4c9-ab8b-4bcd-8557-568179cffb86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:40.972967 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6d4c9-ab8b-4bcd-8557-568179cffb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:40.973242 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6d4c9-ab8b-4bcd-8557-568179cffb86 admin admin] PATH_INFO: `/v3/projects/d5b957cbf2534a84946b3e8a051f0656/users/38a3b2b52ab54d2f8600b690fca2c85b/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:40.998883 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6d4c9-ab8b-4bcd-8557-568179cffb86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b957cbf2534a84946b3e8a051f0656, user_id=38a3b2b52ab54d2f8600b690fca2c85b, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:41.003523 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6d4c9-ab8b-4bcd-8557-568179cffb86 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:41.050558 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1106/2221] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:40 2022] PUT /identity/v3/projects/d5b957cbf2534a84946b3e8a051f0656/users/38a3b2b52ab54d2f8600b690fca2c85b/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:41.065983 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9888f5a-74a6-4c5b-bc68-d04d5806b3af None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:41.067308 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9888f5a-74a6-4c5b-bc68-d04d5806b3af None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:41.068068 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9888f5a-74a6-4c5b-bc68-d04d5806b3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:41.115620 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e9888f5a-74a6-4c5b-bc68-d04d5806b3af None None] MFA Rules not processed for user `38a3b2b52ab54d2f8600b690fca2c85b`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:41.117144 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e9888f5a-74a6-4c5b-bc68-d04d5806b3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:41.241034 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1116/2222] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:41.244468 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6d4c9-ab8b-4bcd-8557-568179cffb86 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:41.247673 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9888f5a-74a6-4c5b-bc68-d04d5806b3af None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:41.249116 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e9888f5a-74a6-4c5b-bc68-d04d5806b3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:41.253321 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ffe6d4c9-ab8b-4bcd-8557-568179cffb86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:41.351866 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9888f5a-74a6-4c5b-bc68-d04d5806b3af None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:41.358714 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d677f-2f3b-4f50-90df-d726105d01e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:41.359944 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6d4c9-ab8b-4bcd-8557-568179cffb86 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:41.361114 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d677f-2f3b-4f50-90df-d726105d01e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:41.361114 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d677f-2f3b-4f50-90df-d726105d01e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:41.361679 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d677f-2f3b-4f50-90df-d726105d01e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:41.363439 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d677f-2f3b-4f50-90df-d726105d01e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:41.366437 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d677f-2f3b-4f50-90df-d726105d01e6 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:41.369035 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54959c1a-96da-4ce2-b436-363101330c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:41.369971 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54959c1a-96da-4ce2-b436-363101330c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:41.370262 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54959c1a-96da-4ce2-b436-363101330c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:41.370540 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54959c1a-96da-4ce2-b436-363101330c06 admin admin] PATH_INFO: `/v3/projects/a9b19064da474769a8e1a3099ca97a8f` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:41.371794 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54959c1a-96da-4ce2-b436-363101330c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9b19064da474769a8e1a3099ca97a8f)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:41.374023 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54959c1a-96da-4ce2-b436-363101330c06 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:41.424244 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1117/2223] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:41 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:56:41.425744 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d677f-2f3b-4f50-90df-d726105d01e6 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:41.440338 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-54959c1a-96da-4ce2-b436-363101330c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9b19064da474769a8e1a3099ca97a8f', 'request_id': 'req-54959c1a-96da-4ce2-b436-363101330c06'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:41.460219 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-54959c1a-96da-4ce2-b436-363101330c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9b19064da474769a8e1a3099ca97a8f', 'request_id': 'req-54959c1a-96da-4ce2-b436-363101330c06'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:41.477188 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-54959c1a-96da-4ce2-b436-363101330c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9b19064da474769a8e1a3099ca97a8f', 'request_id': 'req-54959c1a-96da-4ce2-b436-363101330c06'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:41.497929 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-54959c1a-96da-4ce2-b436-363101330c06 admin admin] The token cache is being invalidate because project a9b19064da474769a8e1a3099ca97a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:41.498429 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-54959c1a-96da-4ce2-b436-363101330c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:41.499524 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-54959c1a-96da-4ce2-b436-363101330c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:41.502411 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1107/2224] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:41 2022] DELETE /identity/v3/projects/a9b19064da474769a8e1a3099ca97a8f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:41.503758 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54959c1a-96da-4ce2-b436-363101330c06 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:41.510672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-54959c1a-96da-4ce2-b436-363101330c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:41.559260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d677f-2f3b-4f50-90df-d726105d01e6 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:41.608014 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54959c1a-96da-4ce2-b436-363101330c06 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:41.617672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3445228-af2a-4b3d-ac9a-b122aa94f3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:41.618972 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3445228-af2a-4b3d-ac9a-b122aa94f3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:41.619333 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3445228-af2a-4b3d-ac9a-b122aa94f3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:41.619975 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3445228-af2a-4b3d-ac9a-b122aa94f3ab admin admin] PATH_INFO: `/v3/projects/4bae0604a8414561b18c1af715d3243c` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:41.621746 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3445228-af2a-4b3d-ac9a-b122aa94f3ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bae0604a8414561b18c1af715d3243c)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:41.624033 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3445228-af2a-4b3d-ac9a-b122aa94f3ab admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:41.626746 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0977bb9-cd71-4d1b-9fd9-70324c5fb23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:41.627445 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0977bb9-cd71-4d1b-9fd9-70324c5fb23e admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:41.627762 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0977bb9-cd71-4d1b-9fd9-70324c5fb23e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:41.628040 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0977bb9-cd71-4d1b-9fd9-70324c5fb23e admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:41.630180 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0977bb9-cd71-4d1b-9fd9-70324c5fb23e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:41.633613 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0977bb9-cd71-4d1b-9fd9-70324c5fb23e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:41.662945 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1118/2225] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:41 2022] POST /identity/v3/users => generated 294 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:41.664683 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb67be4-444e-44a5-8b0f-1d700dbef4c8 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:41.664981 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb67be4-444e-44a5-8b0f-1d700dbef4c8 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:41.665257 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb67be4-444e-44a5-8b0f-1d700dbef4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:41.685946 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-6eb67be4-444e-44a5-8b0f-1d700dbef4c8 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:41.686672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-e3445228-af2a-4b3d-ac9a-b122aa94f3ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bae0604a8414561b18c1af715d3243c', 'request_id': 'req-e3445228-af2a-4b3d-ac9a-b122aa94f3ab'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:41.687302 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6eb67be4-444e-44a5-8b0f-1d700dbef4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:41.695571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-e3445228-af2a-4b3d-ac9a-b122aa94f3ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bae0604a8414561b18c1af715d3243c', 'request_id': 'req-e3445228-af2a-4b3d-ac9a-b122aa94f3ab'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:41.707594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-e3445228-af2a-4b3d-ac9a-b122aa94f3ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bae0604a8414561b18c1af715d3243c', 'request_id': 'req-e3445228-af2a-4b3d-ac9a-b122aa94f3ab'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:41.723674 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-e3445228-af2a-4b3d-ac9a-b122aa94f3ab admin admin] The token cache is being invalidate because project 4bae0604a8414561b18c1af715d3243c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:41.724375 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-e3445228-af2a-4b3d-ac9a-b122aa94f3ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:41.725369 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-e3445228-af2a-4b3d-ac9a-b122aa94f3ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:41.728245 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1108/2226] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:41 2022] DELETE /identity/v3/projects/4bae0604a8414561b18c1af715d3243c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:41.729259 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3445228-af2a-4b3d-ac9a-b122aa94f3ab admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:41.730782 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e3445228-af2a-4b3d-ac9a-b122aa94f3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:41.774035 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1119/2227] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:41.774035 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764520d4-edd1-4a01-87a7-ebf650254cb2 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:41.774035 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764520d4-edd1-4a01-87a7-ebf650254cb2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:41.774035 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764520d4-edd1-4a01-87a7-ebf650254cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:41.796420 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-764520d4-edd1-4a01-87a7-ebf650254cb2 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:41.798857 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-764520d4-edd1-4a01-87a7-ebf650254cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:41.810540 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1120/2228] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:41.816923 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3445228-af2a-4b3d-ac9a-b122aa94f3ab admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:41.819394 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea08953-a3c1-451c-9a75-a4a35c3288ad None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:41.819709 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea08953-a3c1-451c-9a75-a4a35c3288ad None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:41.819996 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea08953-a3c1-451c-9a75-a4a35c3288ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:41.822722 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203f63d-37fd-4299-8792-24b5aca2f488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:41.823396 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203f63d-37fd-4299-8792-24b5aca2f488 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:41.823717 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203f63d-37fd-4299-8792-24b5aca2f488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:41.824223 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203f63d-37fd-4299-8792-24b5aca2f488 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:41.824976 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203f63d-37fd-4299-8792-24b5aca2f488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:41.837592 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203f63d-37fd-4299-8792-24b5aca2f488 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:41.847958 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-5ea08953-a3c1-451c-9a75-a4a35c3288ad None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:41.849395 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5ea08953-a3c1-451c-9a75-a4a35c3288ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:41.863492 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1109/2229] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:41.863699 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1121/2230] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:41.863784 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba467c-65ff-4421-868f-11809ab50a76 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:41.863784 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba467c-65ff-4421-868f-11809ab50a76 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:41.863784 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba467c-65ff-4421-868f-11809ab50a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:41.864744 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea08953-a3c1-451c-9a75-a4a35c3288ad None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:41.883874 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea08953-a3c1-451c-9a75-a4a35c3288ad None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:41.886935 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-71ba467c-65ff-4421-868f-11809ab50a76 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:41.888355 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-71ba467c-65ff-4421-868f-11809ab50a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:41.889072 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4b703-97f6-4152-8fd7-a34f0df569dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:41.890116 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4b703-97f6-4152-8fd7-a34f0df569dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:41.890398 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4b703-97f6-4152-8fd7-a34f0df569dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:41.890675 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4b703-97f6-4152-8fd7-a34f0df569dd admin admin] PATH_INFO: `/v3/projects/a96f7e4f76934566b7ce8aeaeb121aaf/users/116d7c8ca4024c40b7ec67322aa45de7/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:41.898241 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1110/2231] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:41.900107 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba467c-65ff-4421-868f-11809ab50a76 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:41.910610 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba467c-65ff-4421-868f-11809ab50a76 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:41.918162 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3f56c-3b1f-458c-b03f-cf29f3ef15f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:41.918383 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4b703-97f6-4152-8fd7-a34f0df569dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a96f7e4f76934566b7ce8aeaeb121aaf, user_id=116d7c8ca4024c40b7ec67322aa45de7, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:41.919053 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3f56c-3b1f-458c-b03f-cf29f3ef15f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:41.919427 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3f56c-3b1f-458c-b03f-cf29f3ef15f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:41.919827 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3f56c-3b1f-458c-b03f-cf29f3ef15f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:41.921157 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3f56c-3b1f-458c-b03f-cf29f3ef15f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:41.921157 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3f56c-3b1f-458c-b03f-cf29f3ef15f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:41.921370 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4b703-97f6-4152-8fd7-a34f0df569dd admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:41.923888 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3f56c-3b1f-458c-b03f-cf29f3ef15f0 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:41.939696 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1111/2232] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:56:41.940157 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3f56c-3b1f-458c-b03f-cf29f3ef15f0 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:41.946549 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1122/2233] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:41 2022] PUT /identity/v3/projects/a96f7e4f76934566b7ce8aeaeb121aaf/users/116d7c8ca4024c40b7ec67322aa45de7/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:41.947592 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4b703-97f6-4152-8fd7-a34f0df569dd admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:41.957322 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3f56c-3b1f-458c-b03f-cf29f3ef15f0 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:42.029418 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4b703-97f6-4152-8fd7-a34f0df569dd admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:42.041960 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cfcd0-3fd1-43ba-9e19-70543f08c3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:42.043256 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cfcd0-3fd1-43ba-9e19-70543f08c3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:42.043546 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cfcd0-3fd1-43ba-9e19-70543f08c3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:42.043907 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cfcd0-3fd1-43ba-9e19-70543f08c3b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:42.044609 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cfcd0-3fd1-43ba-9e19-70543f08c3b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:42.046902 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cfcd0-3fd1-43ba-9e19-70543f08c3b7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:42.077377 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d77d9-2faa-443c-a490-f4f4e456042c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:42.078163 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d77d9-2faa-443c-a490-f4f4e456042c admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:42.078510 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d77d9-2faa-443c-a490-f4f4e456042c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:42.078870 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d77d9-2faa-443c-a490-f4f4e456042c admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:42.080377 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d77d9-2faa-443c-a490-f4f4e456042c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:42.080743 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d77d9-2faa-443c-a490-f4f4e456042c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:42.082442 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d77d9-2faa-443c-a490-f4f4e456042c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:42.084444 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1123/2234] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:41 2022] POST /identity/v3/projects => generated 363 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:42.085416 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cfcd0-3fd1-43ba-9e19-70543f08c3b7 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:42.101098 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1112/2235] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:56:42.101098 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d77d9-2faa-443c-a490-f4f4e456042c admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:42.116312 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d77d9-2faa-443c-a490-f4f4e456042c admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:42.186811 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cfcd0-3fd1-43ba-9e19-70543f08c3b7 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:42.192969 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2e0b1-eeb7-47a2-b66a-50b775f77972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:42.193675 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2e0b1-eeb7-47a2-b66a-50b775f77972 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:42.193958 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2e0b1-eeb7-47a2-b66a-50b775f77972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:42.194324 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2e0b1-eeb7-47a2-b66a-50b775f77972 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:42.194963 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2e0b1-eeb7-47a2-b66a-50b775f77972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:42.196680 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2e0b1-eeb7-47a2-b66a-50b775f77972 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:42.208540 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87823afc-64d4-4e14-bb1c-f87b984011e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:42.209227 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87823afc-64d4-4e14-bb1c-f87b984011e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:42.209508 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87823afc-64d4-4e14-bb1c-f87b984011e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:42.210043 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87823afc-64d4-4e14-bb1c-f87b984011e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:42.210753 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87823afc-64d4-4e14-bb1c-f87b984011e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:42.212737 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87823afc-64d4-4e14-bb1c-f87b984011e9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:42.214153 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1124/2236] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:42.220804 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2e0b1-eeb7-47a2-b66a-50b775f77972 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:42.235919 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2e0b1-eeb7-47a2-b66a-50b775f77972 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:42.243249 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b058ec6-1f2e-4d11-b195-7cfc1cea152d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:42.246367 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b058ec6-1f2e-4d11-b195-7cfc1cea152d admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:42.246675 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b058ec6-1f2e-4d11-b195-7cfc1cea152d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:42.246939 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b058ec6-1f2e-4d11-b195-7cfc1cea152d admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:42.247650 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b058ec6-1f2e-4d11-b195-7cfc1cea152d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:42.249583 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b058ec6-1f2e-4d11-b195-7cfc1cea152d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:42.259083 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1113/2237] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:42 2022] POST /identity/v3/users => generated 282 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:42.259083 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87823afc-64d4-4e14-bb1c-f87b984011e9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:42.270792 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87823afc-64d4-4e14-bb1c-f87b984011e9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:42.276392 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a574e-5372-405d-975f-47bac8733180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:42.277301 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a574e-5372-405d-975f-47bac8733180 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:42.277582 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a574e-5372-405d-975f-47bac8733180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:42.277851 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a574e-5372-405d-975f-47bac8733180 admin admin] PATH_INFO: `/v3/projects/a96f7e4f76934566b7ce8aeaeb121aaf/users/116d7c8ca4024c40b7ec67322aa45de7/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:42.280724 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a574e-5372-405d-975f-47bac8733180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a96f7e4f76934566b7ce8aeaeb121aaf, user_id=116d7c8ca4024c40b7ec67322aa45de7, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:42.283560 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a574e-5372-405d-975f-47bac8733180 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:42.290073 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1125/2238] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:42 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:42.291343 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b058ec6-1f2e-4d11-b195-7cfc1cea152d admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:42.296087 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1114/2239] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:42 2022] PUT /identity/v3/projects/a96f7e4f76934566b7ce8aeaeb121aaf/users/116d7c8ca4024c40b7ec67322aa45de7/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:42.297200 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a574e-5372-405d-975f-47bac8733180 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:42.399240 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b058ec6-1f2e-4d11-b195-7cfc1cea152d admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:42.404180 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a574e-5372-405d-975f-47bac8733180 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:42.414543 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809210a-2792-45a6-975e-9e2563913806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:42.415247 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809210a-2792-45a6-975e-9e2563913806 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:42.415531 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809210a-2792-45a6-975e-9e2563913806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:42.415855 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809210a-2792-45a6-975e-9e2563913806 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:42.416610 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809210a-2792-45a6-975e-9e2563913806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:42.418501 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809210a-2792-45a6-975e-9e2563913806 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:42.418683 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9757a-e74c-459d-b9c9-06b2ea560c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:42.419326 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9757a-e74c-459d-b9c9-06b2ea560c8e admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:42.419607 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9757a-e74c-459d-b9c9-06b2ea560c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:42.419923 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9757a-e74c-459d-b9c9-06b2ea560c8e admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:42.420626 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9757a-e74c-459d-b9c9-06b2ea560c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:42.422859 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9757a-e74c-459d-b9c9-06b2ea560c8e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:42.438845 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1126/2240] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:42.443524 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bdf6f-f0eb-4417-9f32-c848b185e4d1 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:42.444149 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bdf6f-f0eb-4417-9f32-c848b185e4d1 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:42.445187 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bdf6f-f0eb-4417-9f32-c848b185e4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:42.463334 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1115/2241] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:42 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:42.464226 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9757a-e74c-459d-b9c9-06b2ea560c8e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:42.481547 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9757a-e74c-459d-b9c9-06b2ea560c8e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:42.486619 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e52bdf6f-f0eb-4417-9f32-c848b185e4d1 None None] MFA Rules not processed for user `116d7c8ca4024c40b7ec67322aa45de7`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:42.488839 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e52bdf6f-f0eb-4417-9f32-c848b185e4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:42.493074 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df949401-bfcd-46f5-afed-f1446ab0cde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:42.493781 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df949401-bfcd-46f5-afed-f1446ab0cde6 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:42.493893 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df949401-bfcd-46f5-afed-f1446ab0cde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:42.494176 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df949401-bfcd-46f5-afed-f1446ab0cde6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:42.494923 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df949401-bfcd-46f5-afed-f1446ab0cde6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:42.496870 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df949401-bfcd-46f5-afed-f1446ab0cde6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:42.508288 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1116/2242] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:42.508960 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df949401-bfcd-46f5-afed-f1446ab0cde6 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:42.534339 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df949401-bfcd-46f5-afed-f1446ab0cde6 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:42.551216 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600d9c9-c7cd-4bb8-a8b2-a1a0378a2dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:42.552482 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600d9c9-c7cd-4bb8-a8b2-a1a0378a2dcc admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:42.554693 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600d9c9-c7cd-4bb8-a8b2-a1a0378a2dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:42.555941 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600d9c9-c7cd-4bb8-a8b2-a1a0378a2dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:42.557532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600d9c9-c7cd-4bb8-a8b2-a1a0378a2dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:42.563967 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600d9c9-c7cd-4bb8-a8b2-a1a0378a2dcc admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:42.609387 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1117/2243] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:42.610499 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600d9c9-c7cd-4bb8-a8b2-a1a0378a2dcc admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:42.621950 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600d9c9-c7cd-4bb8-a8b2-a1a0378a2dcc admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:42.628767 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce4bd5-1e45-47f6-aa8e-d366257a6886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:42.629951 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce4bd5-1e45-47f6-aa8e-d366257a6886 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:42.630318 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce4bd5-1e45-47f6-aa8e-d366257a6886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:42.630676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce4bd5-1e45-47f6-aa8e-d366257a6886 admin admin] PATH_INFO: `/v3/projects/c6ffd5b8181740e4b3e1c1a0fc1c170f/users/0d53d4b828dd4cf3bcf2a72fad0e58c5/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:42.636910 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1127/2244] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:42.638679 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e3110-2e90-4bd1-b90c-dabca4e5cba9 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:42.639122 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e3110-2e90-4bd1-b90c-dabca4e5cba9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:42.639551 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e3110-2e90-4bd1-b90c-dabca4e5cba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:42.660765 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce4bd5-1e45-47f6-aa8e-d366257a6886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ffd5b8181740e4b3e1c1a0fc1c170f, user_id=0d53d4b828dd4cf3bcf2a72fad0e58c5, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:42.661956 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-393e3110-2e90-4bd1-b90c-dabca4e5cba9 None None] MFA Rules not processed for user `1bcde529b708471eb9c1b74e15b588b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:42.663187 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-393e3110-2e90-4bd1-b90c-dabca4e5cba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:42.663966 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce4bd5-1e45-47f6-aa8e-d366257a6886 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:42.682216 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1118/2245] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:42 2022] PUT /identity/v3/projects/c6ffd5b8181740e4b3e1c1a0fc1c170f/users/0d53d4b828dd4cf3bcf2a72fad0e58c5/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:42.683088 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce4bd5-1e45-47f6-aa8e-d366257a6886 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:42.747688 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1128/2246] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:42.752870 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e3110-2e90-4bd1-b90c-dabca4e5cba9 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:42.754224 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-393e3110-2e90-4bd1-b90c-dabca4e5cba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:42.773880 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce4bd5-1e45-47f6-aa8e-d366257a6886 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:42.780724 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc52bcb-182a-4a55-832e-874d67fb5b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:42.781760 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc52bcb-182a-4a55-832e-874d67fb5b56 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:42.782763 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc52bcb-182a-4a55-832e-874d67fb5b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:42.783229 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc52bcb-182a-4a55-832e-874d67fb5b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:42.784408 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc52bcb-182a-4a55-832e-874d67fb5b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:42.786408 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc52bcb-182a-4a55-832e-874d67fb5b56 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:42.804849 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1119/2247] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:42.805438 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78c62a-4b94-4d5f-affd-d41e579e92e8 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:42.805832 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78c62a-4b94-4d5f-affd-d41e579e92e8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:42.806206 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78c62a-4b94-4d5f-affd-d41e579e92e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:42.833732 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e3110-2e90-4bd1-b90c-dabca4e5cba9 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:42.865845 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-de78c62a-4b94-4d5f-affd-d41e579e92e8 None None] MFA Rules not processed for user `0d53d4b828dd4cf3bcf2a72fad0e58c5`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:42.870684 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-de78c62a-4b94-4d5f-affd-d41e579e92e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:42.915420 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33f73d-8e87-438d-a1ea-a4a8396829f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:42.916062 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33f73d-8e87-438d-a1ea-a4a8396829f1 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:42.916283 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33f73d-8e87-438d-a1ea-a4a8396829f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:42.916594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33f73d-8e87-438d-a1ea-a4a8396829f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:42.934618 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-fd33f73d-8e87-438d-a1ea-a4a8396829f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:42.966399 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1120/2248] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:42 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:42.967572 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78c62a-4b94-4d5f-affd-d41e579e92e8 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:42.980201 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78c62a-4b94-4d5f-affd-d41e579e92e8 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:42.992764 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923b83d-76ed-4b8c-b34a-20735726693c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:42.993945 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923b83d-76ed-4b8c-b34a-20735726693c admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:42.994360 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923b83d-76ed-4b8c-b34a-20735726693c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:42.994765 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923b83d-76ed-4b8c-b34a-20735726693c admin admin] PATH_INFO: `/v3/projects/d983a70fc3904a799399a99234a37daa/users/46f1a873bbe44c298aef3fea90702aff/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:43.015391 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923b83d-76ed-4b8c-b34a-20735726693c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d983a70fc3904a799399a99234a37daa, user_id=46f1a873bbe44c298aef3fea90702aff, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:43.019479 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923b83d-76ed-4b8c-b34a-20735726693c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:43.043058 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1121/2249] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:42 2022] PUT /identity/v3/projects/d983a70fc3904a799399a99234a37daa/users/46f1a873bbe44c298aef3fea90702aff/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:43.052637 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33f73d-8e87-438d-a1ea-a4a8396829f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:43.052849 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923b83d-76ed-4b8c-b34a-20735726693c admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:43.055617 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33f73d-8e87-438d-a1ea-a4a8396829f1 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:43.058344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6923b83d-76ed-4b8c-b34a-20735726693c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:43.087157 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1129/2250] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:43.089405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15ef08-805a-4355-b34e-b60a37c45d9e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:43.089899 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15ef08-805a-4355-b34e-b60a37c45d9e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:43.090401 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15ef08-805a-4355-b34e-b60a37c45d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:43.120717 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-1b15ef08-805a-4355-b34e-b60a37c45d9e None None] MFA Rules not processed for user `46f1a873bbe44c298aef3fea90702aff`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:43.121811 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1b15ef08-805a-4355-b34e-b60a37c45d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:43.182866 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923b83d-76ed-4b8c-b34a-20735726693c admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:43.193480 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c77ad5-9d72-4cc9-aba0-fa7111047930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:43.194326 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c77ad5-9d72-4cc9-aba0-fa7111047930 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:43.194750 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c77ad5-9d72-4cc9-aba0-fa7111047930 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:43.197190 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c77ad5-9d72-4cc9-aba0-fa7111047930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:43.199882 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1130/2251] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:43.204964 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15ef08-805a-4355-b34e-b60a37c45d9e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:43.297088 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c77ad5-9d72-4cc9-aba0-fa7111047930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:43.304443 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c77ad5-9d72-4cc9-aba0-fa7111047930 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:43.340495 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1122/2252] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:43 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:43.346877 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15ef08-805a-4355-b34e-b60a37c45d9e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:43.361906 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14e4a0-72b3-4dde-a683-eac2300113c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:43.363268 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14e4a0-72b3-4dde-a683-eac2300113c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:43.363898 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14e4a0-72b3-4dde-a683-eac2300113c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:43.367902 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14e4a0-72b3-4dde-a683-eac2300113c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:43.370800 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14e4a0-72b3-4dde-a683-eac2300113c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:43.377155 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14e4a0-72b3-4dde-a683-eac2300113c3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:43.442652 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1131/2253] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:43 2022] POST /identity/v3/projects => generated 383 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:43.444805 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c77ad5-9d72-4cc9-aba0-fa7111047930 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:43.460261 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c77ad5-9d72-4cc9-aba0-fa7111047930 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:43.680000 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7cf94-bdef-4322-9ba5-3a05213637c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:43.681364 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7cf94-bdef-4322-9ba5-3a05213637c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:43.681655 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7cf94-bdef-4322-9ba5-3a05213637c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:43.685501 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7cf94-bdef-4322-9ba5-3a05213637c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:43.690393 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7cf94-bdef-4322-9ba5-3a05213637c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:43.714155 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7cf94-bdef-4322-9ba5-3a05213637c8 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:43.766173 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1123/2254] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:43 2022] POST /identity/v3/users => generated 298 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:56:43.770657 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14e4a0-72b3-4dde-a683-eac2300113c3 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:43.784141 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14e4a0-72b3-4dde-a683-eac2300113c3 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:43.795946 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98ad28-5c2e-4eda-9a55-acf10043b330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:43.796924 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98ad28-5c2e-4eda-9a55-acf10043b330 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:43.797220 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98ad28-5c2e-4eda-9a55-acf10043b330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:43.797498 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98ad28-5c2e-4eda-9a55-acf10043b330 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:43.799893 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98ad28-5c2e-4eda-9a55-acf10043b330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:43.799893 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98ad28-5c2e-4eda-9a55-acf10043b330 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:43.840475 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1132/2255] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:43.841542 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7cf94-bdef-4322-9ba5-3a05213637c8 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:43.864349 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7cf94-bdef-4322-9ba5-3a05213637c8 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:43.871787 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851f7d1-d4b4-41c0-b8e7-2424c33f01d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:43.872803 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851f7d1-d4b4-41c0-b8e7-2424c33f01d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:43.873199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851f7d1-d4b4-41c0-b8e7-2424c33f01d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:43.873586 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851f7d1-d4b4-41c0-b8e7-2424c33f01d4 admin admin] PATH_INFO: `/v3/projects/445f7238aab546b3859a9117501fb61f/users/d5dace3ecba149f5b291c6f6da79a74b/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:43.891996 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851f7d1-d4b4-41c0-b8e7-2424c33f01d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=445f7238aab546b3859a9117501fb61f, user_id=d5dace3ecba149f5b291c6f6da79a74b, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:43.900158 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851f7d1-d4b4-41c0-b8e7-2424c33f01d4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:43.918244 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1124/2256] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:43 2022] PUT /identity/v3/projects/445f7238aab546b3859a9117501fb61f/users/d5dace3ecba149f5b291c6f6da79a74b/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:43.924369 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98ad28-5c2e-4eda-9a55-acf10043b330 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:43.948894 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98ad28-5c2e-4eda-9a55-acf10043b330 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:44.104793 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5069d48-9358-4b2b-b12b-0d0905ff34fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:44.106354 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5069d48-9358-4b2b-b12b-0d0905ff34fe admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:44.106906 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5069d48-9358-4b2b-b12b-0d0905ff34fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:44.107322 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5069d48-9358-4b2b-b12b-0d0905ff34fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:44.108284 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5069d48-9358-4b2b-b12b-0d0905ff34fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:44.111067 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5069d48-9358-4b2b-b12b-0d0905ff34fe admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:44.123378 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1133/2257] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:44.129030 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851f7d1-d4b4-41c0-b8e7-2424c33f01d4 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:44.145095 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851f7d1-d4b4-41c0-b8e7-2424c33f01d4 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:44.156521 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673a80d-d8d1-4683-8153-b05dec069fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:44.161690 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673a80d-d8d1-4683-8153-b05dec069fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:44.162104 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673a80d-d8d1-4683-8153-b05dec069fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:44.162775 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673a80d-d8d1-4683-8153-b05dec069fe5 admin admin] PATH_INFO: `/v3/projects/445f7238aab546b3859a9117501fb61f/users/d5dace3ecba149f5b291c6f6da79a74b/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:44.168339 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673a80d-d8d1-4683-8153-b05dec069fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=445f7238aab546b3859a9117501fb61f, user_id=d5dace3ecba149f5b291c6f6da79a74b, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:44.173724 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673a80d-d8d1-4683-8153-b05dec069fe5 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:44.199179 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1125/2258] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:44 2022] PUT /identity/v3/projects/445f7238aab546b3859a9117501fb61f/users/d5dace3ecba149f5b291c6f6da79a74b/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:44.209438 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9a0c7-06a7-481f-9127-65b15837e201 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:44.209935 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9a0c7-06a7-481f-9127-65b15837e201 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:44.210365 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9a0c7-06a7-481f-9127-65b15837e201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:44.241494 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-83a9a0c7-06a7-481f-9127-65b15837e201 None None] MFA Rules not processed for user `d5dace3ecba149f5b291c6f6da79a74b`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:44.243421 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-83a9a0c7-06a7-481f-9127-65b15837e201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:44.333287 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1134/2259] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:44.345364 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673a80d-d8d1-4683-8153-b05dec069fe5 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:44.411377 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673a80d-d8d1-4683-8153-b05dec069fe5 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:44.416822 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085b84d-b94a-4a87-9667-42e39bfceaf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:44.417489 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085b84d-b94a-4a87-9667-42e39bfceaf0 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:44.417785 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085b84d-b94a-4a87-9667-42e39bfceaf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:44.418051 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085b84d-b94a-4a87-9667-42e39bfceaf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:44.489290 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085b84d-b94a-4a87-9667-42e39bfceaf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:44.490858 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085b84d-b94a-4a87-9667-42e39bfceaf0 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:44.500651 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1126/2260] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:46.132116 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9a0c7-06a7-481f-9127-65b15837e201 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:46.215304 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9a0c7-06a7-481f-9127-65b15837e201 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:46.222569 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e5cfd-4f06-4bc8-aea4-2d5142a96014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:46.223736 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e5cfd-4f06-4bc8-aea4-2d5142a96014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:46.224172 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e5cfd-4f06-4bc8-aea4-2d5142a96014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:46.225326 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e5cfd-4f06-4bc8-aea4-2d5142a96014 admin admin] PATH_INFO: `/v3/users/38a3b2b52ab54d2f8600b690fca2c85b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:46.227326 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e5cfd-4f06-4bc8-aea4-2d5142a96014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a3b2b52ab54d2f8600b690fca2c85b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:46.229542 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e5cfd-4f06-4bc8-aea4-2d5142a96014 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:46.280482 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4c6e5cfd-4f06-4bc8-aea4-2d5142a96014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a3b2b52ab54d2f8600b690fca2c85b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:46.281033 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4c6e5cfd-4f06-4bc8-aea4-2d5142a96014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a3b2b52ab54d2f8600b690fca2c85b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:46.288012 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4c6e5cfd-4f06-4bc8-aea4-2d5142a96014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a3b2b52ab54d2f8600b690fca2c85b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:46.296106 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4c6e5cfd-4f06-4bc8-aea4-2d5142a96014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a3b2b52ab54d2f8600b690fca2c85b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:46.297102 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4c6e5cfd-4f06-4bc8-aea4-2d5142a96014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a3b2b52ab54d2f8600b690fca2c85b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:46.317529 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1135/2261] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:46 2022] DELETE /identity/v3/users/38a3b2b52ab54d2f8600b690fca2c85b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:46.322058 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb6a49-72f4-4f05-aef7-f5a3c4476a4f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:46.322552 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb6a49-72f4-4f05-aef7-f5a3c4476a4f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:46.322628 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb6a49-72f4-4f05-aef7-f5a3c4476a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:46.342103 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-39cb6a49-72f4-4f05-aef7-f5a3c4476a4f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:46.343353 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-39cb6a49-72f4-4f05-aef7-f5a3c4476a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:46.417976 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1127/2262] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:56:46.428530 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e5cfd-4f06-4bc8-aea4-2d5142a96014 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:46.429993 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4c6e5cfd-4f06-4bc8-aea4-2d5142a96014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:46.491922 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e5cfd-4f06-4bc8-aea4-2d5142a96014 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:46.495494 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692784c3-eb04-432d-8bba-a06e3f70e0e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:46.496166 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692784c3-eb04-432d-8bba-a06e3f70e0e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:46.496447 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692784c3-eb04-432d-8bba-a06e3f70e0e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:46.496718 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692784c3-eb04-432d-8bba-a06e3f70e0e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:46.511825 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692784c3-eb04-432d-8bba-a06e3f70e0e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:46.513261 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692784c3-eb04-432d-8bba-a06e3f70e0e0 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:46.522871 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1136/2263] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:46.784611 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb6a49-72f4-4f05-aef7-f5a3c4476a4f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:46.786037 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-39cb6a49-72f4-4f05-aef7-f5a3c4476a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:46.799982 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb6a49-72f4-4f05-aef7-f5a3c4476a4f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:46.804597 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92862d4-16ad-4b48-b4bf-d067c4cf7ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:46.805457 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92862d4-16ad-4b48-b4bf-d067c4cf7ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:46.805735 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92862d4-16ad-4b48-b4bf-d067c4cf7ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:46.806011 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92862d4-16ad-4b48-b4bf-d067c4cf7ed0 admin admin] PATH_INFO: `/v3/projects/d5b957cbf2534a84946b3e8a051f0656` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:46.807954 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92862d4-16ad-4b48-b4bf-d067c4cf7ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b957cbf2534a84946b3e8a051f0656)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:46.809953 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92862d4-16ad-4b48-b4bf-d067c4cf7ed0 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:46.855130 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-c92862d4-16ad-4b48-b4bf-d067c4cf7ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b957cbf2534a84946b3e8a051f0656', 'request_id': 'req-c92862d4-16ad-4b48-b4bf-d067c4cf7ed0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:46.862733 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-c92862d4-16ad-4b48-b4bf-d067c4cf7ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b957cbf2534a84946b3e8a051f0656', 'request_id': 'req-c92862d4-16ad-4b48-b4bf-d067c4cf7ed0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:46.868145 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-c92862d4-16ad-4b48-b4bf-d067c4cf7ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b957cbf2534a84946b3e8a051f0656', 'request_id': 'req-c92862d4-16ad-4b48-b4bf-d067c4cf7ed0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:46.880710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-c92862d4-16ad-4b48-b4bf-d067c4cf7ed0 admin admin] The token cache is being invalidate because project d5b957cbf2534a84946b3e8a051f0656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:46.880999 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-c92862d4-16ad-4b48-b4bf-d067c4cf7ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:46.881641 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-c92862d4-16ad-4b48-b4bf-d067c4cf7ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:46.883208 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1128/2264] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:46 2022] DELETE /identity/v3/projects/d5b957cbf2534a84946b3e8a051f0656 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:46.887105 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692784c3-eb04-432d-8bba-a06e3f70e0e0 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:46.897371 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692784c3-eb04-432d-8bba-a06e3f70e0e0 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:46.951487 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4fadc-4f17-459f-8eec-2614322da1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:46.952313 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4fadc-4f17-459f-8eec-2614322da1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:46.952596 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4fadc-4f17-459f-8eec-2614322da1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:46.952871 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4fadc-4f17-459f-8eec-2614322da1b3 admin admin] PATH_INFO: `/v3/users/116d7c8ca4024c40b7ec67322aa45de7` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:46.954056 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4fadc-4f17-459f-8eec-2614322da1b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=116d7c8ca4024c40b7ec67322aa45de7)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:46.956024 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4fadc-4f17-459f-8eec-2614322da1b3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:47.001772 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8cf4fadc-4f17-459f-8eec-2614322da1b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '116d7c8ca4024c40b7ec67322aa45de7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:47.002432 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8cf4fadc-4f17-459f-8eec-2614322da1b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '116d7c8ca4024c40b7ec67322aa45de7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:47.008968 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8cf4fadc-4f17-459f-8eec-2614322da1b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '116d7c8ca4024c40b7ec67322aa45de7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:47.015577 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8cf4fadc-4f17-459f-8eec-2614322da1b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '116d7c8ca4024c40b7ec67322aa45de7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:47.016393 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8cf4fadc-4f17-459f-8eec-2614322da1b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '116d7c8ca4024c40b7ec67322aa45de7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:47.035817 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1137/2265] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:56:46 2022] DELETE /identity/v3/users/116d7c8ca4024c40b7ec67322aa45de7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:47.439956 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92862d4-16ad-4b48-b4bf-d067c4cf7ed0 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:47.441493 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c92862d4-16ad-4b48-b4bf-d067c4cf7ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:47.458731 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92862d4-16ad-4b48-b4bf-d067c4cf7ed0 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:47.513918 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa914e-8d09-4f5d-a8a7-8fa9d83b457f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:47.514775 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa914e-8d09-4f5d-a8a7-8fa9d83b457f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:47.515059 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa914e-8d09-4f5d-a8a7-8fa9d83b457f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:47.515338 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa914e-8d09-4f5d-a8a7-8fa9d83b457f admin admin] PATH_INFO: `/v3/projects/a96f7e4f76934566b7ce8aeaeb121aaf` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:47.517181 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa914e-8d09-4f5d-a8a7-8fa9d83b457f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a96f7e4f76934566b7ce8aeaeb121aaf)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:47.519086 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa914e-8d09-4f5d-a8a7-8fa9d83b457f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:47.563568 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-22aa914e-8d09-4f5d-a8a7-8fa9d83b457f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a96f7e4f76934566b7ce8aeaeb121aaf', 'request_id': 'req-22aa914e-8d09-4f5d-a8a7-8fa9d83b457f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:47.571554 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-22aa914e-8d09-4f5d-a8a7-8fa9d83b457f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a96f7e4f76934566b7ce8aeaeb121aaf', 'request_id': 'req-22aa914e-8d09-4f5d-a8a7-8fa9d83b457f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:47.576889 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-22aa914e-8d09-4f5d-a8a7-8fa9d83b457f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a96f7e4f76934566b7ce8aeaeb121aaf', 'request_id': 'req-22aa914e-8d09-4f5d-a8a7-8fa9d83b457f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:47.588335 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-22aa914e-8d09-4f5d-a8a7-8fa9d83b457f admin admin] The token cache is being invalidate because project a96f7e4f76934566b7ce8aeaeb121aaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:56:47.588621 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-22aa914e-8d09-4f5d-a8a7-8fa9d83b457f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:47.589240 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-22aa914e-8d09-4f5d-a8a7-8fa9d83b457f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:56:47.590769 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1129/2266] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:56:47 2022] DELETE /identity/v3/projects/a96f7e4f76934566b7ce8aeaeb121aaf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:47.595713 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427b2c4-8a74-4e13-93c4-8b1dac3df695 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:47.596165 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427b2c4-8a74-4e13-93c4-8b1dac3df695 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:47.596455 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427b2c4-8a74-4e13-93c4-8b1dac3df695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:47.613941 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4427b2c4-8a74-4e13-93c4-8b1dac3df695 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:47.615131 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4427b2c4-8a74-4e13-93c4-8b1dac3df695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:47.673631 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1138/2267] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:47.681383 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb146a-3b7c-42b0-9cba-f55dfc1b96ba None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:47.681701 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb146a-3b7c-42b0-9cba-f55dfc1b96ba None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:47.681993 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb146a-3b7c-42b0-9cba-f55dfc1b96ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:47.700368 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-3ccb146a-3b7c-42b0-9cba-f55dfc1b96ba None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:47.701544 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3ccb146a-3b7c-42b0-9cba-f55dfc1b96ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:47.709599 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1130/2268] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:47.713714 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427b2c4-8a74-4e13-93c4-8b1dac3df695 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:47.723415 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427b2c4-8a74-4e13-93c4-8b1dac3df695 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:47.728244 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173fdae-b879-4e25-9dd8-1d57d32c20bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:47.728904 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173fdae-b879-4e25-9dd8-1d57d32c20bb admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:47.729191 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173fdae-b879-4e25-9dd8-1d57d32c20bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:47.729465 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173fdae-b879-4e25-9dd8-1d57d32c20bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:47.730199 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173fdae-b879-4e25-9dd8-1d57d32c20bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:56:47.730507 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173fdae-b879-4e25-9dd8-1d57d32c20bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:47.732117 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173fdae-b879-4e25-9dd8-1d57d32c20bb admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:47.744205 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1139/2269] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:56:47.748898 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb146a-3b7c-42b0-9cba-f55dfc1b96ba None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:47.758638 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb146a-3b7c-42b0-9cba-f55dfc1b96ba None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:47.763166 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71078f08-411f-4735-af1d-36697a248595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:47.763825 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71078f08-411f-4735-af1d-36697a248595 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:47.764107 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71078f08-411f-4735-af1d-36697a248595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:47.764379 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71078f08-411f-4735-af1d-36697a248595 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:47.765068 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71078f08-411f-4735-af1d-36697a248595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:47.766964 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71078f08-411f-4735-af1d-36697a248595 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:47.790773 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1131/2270] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:56:47 2022] POST /identity/v3/projects => generated 369 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:47.794855 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173fdae-b879-4e25-9dd8-1d57d32c20bb admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:47.805640 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173fdae-b879-4e25-9dd8-1d57d32c20bb admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:47.860968 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f87ed-fdfc-4fe2-a240-1a94fa31d875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:47.861686 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f87ed-fdfc-4fe2-a240-1a94fa31d875 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:47.861973 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f87ed-fdfc-4fe2-a240-1a94fa31d875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:47.862252 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f87ed-fdfc-4fe2-a240-1a94fa31d875 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:47.862935 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f87ed-fdfc-4fe2-a240-1a94fa31d875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:47.864893 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f87ed-fdfc-4fe2-a240-1a94fa31d875 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:47.885137 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1140/2271] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:56:47 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:56:47.889137 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71078f08-411f-4735-af1d-36697a248595 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:47.899820 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71078f08-411f-4735-af1d-36697a248595 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:47.904542 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1aa51f-6488-4476-a211-4d90e20caa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:47.905201 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1aa51f-6488-4476-a211-4d90e20caa97 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:47.905488 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1aa51f-6488-4476-a211-4d90e20caa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:47.905763 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1aa51f-6488-4476-a211-4d90e20caa97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:47.906503 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1aa51f-6488-4476-a211-4d90e20caa97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:47.908361 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1aa51f-6488-4476-a211-4d90e20caa97 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:47.918403 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1132/2272] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:47.922959 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f87ed-fdfc-4fe2-a240-1a94fa31d875 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:47.932874 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f87ed-fdfc-4fe2-a240-1a94fa31d875 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:47.937503 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35493b52-7bfd-49a8-9019-9b0dfa081a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:47.938937 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35493b52-7bfd-49a8-9019-9b0dfa081a81 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:47.939218 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35493b52-7bfd-49a8-9019-9b0dfa081a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:47.939496 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35493b52-7bfd-49a8-9019-9b0dfa081a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:47.940250 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35493b52-7bfd-49a8-9019-9b0dfa081a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:47.941833 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35493b52-7bfd-49a8-9019-9b0dfa081a81 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:47.951581 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1141/2273] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:56:47.955591 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1aa51f-6488-4476-a211-4d90e20caa97 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:47.965530 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1aa51f-6488-4476-a211-4d90e20caa97 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:47.970062 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b1ee4-5bc0-42f2-a8fe-f7dd6b4fab11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:47.970922 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b1ee4-5bc0-42f2-a8fe-f7dd6b4fab11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:47.971204 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b1ee4-5bc0-42f2-a8fe-f7dd6b4fab11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:47.971481 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b1ee4-5bc0-42f2-a8fe-f7dd6b4fab11 admin admin] PATH_INFO: `/v3/projects/5454fa29da38491b9770e63f611654e9/users/c3e807f648ee4b8aa5b5a87de691f991/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:47.986180 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b1ee4-5bc0-42f2-a8fe-f7dd6b4fab11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5454fa29da38491b9770e63f611654e9, user_id=c3e807f648ee4b8aa5b5a87de691f991, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:47.988959 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b1ee4-5bc0-42f2-a8fe-f7dd6b4fab11 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:48.002200 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1133/2274] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:56:47 2022] PUT /identity/v3/projects/5454fa29da38491b9770e63f611654e9/users/c3e807f648ee4b8aa5b5a87de691f991/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:56:48.013551 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9aad84-ebbe-45d8-9818-dd369a6686c9 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:48.013840 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9aad84-ebbe-45d8-9818-dd369a6686c9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:48.014120 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9aad84-ebbe-45d8-9818-dd369a6686c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:48.039906 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-cc9aad84-ebbe-45d8-9818-dd369a6686c9 None None] MFA Rules not processed for user `c3e807f648ee4b8aa5b5a87de691f991`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:56:48.041093 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-cc9aad84-ebbe-45d8-9818-dd369a6686c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:48.102646 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1142/2275] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:56:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:56:48.114538 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b1ee4-5bc0-42f2-a8fe-f7dd6b4fab11 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:48.116372 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1c5b1ee4-5bc0-42f2-a8fe-f7dd6b4fab11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:48.176278 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b1ee4-5bc0-42f2-a8fe-f7dd6b4fab11 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:48.179946 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b829c-0c43-4d00-901d-f0536290e005 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cbf69574af4e25b940ec038f9e1bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:48.180588 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b829c-0c43-4d00-901d-f0536290e005 service glance] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:48.180871 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b829c-0c43-4d00-901d-f0536290e005 service glance] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:48.181149 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b829c-0c43-4d00-901d-f0536290e005 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:48.189530 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b829c-0c43-4d00-901d-f0536290e005 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:48.191135 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b829c-0c43-4d00-901d-f0536290e005 service glance] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:48.200345 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1134/2276] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:48 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:56:51.023441 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9aad84-ebbe-45d8-9818-dd369a6686c9 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:56:51.025045 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-cc9aad84-ebbe-45d8-9818-dd369a6686c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:51.082066 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9aad84-ebbe-45d8-9818-dd369a6686c9 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:56:51.085564 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e65b0-5da2-44bf-9a96-a1cb10345cd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:56:51.086202 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e65b0-5da2-44bf-9a96-a1cb10345cd0 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:56:51.086717 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e65b0-5da2-44bf-9a96-a1cb10345cd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:56:51.087050 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e65b0-5da2-44bf-9a96-a1cb10345cd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:56:51.089420 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b09e65b0-5da2-44bf-9a96-a1cb10345cd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:56:51.155989 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e65b0-5da2-44bf-9a96-a1cb10345cd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:56:51.159143 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e65b0-5da2-44bf-9a96-a1cb10345cd0 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:56:51.168166 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1143/2277] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:56:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:57:03.513183 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b829c-0c43-4d00-901d-f0536290e005 service glance] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:03.514719 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-cb6b829c-0c43-4d00-901d-f0536290e005 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:03.588631 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b829c-0c43-4d00-901d-f0536290e005 service glance] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:03.593813 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e5fb8-7175-4e80-9c46-3cbba1d7d4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:03.594873 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e5fb8-7175-4e80-9c46-3cbba1d7d4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:03.595161 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e5fb8-7175-4e80-9c46-3cbba1d7d4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:03.595540 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e5fb8-7175-4e80-9c46-3cbba1d7d4a6 admin admin] PATH_INFO: `/v3/users/46f1a873bbe44c298aef3fea90702aff` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:03.597581 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e5fb8-7175-4e80-9c46-3cbba1d7d4a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46f1a873bbe44c298aef3fea90702aff)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:03.600564 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e5fb8-7175-4e80-9c46-3cbba1d7d4a6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:03.655211 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6b8e5fb8-7175-4e80-9c46-3cbba1d7d4a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46f1a873bbe44c298aef3fea90702aff'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:03.664971 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6b8e5fb8-7175-4e80-9c46-3cbba1d7d4a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46f1a873bbe44c298aef3fea90702aff'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:03.673734 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6b8e5fb8-7175-4e80-9c46-3cbba1d7d4a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46f1a873bbe44c298aef3fea90702aff'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:03.674376 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6b8e5fb8-7175-4e80-9c46-3cbba1d7d4a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46f1a873bbe44c298aef3fea90702aff'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:03.675172 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6b8e5fb8-7175-4e80-9c46-3cbba1d7d4a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46f1a873bbe44c298aef3fea90702aff'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:03.699287 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1135/2278] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:57:03 2022] DELETE /identity/v3/users/46f1a873bbe44c298aef3fea90702aff => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:03.703986 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff41c7-6bc0-402b-bf60-bd1a9aa846a2 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:03.704575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff41c7-6bc0-402b-bf60-bd1a9aa846a2 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:03.704675 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff41c7-6bc0-402b-bf60-bd1a9aa846a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:03.723956 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-26ff41c7-6bc0-402b-bf60-bd1a9aa846a2 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:03.725256 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-26ff41c7-6bc0-402b-bf60-bd1a9aa846a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:03.821053 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1144/2279] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:03.863860 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e5fb8-7175-4e80-9c46-3cbba1d7d4a6 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:03.865870 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6b8e5fb8-7175-4e80-9c46-3cbba1d7d4a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:03.941379 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e5fb8-7175-4e80-9c46-3cbba1d7d4a6 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:03.945468 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e196d3-5bb4-45d7-b9ed-1ba58b4ba81f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:03.946207 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e196d3-5bb4-45d7-b9ed-1ba58b4ba81f service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:03.946564 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e196d3-5bb4-45d7-b9ed-1ba58b4ba81f service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:03.946939 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e196d3-5bb4-45d7-b9ed-1ba58b4ba81f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:03.959015 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e196d3-5bb4-45d7-b9ed-1ba58b4ba81f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:03.960581 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e196d3-5bb4-45d7-b9ed-1ba58b4ba81f service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:03.970017 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1136/2280] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:57:04.239421 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff41c7-6bc0-402b-bf60-bd1a9aa846a2 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:04.240876 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-26ff41c7-6bc0-402b-bf60-bd1a9aa846a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:04.253735 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff41c7-6bc0-402b-bf60-bd1a9aa846a2 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:04.264174 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555167b-5ac6-4781-a304-d1bb37b4aefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:04.265134 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555167b-5ac6-4781-a304-d1bb37b4aefe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:04.265521 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555167b-5ac6-4781-a304-d1bb37b4aefe admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:04.265849 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555167b-5ac6-4781-a304-d1bb37b4aefe admin admin] PATH_INFO: `/v3/projects/d983a70fc3904a799399a99234a37daa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:04.267508 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555167b-5ac6-4781-a304-d1bb37b4aefe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d983a70fc3904a799399a99234a37daa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:04.269849 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555167b-5ac6-4781-a304-d1bb37b4aefe admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:04.316995 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3555167b-5ac6-4781-a304-d1bb37b4aefe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd983a70fc3904a799399a99234a37daa', 'request_id': 'req-3555167b-5ac6-4781-a304-d1bb37b4aefe'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:04.322869 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3555167b-5ac6-4781-a304-d1bb37b4aefe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd983a70fc3904a799399a99234a37daa', 'request_id': 'req-3555167b-5ac6-4781-a304-d1bb37b4aefe'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:04.328224 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3555167b-5ac6-4781-a304-d1bb37b4aefe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd983a70fc3904a799399a99234a37daa', 'request_id': 'req-3555167b-5ac6-4781-a304-d1bb37b4aefe'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:04.342330 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3555167b-5ac6-4781-a304-d1bb37b4aefe admin admin] The token cache is being invalidate because project d983a70fc3904a799399a99234a37daa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:57:04.342906 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3555167b-5ac6-4781-a304-d1bb37b4aefe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:04.343618 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3555167b-5ac6-4781-a304-d1bb37b4aefe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:04.345503 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1145/2281] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:57:04 2022] DELETE /identity/v3/projects/d983a70fc3904a799399a99234a37daa => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:04.349322 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e196d3-5bb4-45d7-b9ed-1ba58b4ba81f service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:04.359278 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e196d3-5bb4-45d7-b9ed-1ba58b4ba81f service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:04.419334 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85778d-98db-4a3f-a49c-8127d0e7da65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:04.420494 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85778d-98db-4a3f-a49c-8127d0e7da65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:04.420774 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85778d-98db-4a3f-a49c-8127d0e7da65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:04.421047 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85778d-98db-4a3f-a49c-8127d0e7da65 admin admin] PATH_INFO: `/v3/users/d5dace3ecba149f5b291c6f6da79a74b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:04.422241 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85778d-98db-4a3f-a49c-8127d0e7da65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5dace3ecba149f5b291c6f6da79a74b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:04.424187 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85778d-98db-4a3f-a49c-8127d0e7da65 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:04.480073 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-af85778d-98db-4a3f-a49c-8127d0e7da65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5dace3ecba149f5b291c6f6da79a74b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:04.488985 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-af85778d-98db-4a3f-a49c-8127d0e7da65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5dace3ecba149f5b291c6f6da79a74b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:04.496903 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-af85778d-98db-4a3f-a49c-8127d0e7da65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5dace3ecba149f5b291c6f6da79a74b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:04.497680 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-af85778d-98db-4a3f-a49c-8127d0e7da65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5dace3ecba149f5b291c6f6da79a74b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:04.498369 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-af85778d-98db-4a3f-a49c-8127d0e7da65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5dace3ecba149f5b291c6f6da79a74b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:04.520428 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1137/2282] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:57:04 2022] DELETE /identity/v3/users/d5dace3ecba149f5b291c6f6da79a74b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:57:04.791849 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555167b-5ac6-4781-a304-d1bb37b4aefe admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:04.793328 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3555167b-5ac6-4781-a304-d1bb37b4aefe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:04.807373 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555167b-5ac6-4781-a304-d1bb37b4aefe admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:04.865295 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b8d5c-3a30-4321-a11f-0087b373091f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:04.866164 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b8d5c-3a30-4321-a11f-0087b373091f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:04.866451 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b8d5c-3a30-4321-a11f-0087b373091f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:04.866799 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b8d5c-3a30-4321-a11f-0087b373091f admin admin] PATH_INFO: `/v3/projects/445f7238aab546b3859a9117501fb61f` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:04.867968 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b8d5c-3a30-4321-a11f-0087b373091f admin admin] RBAC: Authorizing `identity:delete_project(project_id=445f7238aab546b3859a9117501fb61f)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:04.869885 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b8d5c-3a30-4321-a11f-0087b373091f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:04.920080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6d5b8d5c-3a30-4321-a11f-0087b373091f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '445f7238aab546b3859a9117501fb61f', 'request_id': 'req-6d5b8d5c-3a30-4321-a11f-0087b373091f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:04.927562 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6d5b8d5c-3a30-4321-a11f-0087b373091f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '445f7238aab546b3859a9117501fb61f', 'request_id': 'req-6d5b8d5c-3a30-4321-a11f-0087b373091f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:04.932973 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6d5b8d5c-3a30-4321-a11f-0087b373091f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '445f7238aab546b3859a9117501fb61f', 'request_id': 'req-6d5b8d5c-3a30-4321-a11f-0087b373091f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:04.946515 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6d5b8d5c-3a30-4321-a11f-0087b373091f admin admin] The token cache is being invalidate because project 445f7238aab546b3859a9117501fb61f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:57:04.946807 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6d5b8d5c-3a30-4321-a11f-0087b373091f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:04.947562 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-6d5b8d5c-3a30-4321-a11f-0087b373091f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:04.949041 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1146/2283] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:57:04 2022] DELETE /identity/v3/projects/445f7238aab546b3859a9117501fb61f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:04.955235 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2cace-d8a3-46f6-a462-a545d5314f24 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:04.955616 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2cace-d8a3-46f6-a462-a545d5314f24 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:04.956438 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2cace-d8a3-46f6-a462-a545d5314f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:04.977641 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0aa2cace-d8a3-46f6-a462-a545d5314f24 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:04.978940 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0aa2cace-d8a3-46f6-a462-a545d5314f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:05.059562 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1138/2284] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:05.069211 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85401936-4a59-4d92-a127-40c38b1e1151 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:05.069723 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85401936-4a59-4d92-a127-40c38b1e1151 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:05.069804 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85401936-4a59-4d92-a127-40c38b1e1151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:05.090071 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-85401936-4a59-4d92-a127-40c38b1e1151 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:05.091272 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-85401936-4a59-4d92-a127-40c38b1e1151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:05.102832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1147/2285] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:05.106971 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2cace-d8a3-46f6-a462-a545d5314f24 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:05.116685 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2cace-d8a3-46f6-a462-a545d5314f24 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:05.121775 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f97b34-4729-4854-9ddc-69957148ce36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:05.122388 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f97b34-4729-4854-9ddc-69957148ce36 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:05.123163 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f97b34-4729-4854-9ddc-69957148ce36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:05.123163 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f97b34-4729-4854-9ddc-69957148ce36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:05.124002 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f97b34-4729-4854-9ddc-69957148ce36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:57:05.124306 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f97b34-4729-4854-9ddc-69957148ce36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:05.126390 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f97b34-4729-4854-9ddc-69957148ce36 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:05.139015 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1139/2286] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:57:05.144911 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85401936-4a59-4d92-a127-40c38b1e1151 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:05.159695 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85401936-4a59-4d92-a127-40c38b1e1151 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:05.172716 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884cba6-1ac2-41e2-9b54-acb33fcdf69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:05.173391 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884cba6-1ac2-41e2-9b54-acb33fcdf69c admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:05.173670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884cba6-1ac2-41e2-9b54-acb33fcdf69c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:05.173940 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884cba6-1ac2-41e2-9b54-acb33fcdf69c admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:05.174724 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884cba6-1ac2-41e2-9b54-acb33fcdf69c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:05.176696 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884cba6-1ac2-41e2-9b54-acb33fcdf69c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:05.201703 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1148/2287] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:57:05 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:57:05.206802 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f97b34-4729-4854-9ddc-69957148ce36 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:05.216584 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f97b34-4729-4854-9ddc-69957148ce36 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:05.276604 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acf134-938b-4a1e-a769-896af908fb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:05.277286 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acf134-938b-4a1e-a769-896af908fb4e admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:05.277571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acf134-938b-4a1e-a769-896af908fb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:05.277851 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acf134-938b-4a1e-a769-896af908fb4e admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:05.278563 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acf134-938b-4a1e-a769-896af908fb4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:05.280546 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acf134-938b-4a1e-a769-896af908fb4e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:05.302972 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1140/2288] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:57:05 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:57:05.306964 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884cba6-1ac2-41e2-9b54-acb33fcdf69c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:05.317803 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884cba6-1ac2-41e2-9b54-acb33fcdf69c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:05.323263 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fad2f-41c8-49b3-91df-aed502d8d4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:05.324228 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fad2f-41c8-49b3-91df-aed502d8d4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:05.324535 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fad2f-41c8-49b3-91df-aed502d8d4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:05.324862 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fad2f-41c8-49b3-91df-aed502d8d4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:05.325986 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fad2f-41c8-49b3-91df-aed502d8d4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:05.328088 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fad2f-41c8-49b3-91df-aed502d8d4e8 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:05.338941 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1149/2289] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:57:05.343151 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acf134-938b-4a1e-a769-896af908fb4e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:05.354605 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acf134-938b-4a1e-a769-896af908fb4e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:05.359733 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd92687-53c5-4f5b-b303-d16f7e1790eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:05.360393 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd92687-53c5-4f5b-b303-d16f7e1790eb admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:05.360658 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd92687-53c5-4f5b-b303-d16f7e1790eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:05.360956 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd92687-53c5-4f5b-b303-d16f7e1790eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:05.361650 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd92687-53c5-4f5b-b303-d16f7e1790eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:05.364630 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd92687-53c5-4f5b-b303-d16f7e1790eb admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:05.374919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1141/2290] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:57:05.379369 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fad2f-41c8-49b3-91df-aed502d8d4e8 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:05.392455 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fad2f-41c8-49b3-91df-aed502d8d4e8 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:05.402435 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4138b-e8bc-4edd-8ebe-f77d6bfc0b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:05.403361 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4138b-e8bc-4edd-8ebe-f77d6bfc0b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:05.403667 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4138b-e8bc-4edd-8ebe-f77d6bfc0b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:05.403944 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4138b-e8bc-4edd-8ebe-f77d6bfc0b70 admin admin] PATH_INFO: `/v3/projects/39d6b2131a8648e4abd488464eb030d8/users/0d6e758bb05949339f9aff998a2e28ab/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:05.418996 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4138b-e8bc-4edd-8ebe-f77d6bfc0b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d6b2131a8648e4abd488464eb030d8, user_id=0d6e758bb05949339f9aff998a2e28ab, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:05.421948 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4138b-e8bc-4edd-8ebe-f77d6bfc0b70 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:05.435704 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1150/2291] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:57:05 2022] PUT /identity/v3/projects/39d6b2131a8648e4abd488464eb030d8/users/0d6e758bb05949339f9aff998a2e28ab/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:05.447479 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c01cb-0bca-48d8-8337-8e28f3f775a5 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:05.447811 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c01cb-0bca-48d8-8337-8e28f3f775a5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:05.448098 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c01cb-0bca-48d8-8337-8e28f3f775a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:05.474528 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ae7c01cb-0bca-48d8-8337-8e28f3f775a5 None None] MFA Rules not processed for user `0d6e758bb05949339f9aff998a2e28ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:05.475832 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ae7c01cb-0bca-48d8-8337-8e28f3f775a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:05.538884 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1142/2292] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:05.552251 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4138b-e8bc-4edd-8ebe-f77d6bfc0b70 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:05.554050 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-75d4138b-e8bc-4edd-8ebe-f77d6bfc0b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:05.596851 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c01cb-0bca-48d8-8337-8e28f3f775a5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:05.599210 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ae7c01cb-0bca-48d8-8337-8e28f3f775a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:05.635931 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4138b-e8bc-4edd-8ebe-f77d6bfc0b70 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:05.639774 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6f563-cc45-40a5-9820-3c1d8231ead8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cbf69574af4e25b940ec038f9e1bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:05.640487 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6f563-cc45-40a5-9820-3c1d8231ead8 service glance] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:05.640694 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6f563-cc45-40a5-9820-3c1d8231ead8 service glance] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:05.640971 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6f563-cc45-40a5-9820-3c1d8231ead8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:05.649793 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6f563-cc45-40a5-9820-3c1d8231ead8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:05.650993 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6f563-cc45-40a5-9820-3c1d8231ead8 service glance] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:05.660665 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1151/2293] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:57:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:57:05.676974 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c01cb-0bca-48d8-8337-8e28f3f775a5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:05.684880 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70d56b-96a7-4fba-8931-8c8af0ff7fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:05.685771 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70d56b-96a7-4fba-8931-8c8af0ff7fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:05.686060 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70d56b-96a7-4fba-8931-8c8af0ff7fce admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:05.686356 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70d56b-96a7-4fba-8931-8c8af0ff7fce admin admin] PATH_INFO: `/v3/users/bacd465368044995aad32678aa0089b7` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:05.687581 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70d56b-96a7-4fba-8931-8c8af0ff7fce admin admin] RBAC: Authorizing `identity:delete_user(user_id=bacd465368044995aad32678aa0089b7)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:05.689561 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70d56b-96a7-4fba-8931-8c8af0ff7fce admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:05.747072 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1e70d56b-96a7-4fba-8931-8c8af0ff7fce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bacd465368044995aad32678aa0089b7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:05.754527 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1e70d56b-96a7-4fba-8931-8c8af0ff7fce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bacd465368044995aad32678aa0089b7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:05.763967 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1e70d56b-96a7-4fba-8931-8c8af0ff7fce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bacd465368044995aad32678aa0089b7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:05.764684 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1e70d56b-96a7-4fba-8931-8c8af0ff7fce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bacd465368044995aad32678aa0089b7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:05.765327 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1e70d56b-96a7-4fba-8931-8c8af0ff7fce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bacd465368044995aad32678aa0089b7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:05.786412 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1143/2294] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:57:05 2022] DELETE /identity/v3/users/bacd465368044995aad32678aa0089b7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:57:05.791110 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d7cf2-71e9-420d-ab69-b71ac74f9b1c None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:05.791649 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d7cf2-71e9-420d-ab69-b71ac74f9b1c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:05.791932 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d7cf2-71e9-420d-ab69-b71ac74f9b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:05.810789 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d38d7cf2-71e9-420d-ab69-b71ac74f9b1c None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:05.812142 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d38d7cf2-71e9-420d-ab69-b71ac74f9b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:05.887433 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1152/2295] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:05.899545 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70d56b-96a7-4fba-8931-8c8af0ff7fce admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:05.901391 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1e70d56b-96a7-4fba-8931-8c8af0ff7fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:05.967999 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70d56b-96a7-4fba-8931-8c8af0ff7fce admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:05.974345 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097da8d-4bbd-4e1e-9a87-ebd93992849a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:05.975037 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097da8d-4bbd-4e1e-9a87-ebd93992849a service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:05.975330 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097da8d-4bbd-4e1e-9a87-ebd93992849a service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:05.975650 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097da8d-4bbd-4e1e-9a87-ebd93992849a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:05.985838 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097da8d-4bbd-4e1e-9a87-ebd93992849a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:05.987898 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097da8d-4bbd-4e1e-9a87-ebd93992849a service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:05.999497 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1144/2296] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:57:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:57:06.437472 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d7cf2-71e9-420d-ab69-b71ac74f9b1c None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:06.438937 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d38d7cf2-71e9-420d-ab69-b71ac74f9b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:06.451227 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d7cf2-71e9-420d-ab69-b71ac74f9b1c None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:06.457181 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d466bc-4ac1-4f98-8de2-f17db2779c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:06.458097 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d466bc-4ac1-4f98-8de2-f17db2779c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:06.458380 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d466bc-4ac1-4f98-8de2-f17db2779c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:06.458656 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d466bc-4ac1-4f98-8de2-f17db2779c80 admin admin] PATH_INFO: `/v3/projects/36155df9b348437d83f3d5b8d1ee23e6` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:06.460025 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d466bc-4ac1-4f98-8de2-f17db2779c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36155df9b348437d83f3d5b8d1ee23e6)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:06.461996 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d466bc-4ac1-4f98-8de2-f17db2779c80 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:06.510862 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-24d466bc-4ac1-4f98-8de2-f17db2779c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36155df9b348437d83f3d5b8d1ee23e6', 'request_id': 'req-24d466bc-4ac1-4f98-8de2-f17db2779c80'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:06.517242 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-24d466bc-4ac1-4f98-8de2-f17db2779c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36155df9b348437d83f3d5b8d1ee23e6', 'request_id': 'req-24d466bc-4ac1-4f98-8de2-f17db2779c80'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:06.523209 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-24d466bc-4ac1-4f98-8de2-f17db2779c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36155df9b348437d83f3d5b8d1ee23e6', 'request_id': 'req-24d466bc-4ac1-4f98-8de2-f17db2779c80'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:06.537330 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-24d466bc-4ac1-4f98-8de2-f17db2779c80 admin admin] The token cache is being invalidate because project 36155df9b348437d83f3d5b8d1ee23e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:57:06.537715 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-24d466bc-4ac1-4f98-8de2-f17db2779c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:06.538431 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-24d466bc-4ac1-4f98-8de2-f17db2779c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:06.540395 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1153/2297] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:57:06 2022] DELETE /identity/v3/projects/36155df9b348437d83f3d5b8d1ee23e6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:06.545508 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097da8d-4bbd-4e1e-9a87-ebd93992849a service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:06.557696 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097da8d-4bbd-4e1e-9a87-ebd93992849a service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:06.630585 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead80041-0c4c-42b6-90e7-bd6a0d3adb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:06.631577 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead80041-0c4c-42b6-90e7-bd6a0d3adb62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:06.631844 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead80041-0c4c-42b6-90e7-bd6a0d3adb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:06.632119 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead80041-0c4c-42b6-90e7-bd6a0d3adb62 admin admin] PATH_INFO: `/v3/users/1a0574ed075e418e8be1a58478a9a3c6` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:06.633858 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead80041-0c4c-42b6-90e7-bd6a0d3adb62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a0574ed075e418e8be1a58478a9a3c6)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:06.635846 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead80041-0c4c-42b6-90e7-bd6a0d3adb62 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:06.686026 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ead80041-0c4c-42b6-90e7-bd6a0d3adb62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a0574ed075e418e8be1a58478a9a3c6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:06.693961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ead80041-0c4c-42b6-90e7-bd6a0d3adb62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a0574ed075e418e8be1a58478a9a3c6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:06.702975 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ead80041-0c4c-42b6-90e7-bd6a0d3adb62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a0574ed075e418e8be1a58478a9a3c6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:06.703770 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ead80041-0c4c-42b6-90e7-bd6a0d3adb62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a0574ed075e418e8be1a58478a9a3c6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:06.704463 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ead80041-0c4c-42b6-90e7-bd6a0d3adb62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a0574ed075e418e8be1a58478a9a3c6'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:06.728141 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1145/2298] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:57:06 2022] DELETE /identity/v3/users/1a0574ed075e418e8be1a58478a9a3c6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:07.158697 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d466bc-4ac1-4f98-8de2-f17db2779c80 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:07.162167 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-24d466bc-4ac1-4f98-8de2-f17db2779c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:07.179776 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d466bc-4ac1-4f98-8de2-f17db2779c80 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:07.249974 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8e3ee-b6e3-49c5-80be-02b82322dffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:07.250992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8e3ee-b6e3-49c5-80be-02b82322dffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:07.251387 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8e3ee-b6e3-49c5-80be-02b82322dffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:07.252011 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8e3ee-b6e3-49c5-80be-02b82322dffe admin admin] PATH_INFO: `/v3/projects/5d8093e3f4a7474c86d70dc77934038e` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:07.253802 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8e3ee-b6e3-49c5-80be-02b82322dffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8093e3f4a7474c86d70dc77934038e)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:07.255895 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8e3ee-b6e3-49c5-80be-02b82322dffe admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:07.317297 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e6d8e3ee-b6e3-49c5-80be-02b82322dffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8093e3f4a7474c86d70dc77934038e', 'request_id': 'req-e6d8e3ee-b6e3-49c5-80be-02b82322dffe'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:07.323448 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e6d8e3ee-b6e3-49c5-80be-02b82322dffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8093e3f4a7474c86d70dc77934038e', 'request_id': 'req-e6d8e3ee-b6e3-49c5-80be-02b82322dffe'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:07.328976 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e6d8e3ee-b6e3-49c5-80be-02b82322dffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8093e3f4a7474c86d70dc77934038e', 'request_id': 'req-e6d8e3ee-b6e3-49c5-80be-02b82322dffe'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:07.356031 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e6d8e3ee-b6e3-49c5-80be-02b82322dffe admin admin] The token cache is being invalidate because project 5d8093e3f4a7474c86d70dc77934038e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:57:07.356346 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e6d8e3ee-b6e3-49c5-80be-02b82322dffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:07.357266 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e6d8e3ee-b6e3-49c5-80be-02b82322dffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:07.358911 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1154/2299] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:57:07 2022] DELETE /identity/v3/projects/5d8093e3f4a7474c86d70dc77934038e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:07.364039 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da22949-1805-4beb-b790-311e4c5e3cdd None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:07.364339 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da22949-1805-4beb-b790-311e4c5e3cdd None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:07.364810 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da22949-1805-4beb-b790-311e4c5e3cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:07.408629 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4da22949-1805-4beb-b790-311e4c5e3cdd None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:07.410786 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4da22949-1805-4beb-b790-311e4c5e3cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:07.508809 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1146/2300] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:07.516193 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2b1dc-e390-43aa-8443-219620744b10 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:07.516722 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2b1dc-e390-43aa-8443-219620744b10 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:07.517415 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2b1dc-e390-43aa-8443-219620744b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:07.540736 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-dca2b1dc-e390-43aa-8443-219620744b10 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:07.542280 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-dca2b1dc-e390-43aa-8443-219620744b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:07.552559 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1155/2301] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:07.556902 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da22949-1805-4beb-b790-311e4c5e3cdd None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:07.570488 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da22949-1805-4beb-b790-311e4c5e3cdd None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:07.576384 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71458f0a-c0a3-4db7-9cf0-e1677e59f462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:07.577360 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71458f0a-c0a3-4db7-9cf0-e1677e59f462 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:07.577644 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71458f0a-c0a3-4db7-9cf0-e1677e59f462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:07.577918 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71458f0a-c0a3-4db7-9cf0-e1677e59f462 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:07.578680 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71458f0a-c0a3-4db7-9cf0-e1677e59f462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:57:07.584399 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71458f0a-c0a3-4db7-9cf0-e1677e59f462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:07.586434 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71458f0a-c0a3-4db7-9cf0-e1677e59f462 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:07.611783 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1147/2302] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:57:07.616708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2b1dc-e390-43aa-8443-219620744b10 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:07.628420 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2b1dc-e390-43aa-8443-219620744b10 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:07.634091 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124858d-49b8-448a-ab72-06f68800447a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:07.634885 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124858d-49b8-448a-ab72-06f68800447a admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:07.635286 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124858d-49b8-448a-ab72-06f68800447a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:07.635698 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124858d-49b8-448a-ab72-06f68800447a admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:07.636501 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124858d-49b8-448a-ab72-06f68800447a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:07.638657 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124858d-49b8-448a-ab72-06f68800447a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:07.687072 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1156/2303] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:57:07 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:57:07.692217 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71458f0a-c0a3-4db7-9cf0-e1677e59f462 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:07.718752 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71458f0a-c0a3-4db7-9cf0-e1677e59f462 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:07.795361 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d74ac-c761-4807-a974-21b760b03f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:07.796285 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d74ac-c761-4807-a974-21b760b03f6e admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:07.796608 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d74ac-c761-4807-a974-21b760b03f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:07.797502 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d74ac-c761-4807-a974-21b760b03f6e admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:07.798445 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d74ac-c761-4807-a974-21b760b03f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:07.801963 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d74ac-c761-4807-a974-21b760b03f6e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:07.827400 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1148/2304] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:57:07 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:57:07.832498 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124858d-49b8-448a-ab72-06f68800447a admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:07.850762 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124858d-49b8-448a-ab72-06f68800447a admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:07.857643 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4328607-0141-40df-b19e-42cb17172389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:07.858371 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4328607-0141-40df-b19e-42cb17172389 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:07.858656 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4328607-0141-40df-b19e-42cb17172389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:07.858927 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4328607-0141-40df-b19e-42cb17172389 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:07.859673 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4328607-0141-40df-b19e-42cb17172389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:07.861501 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4328607-0141-40df-b19e-42cb17172389 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:07.874987 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1157/2305] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:57:07.879564 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d74ac-c761-4807-a974-21b760b03f6e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:07.889605 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d74ac-c761-4807-a974-21b760b03f6e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:07.894803 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4c52f-3cbe-41b0-bc3d-28b80e426094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:07.895474 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4c52f-3cbe-41b0-bc3d-28b80e426094 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:07.895806 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4c52f-3cbe-41b0-bc3d-28b80e426094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:07.896115 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4c52f-3cbe-41b0-bc3d-28b80e426094 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:07.896944 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4c52f-3cbe-41b0-bc3d-28b80e426094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:07.898588 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4c52f-3cbe-41b0-bc3d-28b80e426094 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:07.911679 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1149/2306] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:57:07.913500 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4328607-0141-40df-b19e-42cb17172389 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:07.924178 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4328607-0141-40df-b19e-42cb17172389 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:07.929645 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a4d69-e452-4841-a24d-2b0f07eb932b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:07.930658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a4d69-e452-4841-a24d-2b0f07eb932b admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:07.930827 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a4d69-e452-4841-a24d-2b0f07eb932b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:07.931103 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a4d69-e452-4841-a24d-2b0f07eb932b admin admin] PATH_INFO: `/v3/projects/59a0b12e492d4ec5bdf3f3da08433abe/users/cb48a0d87a834975a2323070e4b024bb/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:07.947835 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a4d69-e452-4841-a24d-2b0f07eb932b admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a0b12e492d4ec5bdf3f3da08433abe, user_id=cb48a0d87a834975a2323070e4b024bb, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:07.950555 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a4d69-e452-4841-a24d-2b0f07eb932b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:07.964284 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1158/2307] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:57:07 2022] PUT /identity/v3/projects/59a0b12e492d4ec5bdf3f3da08433abe/users/cb48a0d87a834975a2323070e4b024bb/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:07.975403 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7f607-ab48-46c0-8e76-bceafebd47c6 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:07.975724 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7f607-ab48-46c0-8e76-bceafebd47c6 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:07.976006 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7f607-ab48-46c0-8e76-bceafebd47c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:08.004907 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-39e7f607-ab48-46c0-8e76-bceafebd47c6 None None] MFA Rules not processed for user `cb48a0d87a834975a2323070e4b024bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:08.006118 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-39e7f607-ab48-46c0-8e76-bceafebd47c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:08.075193 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1150/2308] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:08.079732 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a4d69-e452-4841-a24d-2b0f07eb932b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:08.147461 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a4d69-e452-4841-a24d-2b0f07eb932b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:08.152259 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fadc4-f65e-49eb-8fa1-51fb19353ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:08.152989 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fadc4-f65e-49eb-8fa1-51fb19353ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:08.153340 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fadc4-f65e-49eb-8fa1-51fb19353ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:08.153701 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fadc4-f65e-49eb-8fa1-51fb19353ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:08.154492 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fadc4-f65e-49eb-8fa1-51fb19353ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:08.156540 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fadc4-f65e-49eb-8fa1-51fb19353ca6 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:08.198190 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1159/2309] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:57:08 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:57:08.199429 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7f607-ab48-46c0-8e76-bceafebd47c6 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:08.211546 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7f607-ab48-46c0-8e76-bceafebd47c6 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:08.271083 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d78e3-9ef9-45b7-a7ce-53bbc766c340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:08.271813 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d78e3-9ef9-45b7-a7ce-53bbc766c340 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:08.272127 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d78e3-9ef9-45b7-a7ce-53bbc766c340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:08.272406 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d78e3-9ef9-45b7-a7ce-53bbc766c340 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:08.273355 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d78e3-9ef9-45b7-a7ce-53bbc766c340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:08.275320 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d78e3-9ef9-45b7-a7ce-53bbc766c340 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:08.302098 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1151/2310] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:57:08 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:57:08.303302 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fadc4-f65e-49eb-8fa1-51fb19353ca6 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:08.313840 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fadc4-f65e-49eb-8fa1-51fb19353ca6 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:08.319085 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a1f1c-9b77-44fa-9f21-f563ce0b5293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:08.319802 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a1f1c-9b77-44fa-9f21-f563ce0b5293 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:08.320087 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a1f1c-9b77-44fa-9f21-f563ce0b5293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:08.320365 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a1f1c-9b77-44fa-9f21-f563ce0b5293 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:08.321096 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a1f1c-9b77-44fa-9f21-f563ce0b5293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:08.322718 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a1f1c-9b77-44fa-9f21-f563ce0b5293 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:08.334087 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1160/2311] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:57:08.338348 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d78e3-9ef9-45b7-a7ce-53bbc766c340 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:08.349156 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d78e3-9ef9-45b7-a7ce-53bbc766c340 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:08.354030 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab6eb5-cf6f-4f4a-95b1-e7d1894d1ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:08.354815 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab6eb5-cf6f-4f4a-95b1-e7d1894d1ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:08.355133 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab6eb5-cf6f-4f4a-95b1-e7d1894d1ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:08.355411 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab6eb5-cf6f-4f4a-95b1-e7d1894d1ab8 admin admin] PATH_INFO: `/v3/projects/551ef72112824b66865468275337a189/users/412ca0b568224c3d9e10359a2f95ce71/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:08.376051 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab6eb5-cf6f-4f4a-95b1-e7d1894d1ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=551ef72112824b66865468275337a189, user_id=412ca0b568224c3d9e10359a2f95ce71, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:08.379292 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab6eb5-cf6f-4f4a-95b1-e7d1894d1ab8 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:08.401981 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1152/2312] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:57:08 2022] PUT /identity/v3/projects/551ef72112824b66865468275337a189/users/412ca0b568224c3d9e10359a2f95ce71/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:57:08.406147 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a1f1c-9b77-44fa-9f21-f563ce0b5293 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:08.417620 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a1f1c-9b77-44fa-9f21-f563ce0b5293 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:08.479203 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad1d1d-c7f5-480b-a5d1-aea46cb48aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:08.479911 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad1d1d-c7f5-480b-a5d1-aea46cb48aad admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:08.480193 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad1d1d-c7f5-480b-a5d1-aea46cb48aad admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:08.480471 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad1d1d-c7f5-480b-a5d1-aea46cb48aad admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:08.481195 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad1d1d-c7f5-480b-a5d1-aea46cb48aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:08.482843 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad1d1d-c7f5-480b-a5d1-aea46cb48aad admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:08.493526 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1161/2313] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:57:08.497983 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab6eb5-cf6f-4f4a-95b1-e7d1894d1ab8 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:08.508039 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab6eb5-cf6f-4f4a-95b1-e7d1894d1ab8 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:08.512515 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f03089-5c10-43f4-90bf-49140c590f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:08.513381 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f03089-5c10-43f4-90bf-49140c590f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:08.513662 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f03089-5c10-43f4-90bf-49140c590f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:08.513932 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f03089-5c10-43f4-90bf-49140c590f7a admin admin] PATH_INFO: `/v3/projects/551ef72112824b66865468275337a189/users/412ca0b568224c3d9e10359a2f95ce71/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:08.515894 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f03089-5c10-43f4-90bf-49140c590f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=551ef72112824b66865468275337a189, user_id=412ca0b568224c3d9e10359a2f95ce71, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:08.518636 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f03089-5c10-43f4-90bf-49140c590f7a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:08.530824 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1153/2314] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:57:08 2022] PUT /identity/v3/projects/551ef72112824b66865468275337a189/users/412ca0b568224c3d9e10359a2f95ce71/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:08.541780 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9484828-775d-403a-bbd7-143f4bd93ce4 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:08.542075 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9484828-775d-403a-bbd7-143f4bd93ce4 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:08.542356 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9484828-775d-403a-bbd7-143f4bd93ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:08.570002 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a9484828-775d-403a-bbd7-143f4bd93ce4 None None] MFA Rules not processed for user `412ca0b568224c3d9e10359a2f95ce71`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:08.571189 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a9484828-775d-403a-bbd7-143f4bd93ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:08.647485 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1162/2315] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:08.657798 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f03089-5c10-43f4-90bf-49140c590f7a admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:08.660368 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f3f03089-5c10-43f4-90bf-49140c590f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:08.714701 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f03089-5c10-43f4-90bf-49140c590f7a admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:08.719754 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb95bc6-9cd3-45a1-949e-1ebbf18d24f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:08.720732 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb95bc6-9cd3-45a1-949e-1ebbf18d24f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:08.721099 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb95bc6-9cd3-45a1-949e-1ebbf18d24f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:08.723556 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb95bc6-9cd3-45a1-949e-1ebbf18d24f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:08.732393 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb95bc6-9cd3-45a1-949e-1ebbf18d24f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:08.733876 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb95bc6-9cd3-45a1-949e-1ebbf18d24f7 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:08.744137 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1154/2316] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:57:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:57:08.773547 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9484828-775d-403a-bbd7-143f4bd93ce4 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:08.840543 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9484828-775d-403a-bbd7-143f4bd93ce4 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:08.845121 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b4758-eb6b-4ba8-8b38-ca720e0a9230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:08.845995 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b4758-eb6b-4ba8-8b38-ca720e0a9230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:08.846860 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b4758-eb6b-4ba8-8b38-ca720e0a9230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:08.847144 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b4758-eb6b-4ba8-8b38-ca720e0a9230 admin admin] PATH_INFO: `/v3/users/cb48a0d87a834975a2323070e4b024bb` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:08.848380 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b4758-eb6b-4ba8-8b38-ca720e0a9230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb48a0d87a834975a2323070e4b024bb)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:08.850707 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b4758-eb6b-4ba8-8b38-ca720e0a9230 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:08.912628 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-006b4758-eb6b-4ba8-8b38-ca720e0a9230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb48a0d87a834975a2323070e4b024bb'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:08.913299 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-006b4758-eb6b-4ba8-8b38-ca720e0a9230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb48a0d87a834975a2323070e4b024bb'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:08.920344 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-006b4758-eb6b-4ba8-8b38-ca720e0a9230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb48a0d87a834975a2323070e4b024bb'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:08.927454 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-006b4758-eb6b-4ba8-8b38-ca720e0a9230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb48a0d87a834975a2323070e4b024bb'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:08.928129 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-006b4758-eb6b-4ba8-8b38-ca720e0a9230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb48a0d87a834975a2323070e4b024bb'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:08.945164 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1163/2317] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:57:08 2022] DELETE /identity/v3/users/cb48a0d87a834975a2323070e4b024bb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:08.949647 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eccb3-1da9-46ec-9271-8cc68ad37a1e None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:08.949942 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eccb3-1da9-46ec-9271-8cc68ad37a1e None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:08.950226 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eccb3-1da9-46ec-9271-8cc68ad37a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:08.968860 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-bd6eccb3-1da9-46ec-9271-8cc68ad37a1e None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:08.970085 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-bd6eccb3-1da9-46ec-9271-8cc68ad37a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:09.028149 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1155/2318] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:09.037884 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b4758-eb6b-4ba8-8b38-ca720e0a9230 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:09.039305 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-006b4758-eb6b-4ba8-8b38-ca720e0a9230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:09.094598 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b4758-eb6b-4ba8-8b38-ca720e0a9230 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:09.098429 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad196c16-ff2e-4f4a-b3d4-f134b8396995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:09.099069 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad196c16-ff2e-4f4a-b3d4-f134b8396995 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:09.099354 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad196c16-ff2e-4f4a-b3d4-f134b8396995 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:09.099646 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad196c16-ff2e-4f4a-b3d4-f134b8396995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:09.110915 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad196c16-ff2e-4f4a-b3d4-f134b8396995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:09.112773 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad196c16-ff2e-4f4a-b3d4-f134b8396995 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:09.123199 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1164/2319] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:57:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:57:09.397038 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6eccb3-1da9-46ec-9271-8cc68ad37a1e None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:09.398544 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-bd6eccb3-1da9-46ec-9271-8cc68ad37a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:09.420278 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6eccb3-1da9-46ec-9271-8cc68ad37a1e None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:09.425399 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27b7b1-3667-4e91-92b1-ee57deda280b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:09.426723 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27b7b1-3667-4e91-92b1-ee57deda280b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:09.427018 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27b7b1-3667-4e91-92b1-ee57deda280b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:09.427466 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27b7b1-3667-4e91-92b1-ee57deda280b admin admin] PATH_INFO: `/v3/projects/59a0b12e492d4ec5bdf3f3da08433abe` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:09.428716 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27b7b1-3667-4e91-92b1-ee57deda280b admin admin] RBAC: Authorizing `identity:delete_project(project_id=59a0b12e492d4ec5bdf3f3da08433abe)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:09.430640 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27b7b1-3667-4e91-92b1-ee57deda280b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:09.475119 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5b27b7b1-3667-4e91-92b1-ee57deda280b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59a0b12e492d4ec5bdf3f3da08433abe', 'request_id': 'req-5b27b7b1-3667-4e91-92b1-ee57deda280b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:09.481913 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5b27b7b1-3667-4e91-92b1-ee57deda280b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59a0b12e492d4ec5bdf3f3da08433abe', 'request_id': 'req-5b27b7b1-3667-4e91-92b1-ee57deda280b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:09.487927 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5b27b7b1-3667-4e91-92b1-ee57deda280b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59a0b12e492d4ec5bdf3f3da08433abe', 'request_id': 'req-5b27b7b1-3667-4e91-92b1-ee57deda280b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:09.499287 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5b27b7b1-3667-4e91-92b1-ee57deda280b admin admin] The token cache is being invalidate because project 59a0b12e492d4ec5bdf3f3da08433abe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:57:09.499598 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5b27b7b1-3667-4e91-92b1-ee57deda280b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:09.500283 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-5b27b7b1-3667-4e91-92b1-ee57deda280b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:09.501865 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1156/2320] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:57:09 2022] DELETE /identity/v3/projects/59a0b12e492d4ec5bdf3f3da08433abe => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:09.506446 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad196c16-ff2e-4f4a-b3d4-f134b8396995 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:09.515878 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad196c16-ff2e-4f4a-b3d4-f134b8396995 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:09.582693 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0785e3-80a5-4fd7-9a2e-ac38cd25b1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:09.583571 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0785e3-80a5-4fd7-9a2e-ac38cd25b1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:09.583883 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0785e3-80a5-4fd7-9a2e-ac38cd25b1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:09.584155 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0785e3-80a5-4fd7-9a2e-ac38cd25b1b4 admin admin] PATH_INFO: `/v3/users/412ca0b568224c3d9e10359a2f95ce71` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:09.585331 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0785e3-80a5-4fd7-9a2e-ac38cd25b1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=412ca0b568224c3d9e10359a2f95ce71)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:09.587255 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0785e3-80a5-4fd7-9a2e-ac38cd25b1b4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:09.630520 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2e0785e3-80a5-4fd7-9a2e-ac38cd25b1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '412ca0b568224c3d9e10359a2f95ce71'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:09.631164 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2e0785e3-80a5-4fd7-9a2e-ac38cd25b1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '412ca0b568224c3d9e10359a2f95ce71'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:09.637644 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2e0785e3-80a5-4fd7-9a2e-ac38cd25b1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '412ca0b568224c3d9e10359a2f95ce71'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:09.644747 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2e0785e3-80a5-4fd7-9a2e-ac38cd25b1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '412ca0b568224c3d9e10359a2f95ce71'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:09.645434 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-2e0785e3-80a5-4fd7-9a2e-ac38cd25b1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '412ca0b568224c3d9e10359a2f95ce71'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:09.662123 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1165/2321] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:57:09 2022] DELETE /identity/v3/users/412ca0b568224c3d9e10359a2f95ce71 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:10.231002 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27b7b1-3667-4e91-92b1-ee57deda280b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:10.232457 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5b27b7b1-3667-4e91-92b1-ee57deda280b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:10.245736 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27b7b1-3667-4e91-92b1-ee57deda280b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:10.304327 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58403c40-456b-45a8-bcd4-a92dae33f103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:10.305190 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58403c40-456b-45a8-bcd4-a92dae33f103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:10.305466 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58403c40-456b-45a8-bcd4-a92dae33f103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:10.305735 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58403c40-456b-45a8-bcd4-a92dae33f103 admin admin] PATH_INFO: `/v3/projects/551ef72112824b66865468275337a189` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:10.306963 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58403c40-456b-45a8-bcd4-a92dae33f103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=551ef72112824b66865468275337a189)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:10.308916 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58403c40-456b-45a8-bcd4-a92dae33f103 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:10.355232 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-58403c40-456b-45a8-bcd4-a92dae33f103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '551ef72112824b66865468275337a189', 'request_id': 'req-58403c40-456b-45a8-bcd4-a92dae33f103'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:10.362504 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-58403c40-456b-45a8-bcd4-a92dae33f103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '551ef72112824b66865468275337a189', 'request_id': 'req-58403c40-456b-45a8-bcd4-a92dae33f103'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:10.368156 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-58403c40-456b-45a8-bcd4-a92dae33f103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '551ef72112824b66865468275337a189', 'request_id': 'req-58403c40-456b-45a8-bcd4-a92dae33f103'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:10.381398 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-58403c40-456b-45a8-bcd4-a92dae33f103 admin admin] The token cache is being invalidate because project 551ef72112824b66865468275337a189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:57:10.381752 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-58403c40-456b-45a8-bcd4-a92dae33f103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:10.382642 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-58403c40-456b-45a8-bcd4-a92dae33f103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:10.384973 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1157/2322] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:57:10 2022] DELETE /identity/v3/projects/551ef72112824b66865468275337a189 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:10.390313 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2c7a4-2bef-4eda-be57-911a165c1abf None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:10.390599 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2c7a4-2bef-4eda-be57-911a165c1abf None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:10.390877 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2c7a4-2bef-4eda-be57-911a165c1abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:10.409600 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a6a2c7a4-2bef-4eda-be57-911a165c1abf None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:10.410789 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a6a2c7a4-2bef-4eda-be57-911a165c1abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:10.467009 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1166/2323] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:10.476253 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c880932-bc18-4ed0-858a-227fd7de8a68 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:10.476538 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c880932-bc18-4ed0-858a-227fd7de8a68 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:10.476810 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c880932-bc18-4ed0-858a-227fd7de8a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:10.495071 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-5c880932-bc18-4ed0-858a-227fd7de8a68 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:10.496303 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5c880932-bc18-4ed0-858a-227fd7de8a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:10.504233 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1158/2324] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:10.508421 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2c7a4-2bef-4eda-be57-911a165c1abf None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:10.518293 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2c7a4-2bef-4eda-be57-911a165c1abf None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:10.522885 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb8faf-1e42-40db-8a49-e8ae5a70299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:10.523599 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb8faf-1e42-40db-8a49-e8ae5a70299a admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:10.523914 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb8faf-1e42-40db-8a49-e8ae5a70299a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:10.524254 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb8faf-1e42-40db-8a49-e8ae5a70299a admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:10.525018 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb8faf-1e42-40db-8a49-e8ae5a70299a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:57:10.525351 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb8faf-1e42-40db-8a49-e8ae5a70299a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:10.526995 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb8faf-1e42-40db-8a49-e8ae5a70299a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:10.541072 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1167/2325] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:57:10.545492 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c880932-bc18-4ed0-858a-227fd7de8a68 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:10.555563 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c880932-bc18-4ed0-858a-227fd7de8a68 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:10.560136 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44f745-dee0-45c4-9a5b-6f0cc9b25ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:10.560781 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44f745-dee0-45c4-9a5b-6f0cc9b25ded admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:10.561062 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44f745-dee0-45c4-9a5b-6f0cc9b25ded admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:10.561335 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44f745-dee0-45c4-9a5b-6f0cc9b25ded admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:10.562032 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44f745-dee0-45c4-9a5b-6f0cc9b25ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:10.563994 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44f745-dee0-45c4-9a5b-6f0cc9b25ded admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:10.587676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1159/2326] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:57:10 2022] POST /identity/v3/projects => generated 401 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:57:10.591572 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb8faf-1e42-40db-8a49-e8ae5a70299a admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:10.601995 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb8faf-1e42-40db-8a49-e8ae5a70299a admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:10.659551 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcf11e-738b-4874-af41-703bd7ba43a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:10.660406 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcf11e-738b-4874-af41-703bd7ba43a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:10.660694 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcf11e-738b-4874-af41-703bd7ba43a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:10.660967 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcf11e-738b-4874-af41-703bd7ba43a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:10.661656 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcf11e-738b-4874-af41-703bd7ba43a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:10.663546 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcf11e-738b-4874-af41-703bd7ba43a5 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:10.683952 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1168/2327] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:57:10 2022] POST /identity/v3/users => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:57:10.687944 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44f745-dee0-45c4-9a5b-6f0cc9b25ded admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:10.698982 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44f745-dee0-45c4-9a5b-6f0cc9b25ded admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:10.703520 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c62d0-5763-4162-a5d2-d8cb95a42fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:10.704208 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c62d0-5763-4162-a5d2-d8cb95a42fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:10.704486 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c62d0-5763-4162-a5d2-d8cb95a42fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:10.704774 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c62d0-5763-4162-a5d2-d8cb95a42fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:10.705609 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c62d0-5763-4162-a5d2-d8cb95a42fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:10.707578 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c62d0-5763-4162-a5d2-d8cb95a42fb8 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:10.717575 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1160/2328] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:57:10.722207 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcf11e-738b-4874-af41-703bd7ba43a5 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:10.731986 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcf11e-738b-4874-af41-703bd7ba43a5 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:10.736540 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a4257-c7b7-444b-a151-306e44dd12d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:10.737815 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4257-c7b7-444b-a151-306e44dd12d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:10.738095 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4257-c7b7-444b-a151-306e44dd12d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:10.738368 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4257-c7b7-444b-a151-306e44dd12d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:10.739086 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a4257-c7b7-444b-a151-306e44dd12d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:10.740701 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a4257-c7b7-444b-a151-306e44dd12d4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:10.750451 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1169/2329] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:57:10.754639 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c62d0-5763-4162-a5d2-d8cb95a42fb8 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:10.764252 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c62d0-5763-4162-a5d2-d8cb95a42fb8 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:10.768976 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf8561-d838-4b29-af69-0240a0a757df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:10.769842 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf8561-d838-4b29-af69-0240a0a757df admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:10.770116 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf8561-d838-4b29-af69-0240a0a757df admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:10.770383 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf8561-d838-4b29-af69-0240a0a757df admin admin] PATH_INFO: `/v3/projects/039933c40b7a47c787abc7493fef9cae/users/d128fe5a50fb45e4b290fe6e5bc77439/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:10.785143 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf8561-d838-4b29-af69-0240a0a757df admin admin] RBAC: Authorizing `identity:create_grant(project_id=039933c40b7a47c787abc7493fef9cae, user_id=d128fe5a50fb45e4b290fe6e5bc77439, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:10.787867 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf8561-d838-4b29-af69-0240a0a757df admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:10.801848 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1161/2330] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:57:10 2022] PUT /identity/v3/projects/039933c40b7a47c787abc7493fef9cae/users/d128fe5a50fb45e4b290fe6e5bc77439/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:10.812193 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaac8ac-fc6c-4372-9aaa-8803dc02ec49 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:10.812425 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaac8ac-fc6c-4372-9aaa-8803dc02ec49 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:10.812722 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaac8ac-fc6c-4372-9aaa-8803dc02ec49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:10.839195 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7aaac8ac-fc6c-4372-9aaa-8803dc02ec49 None None] MFA Rules not processed for user `d128fe5a50fb45e4b290fe6e5bc77439`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:10.840889 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7aaac8ac-fc6c-4372-9aaa-8803dc02ec49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:10.906834 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1170/2331] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:10.912426 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf8561-d838-4b29-af69-0240a0a757df admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:10.972835 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf8561-d838-4b29-af69-0240a0a757df admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:10.978319 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636002cc-75e7-4922-ae75-c49f9eed6142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:10.979161 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636002cc-75e7-4922-ae75-c49f9eed6142 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:10.979445 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636002cc-75e7-4922-ae75-c49f9eed6142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:10.979740 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636002cc-75e7-4922-ae75-c49f9eed6142 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:10.980426 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636002cc-75e7-4922-ae75-c49f9eed6142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:10.982339 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636002cc-75e7-4922-ae75-c49f9eed6142 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:11.013000 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1162/2332] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:57:10 2022] POST /identity/v3/projects => generated 401 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:57:11.015202 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaac8ac-fc6c-4372-9aaa-8803dc02ec49 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:11.028591 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaac8ac-fc6c-4372-9aaa-8803dc02ec49 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:11.083471 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06258115-ccf1-4b37-86c4-f50161b08165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:11.084097 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06258115-ccf1-4b37-86c4-f50161b08165 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:11.084382 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06258115-ccf1-4b37-86c4-f50161b08165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:11.084661 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06258115-ccf1-4b37-86c4-f50161b08165 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:11.085362 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06258115-ccf1-4b37-86c4-f50161b08165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:11.087358 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06258115-ccf1-4b37-86c4-f50161b08165 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:11.109256 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1171/2333] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:57:11 2022] POST /identity/v3/users => generated 307 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:57:11.113304 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636002cc-75e7-4922-ae75-c49f9eed6142 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:11.123396 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636002cc-75e7-4922-ae75-c49f9eed6142 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:11.128079 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557d8bb-d6d9-45e6-8915-cd943ef9ae4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:11.130209 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557d8bb-d6d9-45e6-8915-cd943ef9ae4e admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:11.130579 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557d8bb-d6d9-45e6-8915-cd943ef9ae4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:11.130868 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557d8bb-d6d9-45e6-8915-cd943ef9ae4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:11.131680 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557d8bb-d6d9-45e6-8915-cd943ef9ae4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:11.133574 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557d8bb-d6d9-45e6-8915-cd943ef9ae4e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:11.146303 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1163/2334] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:57:11.150457 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06258115-ccf1-4b37-86c4-f50161b08165 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:11.161372 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06258115-ccf1-4b37-86c4-f50161b08165 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:11.171943 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7d26a-d2b6-4d30-9b48-476197859e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:11.172850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7d26a-d2b6-4d30-9b48-476197859e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:11.173129 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7d26a-d2b6-4d30-9b48-476197859e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:11.173406 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7d26a-d2b6-4d30-9b48-476197859e6e admin admin] PATH_INFO: `/v3/projects/1cc1de439fb74d01a78fbb4e440d9378/users/b682eaca4dfe433586a7153366205ae4/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:11.188528 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7d26a-d2b6-4d30-9b48-476197859e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc1de439fb74d01a78fbb4e440d9378, user_id=b682eaca4dfe433586a7153366205ae4, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:11.192115 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7d26a-d2b6-4d30-9b48-476197859e6e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:11.206278 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1172/2335] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:57:11 2022] PUT /identity/v3/projects/1cc1de439fb74d01a78fbb4e440d9378/users/b682eaca4dfe433586a7153366205ae4/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:11.210010 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557d8bb-d6d9-45e6-8915-cd943ef9ae4e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:11.220337 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557d8bb-d6d9-45e6-8915-cd943ef9ae4e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:11.284349 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e800e-d07e-4cc5-8c72-7b6b93a59f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:11.285028 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e800e-d07e-4cc5-8c72-7b6b93a59f5e admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:11.285312 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e800e-d07e-4cc5-8c72-7b6b93a59f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:11.285587 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e800e-d07e-4cc5-8c72-7b6b93a59f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:11.286318 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e800e-d07e-4cc5-8c72-7b6b93a59f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:11.288140 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e800e-d07e-4cc5-8c72-7b6b93a59f5e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:11.298603 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1164/2336] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:57:11.302569 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7d26a-d2b6-4d30-9b48-476197859e6e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:11.312580 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7d26a-d2b6-4d30-9b48-476197859e6e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:11.317870 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78af41-02a0-404d-b2c3-0ba271d4c2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:11.318755 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78af41-02a0-404d-b2c3-0ba271d4c2bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:11.319038 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78af41-02a0-404d-b2c3-0ba271d4c2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:11.319317 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78af41-02a0-404d-b2c3-0ba271d4c2bd admin admin] PATH_INFO: `/v3/projects/1cc1de439fb74d01a78fbb4e440d9378/users/b682eaca4dfe433586a7153366205ae4/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:11.321299 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78af41-02a0-404d-b2c3-0ba271d4c2bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc1de439fb74d01a78fbb4e440d9378, user_id=b682eaca4dfe433586a7153366205ae4, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:11.323977 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78af41-02a0-404d-b2c3-0ba271d4c2bd admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:11.334677 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1173/2337] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:57:11 2022] PUT /identity/v3/projects/1cc1de439fb74d01a78fbb4e440d9378/users/b682eaca4dfe433586a7153366205ae4/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:11.344691 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d97cb6-4859-4a0d-8c47-5ac780537c05 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:11.344987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d97cb6-4859-4a0d-8c47-5ac780537c05 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:11.345270 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d97cb6-4859-4a0d-8c47-5ac780537c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:11.375921 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b8d97cb6-4859-4a0d-8c47-5ac780537c05 None None] MFA Rules not processed for user `b682eaca4dfe433586a7153366205ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:11.375921 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b8d97cb6-4859-4a0d-8c47-5ac780537c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:11.446141 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1165/2338] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:11 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:11.457242 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78af41-02a0-404d-b2c3-0ba271d4c2bd admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:11.458930 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-cb78af41-02a0-404d-b2c3-0ba271d4c2bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:11.513655 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78af41-02a0-404d-b2c3-0ba271d4c2bd admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:11.517379 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c96536-67c0-4bb7-912d-caf8dfee124d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:11.518682 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c96536-67c0-4bb7-912d-caf8dfee124d service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:11.519115 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c96536-67c0-4bb7-912d-caf8dfee124d service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:11.519696 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c96536-67c0-4bb7-912d-caf8dfee124d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:11.528434 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c96536-67c0-4bb7-912d-caf8dfee124d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:11.529862 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c96536-67c0-4bb7-912d-caf8dfee124d service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:11.539150 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1174/2339] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:57:11 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:57:11.626794 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d97cb6-4859-4a0d-8c47-5ac780537c05 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:11.637047 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d97cb6-4859-4a0d-8c47-5ac780537c05 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:11.640670 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd5865-a215-4459-9a6d-e259eef41d7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:11.641311 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5865-a215-4459-9a6d-e259eef41d7c service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:11.641622 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5865-a215-4459-9a6d-e259eef41d7c service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:11.641899 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5865-a215-4459-9a6d-e259eef41d7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:11.696767 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd5865-a215-4459-9a6d-e259eef41d7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:11.698202 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd5865-a215-4459-9a6d-e259eef41d7c service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:11.706922 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1166/2340] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:57:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:57:15.886634 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c96536-67c0-4bb7-912d-caf8dfee124d service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:15.951530 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c96536-67c0-4bb7-912d-caf8dfee124d service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:15.956149 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f336d-6138-44bb-a878-59ed5fdbdb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:15.957164 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f336d-6138-44bb-a878-59ed5fdbdb30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:15.957718 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f336d-6138-44bb-a878-59ed5fdbdb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:15.958275 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f336d-6138-44bb-a878-59ed5fdbdb30 admin admin] PATH_INFO: `/v3/users/d128fe5a50fb45e4b290fe6e5bc77439` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:15.959985 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f336d-6138-44bb-a878-59ed5fdbdb30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d128fe5a50fb45e4b290fe6e5bc77439)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:15.961982 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f336d-6138-44bb-a878-59ed5fdbdb30 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:16.011965 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d57f336d-6138-44bb-a878-59ed5fdbdb30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd128fe5a50fb45e4b290fe6e5bc77439'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:16.012640 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d57f336d-6138-44bb-a878-59ed5fdbdb30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd128fe5a50fb45e4b290fe6e5bc77439'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:16.019411 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d57f336d-6138-44bb-a878-59ed5fdbdb30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd128fe5a50fb45e4b290fe6e5bc77439'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:16.026871 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d57f336d-6138-44bb-a878-59ed5fdbdb30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd128fe5a50fb45e4b290fe6e5bc77439'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:16.027473 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d57f336d-6138-44bb-a878-59ed5fdbdb30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd128fe5a50fb45e4b290fe6e5bc77439'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:16.044880 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1175/2341] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:57:15 2022] DELETE /identity/v3/users/d128fe5a50fb45e4b290fe6e5bc77439 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:16.049332 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b96255-aea2-4b91-9de0-f3f9dc7ed134 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:16.049779 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b96255-aea2-4b91-9de0-f3f9dc7ed134 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:16.049920 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b96255-aea2-4b91-9de0-f3f9dc7ed134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:16.066356 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-34b96255-aea2-4b91-9de0-f3f9dc7ed134 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:16.067555 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-34b96255-aea2-4b91-9de0-f3f9dc7ed134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:16.125997 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1167/2342] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:16.135766 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f336d-6138-44bb-a878-59ed5fdbdb30 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:16.137578 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d57f336d-6138-44bb-a878-59ed5fdbdb30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:16.193325 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f336d-6138-44bb-a878-59ed5fdbdb30 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:16.197364 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4375112-617a-42ac-a498-0a69e8c5a5a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:16.198096 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4375112-617a-42ac-a498-0a69e8c5a5a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:16.198412 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4375112-617a-42ac-a498-0a69e8c5a5a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:16.198666 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4375112-617a-42ac-a498-0a69e8c5a5a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:16.209713 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4375112-617a-42ac-a498-0a69e8c5a5a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:16.211160 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4375112-617a-42ac-a498-0a69e8c5a5a6 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:16.221172 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1176/2343] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:57:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:57:16.499519 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b96255-aea2-4b91-9de0-f3f9dc7ed134 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:16.500981 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-34b96255-aea2-4b91-9de0-f3f9dc7ed134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:16.513347 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b96255-aea2-4b91-9de0-f3f9dc7ed134 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:16.518056 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd33a14-87c8-4b55-bd03-b43047887d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:16.519135 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd33a14-87c8-4b55-bd03-b43047887d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:16.519425 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd33a14-87c8-4b55-bd03-b43047887d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:16.520334 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd33a14-87c8-4b55-bd03-b43047887d13 admin admin] PATH_INFO: `/v3/projects/039933c40b7a47c787abc7493fef9cae` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:16.521779 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd33a14-87c8-4b55-bd03-b43047887d13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=039933c40b7a47c787abc7493fef9cae)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:16.523861 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd33a14-87c8-4b55-bd03-b43047887d13 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:16.574837 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3fd33a14-87c8-4b55-bd03-b43047887d13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '039933c40b7a47c787abc7493fef9cae', 'request_id': 'req-3fd33a14-87c8-4b55-bd03-b43047887d13'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:16.583638 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3fd33a14-87c8-4b55-bd03-b43047887d13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '039933c40b7a47c787abc7493fef9cae', 'request_id': 'req-3fd33a14-87c8-4b55-bd03-b43047887d13'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:16.589066 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3fd33a14-87c8-4b55-bd03-b43047887d13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '039933c40b7a47c787abc7493fef9cae', 'request_id': 'req-3fd33a14-87c8-4b55-bd03-b43047887d13'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:16.600061 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3fd33a14-87c8-4b55-bd03-b43047887d13 admin admin] The token cache is being invalidate because project 039933c40b7a47c787abc7493fef9cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:57:16.600352 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3fd33a14-87c8-4b55-bd03-b43047887d13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:16.600984 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-3fd33a14-87c8-4b55-bd03-b43047887d13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:16.602535 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1168/2344] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:57:16 2022] DELETE /identity/v3/projects/039933c40b7a47c787abc7493fef9cae => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:16.606655 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4375112-617a-42ac-a498-0a69e8c5a5a6 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:16.616703 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4375112-617a-42ac-a498-0a69e8c5a5a6 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:16.677985 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa506f2-1054-4f71-b792-49de28381971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:16.677985 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa506f2-1054-4f71-b792-49de28381971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:16.677985 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa506f2-1054-4f71-b792-49de28381971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:16.677985 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa506f2-1054-4f71-b792-49de28381971 admin admin] PATH_INFO: `/v3/users/b682eaca4dfe433586a7153366205ae4` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:16.678347 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa506f2-1054-4f71-b792-49de28381971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b682eaca4dfe433586a7153366205ae4)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:16.678347 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa506f2-1054-4f71-b792-49de28381971 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:16.728979 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-baa506f2-1054-4f71-b792-49de28381971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b682eaca4dfe433586a7153366205ae4'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:16.729706 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-baa506f2-1054-4f71-b792-49de28381971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b682eaca4dfe433586a7153366205ae4'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:16.737275 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-baa506f2-1054-4f71-b792-49de28381971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b682eaca4dfe433586a7153366205ae4'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:16.745023 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-baa506f2-1054-4f71-b792-49de28381971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b682eaca4dfe433586a7153366205ae4'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:16.745638 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-baa506f2-1054-4f71-b792-49de28381971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b682eaca4dfe433586a7153366205ae4'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:16.762456 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1177/2345] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:57:16 2022] DELETE /identity/v3/users/b682eaca4dfe433586a7153366205ae4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:17.035774 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd33a14-87c8-4b55-bd03-b43047887d13 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:17.037875 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3fd33a14-87c8-4b55-bd03-b43047887d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:17.051673 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd33a14-87c8-4b55-bd03-b43047887d13 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:17.116477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8c426-211f-4805-ae80-7970308c5968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:17.117392 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8c426-211f-4805-ae80-7970308c5968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:17.118189 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8c426-211f-4805-ae80-7970308c5968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:17.118653 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8c426-211f-4805-ae80-7970308c5968 admin admin] PATH_INFO: `/v3/projects/1cc1de439fb74d01a78fbb4e440d9378` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:17.119905 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8c426-211f-4805-ae80-7970308c5968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc1de439fb74d01a78fbb4e440d9378)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:17.121915 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8c426-211f-4805-ae80-7970308c5968 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:17.171095 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f2d8c426-211f-4805-ae80-7970308c5968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc1de439fb74d01a78fbb4e440d9378', 'request_id': 'req-f2d8c426-211f-4805-ae80-7970308c5968'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:17.179750 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f2d8c426-211f-4805-ae80-7970308c5968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc1de439fb74d01a78fbb4e440d9378', 'request_id': 'req-f2d8c426-211f-4805-ae80-7970308c5968'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:17.185325 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f2d8c426-211f-4805-ae80-7970308c5968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc1de439fb74d01a78fbb4e440d9378', 'request_id': 'req-f2d8c426-211f-4805-ae80-7970308c5968'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:17.196736 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f2d8c426-211f-4805-ae80-7970308c5968 admin admin] The token cache is being invalidate because project 1cc1de439fb74d01a78fbb4e440d9378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:57:17.197027 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f2d8c426-211f-4805-ae80-7970308c5968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:17.197743 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f2d8c426-211f-4805-ae80-7970308c5968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:17.199493 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1169/2346] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:57:17 2022] DELETE /identity/v3/projects/1cc1de439fb74d01a78fbb4e440d9378 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:17.204782 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87edef-34c9-461f-a19d-70639e5cd27b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:17.205292 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87edef-34c9-461f-a19d-70639e5cd27b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:17.205555 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87edef-34c9-461f-a19d-70639e5cd27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:17.227453 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-cc87edef-34c9-461f-a19d-70639e5cd27b None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:17.228702 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-cc87edef-34c9-461f-a19d-70639e5cd27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:17.285679 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1178/2347] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:57:17.294690 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5647c24-a539-4072-84d2-9025083c4f40 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:17.294983 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5647c24-a539-4072-84d2-9025083c4f40 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:17.295261 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5647c24-a539-4072-84d2-9025083c4f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:17.313712 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-f5647c24-a539-4072-84d2-9025083c4f40 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:17.314916 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f5647c24-a539-4072-84d2-9025083c4f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:17.323060 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1170/2348] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:17.327145 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87edef-34c9-461f-a19d-70639e5cd27b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:17.336927 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87edef-34c9-461f-a19d-70639e5cd27b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:17.341498 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7a99e-8333-4a2f-b211-94bf4249ef10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:17.342149 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7a99e-8333-4a2f-b211-94bf4249ef10 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:17.342432 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7a99e-8333-4a2f-b211-94bf4249ef10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:17.342708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7a99e-8333-4a2f-b211-94bf4249ef10 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:17.343447 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7a99e-8333-4a2f-b211-94bf4249ef10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:57:17.343799 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7a99e-8333-4a2f-b211-94bf4249ef10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:17.345403 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7a99e-8333-4a2f-b211-94bf4249ef10 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:17.357667 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1179/2349] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:57:17.362107 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5647c24-a539-4072-84d2-9025083c4f40 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:17.372072 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5647c24-a539-4072-84d2-9025083c4f40 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:17.376734 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9d2ea-1885-4242-90a9-6f802becf08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:17.377382 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9d2ea-1885-4242-90a9-6f802becf08c admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:17.377663 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9d2ea-1885-4242-90a9-6f802becf08c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:17.383348 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9d2ea-1885-4242-90a9-6f802becf08c admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:17.384104 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9d2ea-1885-4242-90a9-6f802becf08c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:17.386365 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9d2ea-1885-4242-90a9-6f802becf08c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:17.415083 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1171/2350] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:57:17 2022] POST /identity/v3/projects => generated 407 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:57:17.419228 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7a99e-8333-4a2f-b211-94bf4249ef10 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:17.429892 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7a99e-8333-4a2f-b211-94bf4249ef10 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:17.485570 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbab15b-4b5c-4286-92da-d3a48868d454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:17.486242 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbab15b-4b5c-4286-92da-d3a48868d454 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:17.486527 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbab15b-4b5c-4286-92da-d3a48868d454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:17.486804 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbab15b-4b5c-4286-92da-d3a48868d454 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:17.487501 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbab15b-4b5c-4286-92da-d3a48868d454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:17.490052 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbab15b-4b5c-4286-92da-d3a48868d454 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:17.508782 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1180/2351] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:57:17 2022] POST /identity/v3/users => generated 304 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:57:17.513022 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9d2ea-1885-4242-90a9-6f802becf08c admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:17.523554 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9d2ea-1885-4242-90a9-6f802becf08c admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:17.528108 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0359-1ba7-4449-bfde-f709a0abd614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:17.528756 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0359-1ba7-4449-bfde-f709a0abd614 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:17.529039 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0359-1ba7-4449-bfde-f709a0abd614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:17.529310 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0359-1ba7-4449-bfde-f709a0abd614 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:17.530224 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e0359-1ba7-4449-bfde-f709a0abd614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:17.531835 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e0359-1ba7-4449-bfde-f709a0abd614 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:17.542340 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1172/2352] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:57:17.546576 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbab15b-4b5c-4286-92da-d3a48868d454 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:17.557825 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbab15b-4b5c-4286-92da-d3a48868d454 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:17.562686 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1988df8-a75d-47a5-9b25-77da7ba11267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:17.563365 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1988df8-a75d-47a5-9b25-77da7ba11267 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:17.563674 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1988df8-a75d-47a5-9b25-77da7ba11267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:17.563953 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1988df8-a75d-47a5-9b25-77da7ba11267 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:17.564688 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1988df8-a75d-47a5-9b25-77da7ba11267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:17.566288 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1988df8-a75d-47a5-9b25-77da7ba11267 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:17.576780 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1181/2353] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:57:17.580775 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0359-1ba7-4449-bfde-f709a0abd614 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:17.590982 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0359-1ba7-4449-bfde-f709a0abd614 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:17.595500 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c98e7-ebbb-4af2-a102-7e2c4a47aa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:17.596393 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c98e7-ebbb-4af2-a102-7e2c4a47aa60 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:17.596670 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c98e7-ebbb-4af2-a102-7e2c4a47aa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:17.596937 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c98e7-ebbb-4af2-a102-7e2c4a47aa60 admin admin] PATH_INFO: `/v3/projects/4b227e902fbf49c690dc04674cbb31f4/users/80878fb3fcdf4535b1477ec6562b5b1a/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:17.611188 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c98e7-ebbb-4af2-a102-7e2c4a47aa60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b227e902fbf49c690dc04674cbb31f4, user_id=80878fb3fcdf4535b1477ec6562b5b1a, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:17.613840 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c98e7-ebbb-4af2-a102-7e2c4a47aa60 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:17.626856 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1173/2354] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:57:17 2022] PUT /identity/v3/projects/4b227e902fbf49c690dc04674cbb31f4/users/80878fb3fcdf4535b1477ec6562b5b1a/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:17.637084 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e2bf5-e9ee-414b-983c-813e9a95d155 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:17.637426 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e2bf5-e9ee-414b-983c-813e9a95d155 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:17.637711 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e2bf5-e9ee-414b-983c-813e9a95d155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:17.664175 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-312e2bf5-e9ee-414b-983c-813e9a95d155 None None] MFA Rules not processed for user `80878fb3fcdf4535b1477ec6562b5b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:17.665379 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-312e2bf5-e9ee-414b-983c-813e9a95d155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:17.735023 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1182/2355] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:17 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:57:17.739825 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c98e7-ebbb-4af2-a102-7e2c4a47aa60 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:17.800102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c98e7-ebbb-4af2-a102-7e2c4a47aa60 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:17.805537 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058b45d-c264-4eb1-a285-ae9b37bc1ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:17.806227 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058b45d-c264-4eb1-a285-ae9b37bc1ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:17.806516 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058b45d-c264-4eb1-a285-ae9b37bc1ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:17.806787 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058b45d-c264-4eb1-a285-ae9b37bc1ee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:17.807475 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058b45d-c264-4eb1-a285-ae9b37bc1ee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:17.809430 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058b45d-c264-4eb1-a285-ae9b37bc1ee6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:17.835181 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1174/2356] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:57:17 2022] POST /identity/v3/projects => generated 409 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:57:17.839149 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e2bf5-e9ee-414b-983c-813e9a95d155 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:17.850871 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e2bf5-e9ee-414b-983c-813e9a95d155 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:17.906775 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d33da-d00e-4026-b2ea-adb263acccec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:17.907452 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d33da-d00e-4026-b2ea-adb263acccec admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:17.907839 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d33da-d00e-4026-b2ea-adb263acccec admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:17.908122 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d33da-d00e-4026-b2ea-adb263acccec admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:17.908809 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d33da-d00e-4026-b2ea-adb263acccec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:17.910771 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d33da-d00e-4026-b2ea-adb263acccec admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:17.930375 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1183/2357] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:57:17 2022] POST /identity/v3/users => generated 311 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:57:17.934372 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058b45d-c264-4eb1-a285-ae9b37bc1ee6 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:17.944315 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058b45d-c264-4eb1-a285-ae9b37bc1ee6 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:17.949140 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92cc091-ed67-4810-8655-15e1f082d554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:17.949793 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cc091-ed67-4810-8655-15e1f082d554 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:17.950075 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cc091-ed67-4810-8655-15e1f082d554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:17.950350 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cc091-ed67-4810-8655-15e1f082d554 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:17.951075 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92cc091-ed67-4810-8655-15e1f082d554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:17.952727 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92cc091-ed67-4810-8655-15e1f082d554 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:17.963285 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1175/2358] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:57:17.967447 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d33da-d00e-4026-b2ea-adb263acccec admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:17.977914 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d33da-d00e-4026-b2ea-adb263acccec admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:17.982454 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e3f17-2643-4f9e-8538-f0f1d5bbd932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:17.983320 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e3f17-2643-4f9e-8538-f0f1d5bbd932 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:17.983602 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e3f17-2643-4f9e-8538-f0f1d5bbd932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:17.983910 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e3f17-2643-4f9e-8538-f0f1d5bbd932 admin admin] PATH_INFO: `/v3/projects/29d972177a044a2697246fb4d8e0a95b/users/7011c7dea00b4cdaa887573466694ce7/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:17.998541 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e3f17-2643-4f9e-8538-f0f1d5bbd932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29d972177a044a2697246fb4d8e0a95b, user_id=7011c7dea00b4cdaa887573466694ce7, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:18.001214 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e3f17-2643-4f9e-8538-f0f1d5bbd932 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:18.013771 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1184/2359] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:57:17 2022] PUT /identity/v3/projects/29d972177a044a2697246fb4d8e0a95b/users/7011c7dea00b4cdaa887573466694ce7/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:57:18.017985 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92cc091-ed67-4810-8655-15e1f082d554 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:18.029266 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92cc091-ed67-4810-8655-15e1f082d554 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:18.088379 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf71832-b348-4c69-bfda-5d68fd3fac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:18.089070 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf71832-b348-4c69-bfda-5d68fd3fac1b admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:18.089339 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf71832-b348-4c69-bfda-5d68fd3fac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:18.089619 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf71832-b348-4c69-bfda-5d68fd3fac1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:18.090344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf71832-b348-4c69-bfda-5d68fd3fac1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:18.091973 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf71832-b348-4c69-bfda-5d68fd3fac1b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:18.101917 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1176/2360] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:57:18.106041 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e3f17-2643-4f9e-8538-f0f1d5bbd932 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:18.117223 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e3f17-2643-4f9e-8538-f0f1d5bbd932 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:18.121875 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ad6f4-d617-4991-9274-d5e8ebc385b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:18.122747 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ad6f4-d617-4991-9274-d5e8ebc385b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:18.123031 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ad6f4-d617-4991-9274-d5e8ebc385b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:18.123305 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ad6f4-d617-4991-9274-d5e8ebc385b6 admin admin] PATH_INFO: `/v3/projects/29d972177a044a2697246fb4d8e0a95b/users/7011c7dea00b4cdaa887573466694ce7/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:18.125277 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ad6f4-d617-4991-9274-d5e8ebc385b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29d972177a044a2697246fb4d8e0a95b, user_id=7011c7dea00b4cdaa887573466694ce7, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:18.127941 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ad6f4-d617-4991-9274-d5e8ebc385b6 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:18.138586 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1185/2361] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:57:18 2022] PUT /identity/v3/projects/29d972177a044a2697246fb4d8e0a95b/users/7011c7dea00b4cdaa887573466694ce7/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:18.149737 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a9213-f8d5-471d-b2de-01f801f289b9 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:18.150025 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a9213-f8d5-471d-b2de-01f801f289b9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:18.150319 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a9213-f8d5-471d-b2de-01f801f289b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:18.181341 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e45a9213-f8d5-471d-b2de-01f801f289b9 None None] MFA Rules not processed for user `7011c7dea00b4cdaa887573466694ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:18.182567 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e45a9213-f8d5-471d-b2de-01f801f289b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:18.248152 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1177/2362] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:18 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:18.258833 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ad6f4-d617-4991-9274-d5e8ebc385b6 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:18.260627 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a65ad6f4-d617-4991-9274-d5e8ebc385b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:18.319367 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ad6f4-d617-4991-9274-d5e8ebc385b6 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:18.323020 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63820086-4ec8-48fe-9bb9-d45a2d318f23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:18.323733 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63820086-4ec8-48fe-9bb9-d45a2d318f23 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:18.324048 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63820086-4ec8-48fe-9bb9-d45a2d318f23 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:18.324327 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63820086-4ec8-48fe-9bb9-d45a2d318f23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:18.334321 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63820086-4ec8-48fe-9bb9-d45a2d318f23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:18.335791 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63820086-4ec8-48fe-9bb9-d45a2d318f23 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:18.345260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1186/2363] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:57:18 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:57:18.501297 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a9213-f8d5-471d-b2de-01f801f289b9 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:18.512636 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a9213-f8d5-471d-b2de-01f801f289b9 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:18.516203 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18de34-672a-461e-a290-22dd1aa2e3bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:18.516859 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18de34-672a-461e-a290-22dd1aa2e3bb service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:18.517146 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18de34-672a-461e-a290-22dd1aa2e3bb service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:18.517424 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18de34-672a-461e-a290-22dd1aa2e3bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:18.572026 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18de34-672a-461e-a290-22dd1aa2e3bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:18.573470 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18de34-672a-461e-a290-22dd1aa2e3bb service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:18.582211 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1178/2364] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:57:18 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:57:26.541786 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63820086-4ec8-48fe-9bb9-d45a2d318f23 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:26.543215 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-63820086-4ec8-48fe-9bb9-d45a2d318f23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:26.609048 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63820086-4ec8-48fe-9bb9-d45a2d318f23 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:26.614080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039690ab-dab0-49dd-9ba6-b2846164adc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:26.614940 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039690ab-dab0-49dd-9ba6-b2846164adc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:26.615212 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039690ab-dab0-49dd-9ba6-b2846164adc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:26.615480 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039690ab-dab0-49dd-9ba6-b2846164adc7 admin admin] PATH_INFO: `/v3/users/c3e807f648ee4b8aa5b5a87de691f991` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:26.616698 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039690ab-dab0-49dd-9ba6-b2846164adc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3e807f648ee4b8aa5b5a87de691f991)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:26.618630 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039690ab-dab0-49dd-9ba6-b2846164adc7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:26.671962 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-039690ab-dab0-49dd-9ba6-b2846164adc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3e807f648ee4b8aa5b5a87de691f991'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:26.672809 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-039690ab-dab0-49dd-9ba6-b2846164adc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3e807f648ee4b8aa5b5a87de691f991'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:26.680361 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-039690ab-dab0-49dd-9ba6-b2846164adc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3e807f648ee4b8aa5b5a87de691f991'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:26.688136 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-039690ab-dab0-49dd-9ba6-b2846164adc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3e807f648ee4b8aa5b5a87de691f991'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:26.688751 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-039690ab-dab0-49dd-9ba6-b2846164adc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3e807f648ee4b8aa5b5a87de691f991'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:26.705460 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1187/2365] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:57:26 2022] DELETE /identity/v3/users/c3e807f648ee4b8aa5b5a87de691f991 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:26.710061 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054b7e7-df9d-4091-bcc7-e2b2b693fc2f None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:26.710512 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054b7e7-df9d-4091-bcc7-e2b2b693fc2f None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:26.710603 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9054b7e7-df9d-4091-bcc7-e2b2b693fc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:26.730134 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-9054b7e7-df9d-4091-bcc7-e2b2b693fc2f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:26.730895 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9054b7e7-df9d-4091-bcc7-e2b2b693fc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:26.801717 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1179/2366] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:26.811217 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039690ab-dab0-49dd-9ba6-b2846164adc7 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:26.812657 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-039690ab-dab0-49dd-9ba6-b2846164adc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:26.876029 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039690ab-dab0-49dd-9ba6-b2846164adc7 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:26.879864 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43171248-d9b0-4e65-b738-5e33564cabf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:26.880539 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43171248-d9b0-4e65-b738-5e33564cabf5 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:26.880825 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43171248-d9b0-4e65-b738-5e33564cabf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:26.881093 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43171248-d9b0-4e65-b738-5e33564cabf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:26.890374 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054b7e7-df9d-4091-bcc7-e2b2b693fc2f None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:26.891781 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9054b7e7-df9d-4091-bcc7-e2b2b693fc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:26.891895 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43171248-d9b0-4e65-b738-5e33564cabf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:26.893270 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43171248-d9b0-4e65-b738-5e33564cabf5 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:26.903120 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1188/2367] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:57:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:57:26.903266 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9054b7e7-df9d-4091-bcc7-e2b2b693fc2f None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:26.908011 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e72f9d-439f-4e0f-a91f-3fafdabb8296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:26.908882 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e72f9d-439f-4e0f-a91f-3fafdabb8296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:26.909163 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e72f9d-439f-4e0f-a91f-3fafdabb8296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:26.909441 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e72f9d-439f-4e0f-a91f-3fafdabb8296 admin admin] PATH_INFO: `/v3/users/80878fb3fcdf4535b1477ec6562b5b1a` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:26.911175 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e72f9d-439f-4e0f-a91f-3fafdabb8296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80878fb3fcdf4535b1477ec6562b5b1a)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:26.913145 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e72f9d-439f-4e0f-a91f-3fafdabb8296 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:26.980763 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-77e72f9d-439f-4e0f-a91f-3fafdabb8296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80878fb3fcdf4535b1477ec6562b5b1a'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:26.990836 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-77e72f9d-439f-4e0f-a91f-3fafdabb8296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80878fb3fcdf4535b1477ec6562b5b1a'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:27.001422 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-77e72f9d-439f-4e0f-a91f-3fafdabb8296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80878fb3fcdf4535b1477ec6562b5b1a'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:27.002945 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-77e72f9d-439f-4e0f-a91f-3fafdabb8296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80878fb3fcdf4535b1477ec6562b5b1a'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:27.003577 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-77e72f9d-439f-4e0f-a91f-3fafdabb8296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80878fb3fcdf4535b1477ec6562b5b1a'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:27.032631 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1180/2368] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:57:26 2022] DELETE /identity/v3/users/80878fb3fcdf4535b1477ec6562b5b1a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:57:27.039263 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd7a2a-ebce-4028-afcf-6721dda42c18 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:27.040611 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd7a2a-ebce-4028-afcf-6721dda42c18 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:27.041106 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd7a2a-ebce-4028-afcf-6721dda42c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:27.062532 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-12fd7a2a-ebce-4028-afcf-6721dda42c18 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:27.063907 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-12fd7a2a-ebce-4028-afcf-6721dda42c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:27.130775 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1189/2369] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:27.144013 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e72f9d-439f-4e0f-a91f-3fafdabb8296 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:27.145875 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-77e72f9d-439f-4e0f-a91f-3fafdabb8296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:27.214662 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e72f9d-439f-4e0f-a91f-3fafdabb8296 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:27.220570 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205aa2c4-ddef-4e32-9b91-f8893835d32d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:27.221496 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205aa2c4-ddef-4e32-9b91-f8893835d32d service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:27.222013 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205aa2c4-ddef-4e32-9b91-f8893835d32d service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:27.222511 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205aa2c4-ddef-4e32-9b91-f8893835d32d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:27.242810 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205aa2c4-ddef-4e32-9b91-f8893835d32d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:27.243763 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd7a2a-ebce-4028-afcf-6721dda42c18 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:27.244985 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205aa2c4-ddef-4e32-9b91-f8893835d32d service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:27.246804 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-12fd7a2a-ebce-4028-afcf-6721dda42c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:27.255429 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1181/2370] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:57:27.260626 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd7a2a-ebce-4028-afcf-6721dda42c18 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:27.279892 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceab5e1-380b-4960-ac38-91ccaaff7414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:27.280959 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceab5e1-380b-4960-ac38-91ccaaff7414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:27.281347 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceab5e1-380b-4960-ac38-91ccaaff7414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:27.281696 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceab5e1-380b-4960-ac38-91ccaaff7414 admin admin] PATH_INFO: `/v3/projects/5454fa29da38491b9770e63f611654e9` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:27.283154 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceab5e1-380b-4960-ac38-91ccaaff7414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5454fa29da38491b9770e63f611654e9)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:27.286472 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceab5e1-380b-4960-ac38-91ccaaff7414 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:27.342999 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-dceab5e1-380b-4960-ac38-91ccaaff7414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5454fa29da38491b9770e63f611654e9', 'request_id': 'req-dceab5e1-380b-4960-ac38-91ccaaff7414'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:27.349929 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-dceab5e1-380b-4960-ac38-91ccaaff7414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5454fa29da38491b9770e63f611654e9', 'request_id': 'req-dceab5e1-380b-4960-ac38-91ccaaff7414'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:27.355685 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-dceab5e1-380b-4960-ac38-91ccaaff7414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5454fa29da38491b9770e63f611654e9', 'request_id': 'req-dceab5e1-380b-4960-ac38-91ccaaff7414'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:27.368518 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-dceab5e1-380b-4960-ac38-91ccaaff7414 admin admin] The token cache is being invalidate because project 5454fa29da38491b9770e63f611654e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:57:27.369001 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-dceab5e1-380b-4960-ac38-91ccaaff7414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:27.369734 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-dceab5e1-380b-4960-ac38-91ccaaff7414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:27.371924 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1190/2371] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:57:27 2022] DELETE /identity/v3/projects/5454fa29da38491b9770e63f611654e9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:57:27.377154 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7eb4a0-6ef3-4dee-b799-da465fd9a981 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:27.377444 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7eb4a0-6ef3-4dee-b799-da465fd9a981 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:27.377718 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7eb4a0-6ef3-4dee-b799-da465fd9a981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:27.402922 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-bd7eb4a0-6ef3-4dee-b799-da465fd9a981 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:27.404446 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-bd7eb4a0-6ef3-4dee-b799-da465fd9a981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:27.483670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf86704-65b2-48b6-8ece-3e7acde1da54 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:27.486186 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf86704-65b2-48b6-8ece-3e7acde1da54 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:27.486186 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf86704-65b2-48b6-8ece-3e7acde1da54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:27.489627 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1182/2372] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:27.521212 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-8cf86704-65b2-48b6-8ece-3e7acde1da54 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:27.522762 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8cf86704-65b2-48b6-8ece-3e7acde1da54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:27.531359 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1191/2373] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:27.536614 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7eb4a0-6ef3-4dee-b799-da465fd9a981 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:27.546292 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7eb4a0-6ef3-4dee-b799-da465fd9a981 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:27.550996 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122f580-ba60-4bfd-b8ea-e41880b0f5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:27.552067 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122f580-ba60-4bfd-b8ea-e41880b0f5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:27.552351 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122f580-ba60-4bfd-b8ea-e41880b0f5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:27.552626 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122f580-ba60-4bfd-b8ea-e41880b0f5e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:27.553355 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122f580-ba60-4bfd-b8ea-e41880b0f5e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:57:27.553655 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122f580-ba60-4bfd-b8ea-e41880b0f5e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:27.555244 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122f580-ba60-4bfd-b8ea-e41880b0f5e1 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:27.566663 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1183/2374] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:57:27.571107 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf86704-65b2-48b6-8ece-3e7acde1da54 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:27.581521 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf86704-65b2-48b6-8ece-3e7acde1da54 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:27.587547 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b64a3-aa3e-4441-a524-495b280a5ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:27.588269 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b64a3-aa3e-4441-a524-495b280a5ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:27.588556 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b64a3-aa3e-4441-a524-495b280a5ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:27.588833 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b64a3-aa3e-4441-a524-495b280a5ba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:27.589537 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b64a3-aa3e-4441-a524-495b280a5ba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:27.591467 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b64a3-aa3e-4441-a524-495b280a5ba4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:27.617567 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1192/2375] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:57:27 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:57:27.621928 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122f580-ba60-4bfd-b8ea-e41880b0f5e1 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:27.633926 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122f580-ba60-4bfd-b8ea-e41880b0f5e1 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:27.696994 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cd1a5-d2c9-454c-9dbb-ac8f3c516636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:27.697917 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cd1a5-d2c9-454c-9dbb-ac8f3c516636 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:27.698246 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cd1a5-d2c9-454c-9dbb-ac8f3c516636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:27.698616 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cd1a5-d2c9-454c-9dbb-ac8f3c516636 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:27.699484 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5cd1a5-d2c9-454c-9dbb-ac8f3c516636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:27.701797 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5cd1a5-d2c9-454c-9dbb-ac8f3c516636 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:27.711858 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b64a3-aa3e-4441-a524-495b280a5ba4 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:27.714792 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c80b64a3-aa3e-4441-a524-495b280a5ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:27.728286 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1184/2376] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:57:27 2022] POST /identity/v3/users => generated 300 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:57:27.729182 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cd1a5-d2c9-454c-9dbb-ac8f3c516636 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:27.730222 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b64a3-aa3e-4441-a524-495b280a5ba4 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:27.735901 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575472d2-fecc-4336-9141-25ce2efb6b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:27.736766 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575472d2-fecc-4336-9141-25ce2efb6b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:27.737061 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575472d2-fecc-4336-9141-25ce2efb6b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:27.737306 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575472d2-fecc-4336-9141-25ce2efb6b43 admin admin] PATH_INFO: `/v3/projects/4b227e902fbf49c690dc04674cbb31f4` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:27.739885 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575472d2-fecc-4336-9141-25ce2efb6b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b227e902fbf49c690dc04674cbb31f4)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:27.742170 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575472d2-fecc-4336-9141-25ce2efb6b43 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:27.742823 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cd1a5-d2c9-454c-9dbb-ac8f3c516636 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:27.748106 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6a708-663a-4e8f-ba0e-643eab33c515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:27.748779 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6a708-663a-4e8f-ba0e-643eab33c515 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:27.749068 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6a708-663a-4e8f-ba0e-643eab33c515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:27.749345 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6a708-663a-4e8f-ba0e-643eab33c515 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:27.750361 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6a708-663a-4e8f-ba0e-643eab33c515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:27.751739 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6a708-663a-4e8f-ba0e-643eab33c515 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:27.762110 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1185/2377] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:57:27.766010 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6a708-663a-4e8f-ba0e-643eab33c515 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:27.776190 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6a708-663a-4e8f-ba0e-643eab33c515 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:27.795133 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-575472d2-fecc-4336-9141-25ce2efb6b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b227e902fbf49c690dc04674cbb31f4', 'request_id': 'req-575472d2-fecc-4336-9141-25ce2efb6b43'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:27.804576 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-575472d2-fecc-4336-9141-25ce2efb6b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b227e902fbf49c690dc04674cbb31f4', 'request_id': 'req-575472d2-fecc-4336-9141-25ce2efb6b43'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:27.810650 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-575472d2-fecc-4336-9141-25ce2efb6b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b227e902fbf49c690dc04674cbb31f4', 'request_id': 'req-575472d2-fecc-4336-9141-25ce2efb6b43'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:27.827378 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-575472d2-fecc-4336-9141-25ce2efb6b43 admin admin] The token cache is being invalidate because project 4b227e902fbf49c690dc04674cbb31f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:57:27.827703 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-575472d2-fecc-4336-9141-25ce2efb6b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:27.833191 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-575472d2-fecc-4336-9141-25ce2efb6b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:27.837730 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1193/2378] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:57:27 2022] DELETE /identity/v3/projects/4b227e902fbf49c690dc04674cbb31f4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:57:27.838994 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575472d2-fecc-4336-9141-25ce2efb6b43 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:27.840405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-575472d2-fecc-4336-9141-25ce2efb6b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:27.850310 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a2246-7006-4f8e-9292-32d3271b1701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:27.851056 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a2246-7006-4f8e-9292-32d3271b1701 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:27.851385 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a2246-7006-4f8e-9292-32d3271b1701 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:27.851747 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a2246-7006-4f8e-9292-32d3271b1701 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:27.852551 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a2246-7006-4f8e-9292-32d3271b1701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:27.854224 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a2246-7006-4f8e-9292-32d3271b1701 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:27.867496 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1186/2379] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:57:27.868581 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a2246-7006-4f8e-9292-32d3271b1701 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:27.870571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9a9a2246-7006-4f8e-9292-32d3271b1701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:27.883411 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a2246-7006-4f8e-9292-32d3271b1701 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:27.888636 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73506de-6186-4a11-9eea-7480e10044e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:27.889985 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73506de-6186-4a11-9eea-7480e10044e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:27.890267 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73506de-6186-4a11-9eea-7480e10044e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:27.890542 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73506de-6186-4a11-9eea-7480e10044e9 admin admin] PATH_INFO: `/v3/projects/92f51eb4173740b19beb0814f33bd8a1/users/b34b284510dd41beabd84dbfa74135a2/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:27.905538 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575472d2-fecc-4336-9141-25ce2efb6b43 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:27.905696 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73506de-6186-4a11-9eea-7480e10044e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f51eb4173740b19beb0814f33bd8a1, user_id=b34b284510dd41beabd84dbfa74135a2, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:27.908317 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73506de-6186-4a11-9eea-7480e10044e9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:27.910208 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd29ee-2614-4bfb-a3ba-3968e6a158f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:27.911070 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd29ee-2614-4bfb-a3ba-3968e6a158f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:27.911352 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd29ee-2614-4bfb-a3ba-3968e6a158f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:27.911660 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd29ee-2614-4bfb-a3ba-3968e6a158f2 admin admin] PATH_INFO: `/v3/users/7011c7dea00b4cdaa887573466694ce7` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:27.912964 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd29ee-2614-4bfb-a3ba-3968e6a158f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7011c7dea00b4cdaa887573466694ce7)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:27.915259 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd29ee-2614-4bfb-a3ba-3968e6a158f2 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:27.921803 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1187/2380] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:57:27 2022] PUT /identity/v3/projects/92f51eb4173740b19beb0814f33bd8a1/users/b34b284510dd41beabd84dbfa74135a2/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:57:27.932334 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f020117-521b-4393-98ed-90f0519819a6 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:27.932626 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f020117-521b-4393-98ed-90f0519819a6 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:27.932930 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f020117-521b-4393-98ed-90f0519819a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:27.960222 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-7f020117-521b-4393-98ed-90f0519819a6 None None] MFA Rules not processed for user `b34b284510dd41beabd84dbfa74135a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:27.961362 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7f020117-521b-4393-98ed-90f0519819a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:27.963151 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f9fd29ee-2614-4bfb-a3ba-3968e6a158f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7011c7dea00b4cdaa887573466694ce7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:27.963852 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f9fd29ee-2614-4bfb-a3ba-3968e6a158f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7011c7dea00b4cdaa887573466694ce7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:27.970637 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f9fd29ee-2614-4bfb-a3ba-3968e6a158f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7011c7dea00b4cdaa887573466694ce7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:27.978032 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f9fd29ee-2614-4bfb-a3ba-3968e6a158f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7011c7dea00b4cdaa887573466694ce7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:27.978657 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-f9fd29ee-2614-4bfb-a3ba-3968e6a158f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7011c7dea00b4cdaa887573466694ce7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:27.995813 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1194/2381] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:57:27 2022] DELETE /identity/v3/users/7011c7dea00b4cdaa887573466694ce7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:28.046303 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1188/2382] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:28.059373 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd29ee-2614-4bfb-a3ba-3968e6a158f2 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:28.061588 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f9fd29ee-2614-4bfb-a3ba-3968e6a158f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:28.123020 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd29ee-2614-4bfb-a3ba-3968e6a158f2 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:28.127346 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ea601-b660-469a-8b91-510e6046c0eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:28.128154 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ea601-b660-469a-8b91-510e6046c0eb service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:28.128504 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ea601-b660-469a-8b91-510e6046c0eb service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:28.128960 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ea601-b660-469a-8b91-510e6046c0eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:28.197609 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ea601-b660-469a-8b91-510e6046c0eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:28.199876 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ea601-b660-469a-8b91-510e6046c0eb service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:28.211829 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1195/2383] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:57:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:57:28.374090 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f020117-521b-4393-98ed-90f0519819a6 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:28.375541 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7f020117-521b-4393-98ed-90f0519819a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:28.462920 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f020117-521b-4393-98ed-90f0519819a6 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:28.529868 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651218a-ff8e-4bf3-b656-5c7be7cd67ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:28.531297 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651218a-ff8e-4bf3-b656-5c7be7cd67ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:28.531835 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651218a-ff8e-4bf3-b656-5c7be7cd67ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:28.532284 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651218a-ff8e-4bf3-b656-5c7be7cd67ba admin admin] PATH_INFO: `/v3/projects/29d972177a044a2697246fb4d8e0a95b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:28.533823 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651218a-ff8e-4bf3-b656-5c7be7cd67ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=29d972177a044a2697246fb4d8e0a95b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:28.536645 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651218a-ff8e-4bf3-b656-5c7be7cd67ba admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:28.595248 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1651218a-ff8e-4bf3-b656-5c7be7cd67ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29d972177a044a2697246fb4d8e0a95b', 'request_id': 'req-1651218a-ff8e-4bf3-b656-5c7be7cd67ba'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:28.610640 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1651218a-ff8e-4bf3-b656-5c7be7cd67ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29d972177a044a2697246fb4d8e0a95b', 'request_id': 'req-1651218a-ff8e-4bf3-b656-5c7be7cd67ba'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:28.644315 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1651218a-ff8e-4bf3-b656-5c7be7cd67ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29d972177a044a2697246fb4d8e0a95b', 'request_id': 'req-1651218a-ff8e-4bf3-b656-5c7be7cd67ba'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:28.657956 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1651218a-ff8e-4bf3-b656-5c7be7cd67ba admin admin] The token cache is being invalidate because project 29d972177a044a2697246fb4d8e0a95b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:57:28.658254 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1651218a-ff8e-4bf3-b656-5c7be7cd67ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:28.659118 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-1651218a-ff8e-4bf3-b656-5c7be7cd67ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:28.660989 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1189/2384] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:57:28 2022] DELETE /identity/v3/projects/29d972177a044a2697246fb4d8e0a95b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:28.665865 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cecd5-0d95-49a6-9c1b-b542680f7228 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:28.666431 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cecd5-0d95-49a6-9c1b-b542680f7228 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:28.666431 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cecd5-0d95-49a6-9c1b-b542680f7228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:28.685906 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d29cecd5-0d95-49a6-9c1b-b542680f7228 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:28.687438 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d29cecd5-0d95-49a6-9c1b-b542680f7228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:28.755853 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1196/2385] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:28.764415 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365450c1-5f3f-4411-8266-cdc139c62db8 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:28.764954 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365450c1-5f3f-4411-8266-cdc139c62db8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:28.765063 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365450c1-5f3f-4411-8266-cdc139c62db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:28.796789 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-365450c1-5f3f-4411-8266-cdc139c62db8 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:28.797998 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-365450c1-5f3f-4411-8266-cdc139c62db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:28.806069 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1190/2386] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:28.810530 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cecd5-0d95-49a6-9c1b-b542680f7228 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:28.821195 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cecd5-0d95-49a6-9c1b-b542680f7228 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:28.826132 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d366a4-3a6c-4826-8d93-d741d97a9a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:28.826767 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d366a4-3a6c-4826-8d93-d741d97a9a62 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:28.827048 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d366a4-3a6c-4826-8d93-d741d97a9a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:28.827325 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d366a4-3a6c-4826-8d93-d741d97a9a62 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:28.828098 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d366a4-3a6c-4826-8d93-d741d97a9a62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:57:28.828407 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d366a4-3a6c-4826-8d93-d741d97a9a62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:28.830032 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d366a4-3a6c-4826-8d93-d741d97a9a62 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:28.843228 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1197/2387] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:57:28.848306 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365450c1-5f3f-4411-8266-cdc139c62db8 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:28.857947 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365450c1-5f3f-4411-8266-cdc139c62db8 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:28.862628 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d2d5c-1144-45de-a263-b32ff8ec973c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:28.864001 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d2d5c-1144-45de-a263-b32ff8ec973c admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:28.864292 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d2d5c-1144-45de-a263-b32ff8ec973c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:28.864571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d2d5c-1144-45de-a263-b32ff8ec973c admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:28.865248 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d2d5c-1144-45de-a263-b32ff8ec973c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:28.867174 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d2d5c-1144-45de-a263-b32ff8ec973c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:28.894556 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1191/2388] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:57:28 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:57:28.898793 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d366a4-3a6c-4826-8d93-d741d97a9a62 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:28.908483 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d366a4-3a6c-4826-8d93-d741d97a9a62 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:28.964420 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584c2dc-ea95-4eb2-abf9-86f1dcc93f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:28.965016 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584c2dc-ea95-4eb2-abf9-86f1dcc93f39 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:28.965299 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584c2dc-ea95-4eb2-abf9-86f1dcc93f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:28.965578 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584c2dc-ea95-4eb2-abf9-86f1dcc93f39 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:28.966275 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584c2dc-ea95-4eb2-abf9-86f1dcc93f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:28.968230 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584c2dc-ea95-4eb2-abf9-86f1dcc93f39 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:28.987096 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1198/2389] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:57:28 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:57:28.992014 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d2d5c-1144-45de-a263-b32ff8ec973c admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:29.001966 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d2d5c-1144-45de-a263-b32ff8ec973c admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:29.007181 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58502dbf-bc31-4672-aaa1-3f1a411383f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:29.007866 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58502dbf-bc31-4672-aaa1-3f1a411383f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:29.008188 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58502dbf-bc31-4672-aaa1-3f1a411383f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:29.008469 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58502dbf-bc31-4672-aaa1-3f1a411383f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:29.009223 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58502dbf-bc31-4672-aaa1-3f1a411383f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:29.011192 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58502dbf-bc31-4672-aaa1-3f1a411383f3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:29.021795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1192/2390] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:57:29.025849 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584c2dc-ea95-4eb2-abf9-86f1dcc93f39 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:29.036577 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584c2dc-ea95-4eb2-abf9-86f1dcc93f39 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:29.041194 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f1095-e424-4664-8634-bf4c93a31fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:29.041862 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f1095-e424-4664-8634-bf4c93a31fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:29.042163 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f1095-e424-4664-8634-bf4c93a31fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:29.042439 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f1095-e424-4664-8634-bf4c93a31fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:29.043161 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f1095-e424-4664-8634-bf4c93a31fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:29.045189 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f1095-e424-4664-8634-bf4c93a31fc9 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:29.056094 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1199/2391] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:57:29.060207 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58502dbf-bc31-4672-aaa1-3f1a411383f3 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:29.070728 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58502dbf-bc31-4672-aaa1-3f1a411383f3 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:29.075275 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c1ccc-5d49-49d9-bc49-bcdd91511bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:29.076199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c1ccc-5d49-49d9-bc49-bcdd91511bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:29.076485 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c1ccc-5d49-49d9-bc49-bcdd91511bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:29.076760 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c1ccc-5d49-49d9-bc49-bcdd91511bb1 admin admin] PATH_INFO: `/v3/projects/6b883dc95a4349fba7f113cbe48b4c51/users/73000e2a51b8452e9e25ecde059ce0a8/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:29.090652 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c1ccc-5d49-49d9-bc49-bcdd91511bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b883dc95a4349fba7f113cbe48b4c51, user_id=73000e2a51b8452e9e25ecde059ce0a8, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:29.093341 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c1ccc-5d49-49d9-bc49-bcdd91511bb1 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:29.106823 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1193/2392] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:57:29 2022] PUT /identity/v3/projects/6b883dc95a4349fba7f113cbe48b4c51/users/73000e2a51b8452e9e25ecde059ce0a8/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:29.117747 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077d0e9-a1b4-46d8-be59-dee86fc3a3b8 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:29.118038 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077d0e9-a1b4-46d8-be59-dee86fc3a3b8 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:29.118318 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077d0e9-a1b4-46d8-be59-dee86fc3a3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:29.145176 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-f077d0e9-a1b4-46d8-be59-dee86fc3a3b8 None None] MFA Rules not processed for user `73000e2a51b8452e9e25ecde059ce0a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:29.146403 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f077d0e9-a1b4-46d8-be59-dee86fc3a3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:29.207471 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1200/2393] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:29.217992 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c1ccc-5d49-49d9-bc49-bcdd91511bb1 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:29.219720 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-684c1ccc-5d49-49d9-bc49-bcdd91511bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:29.276003 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c1ccc-5d49-49d9-bc49-bcdd91511bb1 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:29.279719 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184846ce-d120-403f-b593-dc77fa9ac160 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:29.280370 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184846ce-d120-403f-b593-dc77fa9ac160 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:29.280654 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184846ce-d120-403f-b593-dc77fa9ac160 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:29.280930 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184846ce-d120-403f-b593-dc77fa9ac160 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:29.289737 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184846ce-d120-403f-b593-dc77fa9ac160 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:29.291183 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184846ce-d120-403f-b593-dc77fa9ac160 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:29.300443 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1194/2394] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:57:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:57:30.633123 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbd28b-5b02-4a3b-847a-e860fca33cd5 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:30.633615 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbd28b-5b02-4a3b-847a-e860fca33cd5 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:30.633766 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbd28b-5b02-4a3b-847a-e860fca33cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:30.651005 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-fefbd28b-5b02-4a3b-847a-e860fca33cd5 None None] MFA Rules not processed for user `73000e2a51b8452e9e25ecde059ce0a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:30.652241 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-fefbd28b-5b02-4a3b-847a-e860fca33cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:30.659088 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1201/2395] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:36.311548 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184846ce-d120-403f-b593-dc77fa9ac160 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:36.312980 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-184846ce-d120-403f-b593-dc77fa9ac160 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:36.437853 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184846ce-d120-403f-b593-dc77fa9ac160 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:36.443143 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e0aa5-2f59-48aa-b4cb-c3c0fd26eec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:36.444038 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e0aa5-2f59-48aa-b4cb-c3c0fd26eec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:36.444317 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e0aa5-2f59-48aa-b4cb-c3c0fd26eec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:36.444633 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e0aa5-2f59-48aa-b4cb-c3c0fd26eec1 admin admin] PATH_INFO: `/v3/users/b34b284510dd41beabd84dbfa74135a2` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:36.445970 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e0aa5-2f59-48aa-b4cb-c3c0fd26eec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b34b284510dd41beabd84dbfa74135a2)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:36.447948 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e0aa5-2f59-48aa-b4cb-c3c0fd26eec1 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:36.490741 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-cc0e0aa5-2f59-48aa-b4cb-c3c0fd26eec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b34b284510dd41beabd84dbfa74135a2'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:36.497315 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-cc0e0aa5-2f59-48aa-b4cb-c3c0fd26eec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b34b284510dd41beabd84dbfa74135a2'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:36.505858 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-cc0e0aa5-2f59-48aa-b4cb-c3c0fd26eec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b34b284510dd41beabd84dbfa74135a2'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:36.506481 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-cc0e0aa5-2f59-48aa-b4cb-c3c0fd26eec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b34b284510dd41beabd84dbfa74135a2'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:36.507117 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-cc0e0aa5-2f59-48aa-b4cb-c3c0fd26eec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b34b284510dd41beabd84dbfa74135a2'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:36.524421 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1195/2396] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:57:36 2022] DELETE /identity/v3/users/b34b284510dd41beabd84dbfa74135a2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:36.528928 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e645f7-ce72-4d22-aa2e-163dd9a96d8e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:36.529393 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e645f7-ce72-4d22-aa2e-163dd9a96d8e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:36.529491 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e645f7-ce72-4d22-aa2e-163dd9a96d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:36.555146 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-69e645f7-ce72-4d22-aa2e-163dd9a96d8e None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:36.556395 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-69e645f7-ce72-4d22-aa2e-163dd9a96d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:36.612470 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1202/2397] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:36.622224 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e0aa5-2f59-48aa-b4cb-c3c0fd26eec1 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:36.623646 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-cc0e0aa5-2f59-48aa-b4cb-c3c0fd26eec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:36.715615 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e0aa5-2f59-48aa-b4cb-c3c0fd26eec1 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:36.719568 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54ba50-9cb9-4465-b080-8a680942fd02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:36.720256 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54ba50-9cb9-4465-b080-8a680942fd02 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:36.720550 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54ba50-9cb9-4465-b080-8a680942fd02 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:36.720824 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54ba50-9cb9-4465-b080-8a680942fd02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:36.731328 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54ba50-9cb9-4465-b080-8a680942fd02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:36.732846 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54ba50-9cb9-4465-b080-8a680942fd02 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:36.743962 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1196/2398] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:57:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:57:37.109704 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e645f7-ce72-4d22-aa2e-163dd9a96d8e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:37.111146 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-69e645f7-ce72-4d22-aa2e-163dd9a96d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:37.123279 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e645f7-ce72-4d22-aa2e-163dd9a96d8e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:37.130179 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53287b-e996-4150-8f66-9274d6319b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:37.131052 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53287b-e996-4150-8f66-9274d6319b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:37.131333 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53287b-e996-4150-8f66-9274d6319b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:37.131607 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53287b-e996-4150-8f66-9274d6319b01 admin admin] PATH_INFO: `/v3/projects/92f51eb4173740b19beb0814f33bd8a1` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:37.132834 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53287b-e996-4150-8f66-9274d6319b01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92f51eb4173740b19beb0814f33bd8a1)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:37.135294 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53287b-e996-4150-8f66-9274d6319b01 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:37.190843 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-5e53287b-e996-4150-8f66-9274d6319b01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92f51eb4173740b19beb0814f33bd8a1', 'request_id': 'req-5e53287b-e996-4150-8f66-9274d6319b01'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:37.197749 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-5e53287b-e996-4150-8f66-9274d6319b01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92f51eb4173740b19beb0814f33bd8a1', 'request_id': 'req-5e53287b-e996-4150-8f66-9274d6319b01'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:37.203573 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-5e53287b-e996-4150-8f66-9274d6319b01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92f51eb4173740b19beb0814f33bd8a1', 'request_id': 'req-5e53287b-e996-4150-8f66-9274d6319b01'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:37.217042 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-5e53287b-e996-4150-8f66-9274d6319b01 admin admin] The token cache is being invalidate because project 92f51eb4173740b19beb0814f33bd8a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:57:37.217334 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-5e53287b-e996-4150-8f66-9274d6319b01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:37.217965 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-5e53287b-e996-4150-8f66-9274d6319b01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:37.219754 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1203/2399] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:57:37 2022] DELETE /identity/v3/projects/92f51eb4173740b19beb0814f33bd8a1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:37.225209 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7feee-3655-4e73-bb14-075718839c41 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:37.225489 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7feee-3655-4e73-bb14-075718839c41 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:37.225769 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7feee-3655-4e73-bb14-075718839c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:37.262990 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-e0e7feee-3655-4e73-bb14-075718839c41 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:37.264229 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e0e7feee-3655-4e73-bb14-075718839c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:37.333815 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1197/2400] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:37.342423 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc507514-8433-479b-98ca-5a085cf8a354 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:37.342715 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc507514-8433-479b-98ca-5a085cf8a354 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:37.342996 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc507514-8433-479b-98ca-5a085cf8a354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:37.361782 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-cc507514-8433-479b-98ca-5a085cf8a354 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:37.363897 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-cc507514-8433-479b-98ca-5a085cf8a354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:37.371958 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1204/2401] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:37.375979 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7feee-3655-4e73-bb14-075718839c41 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:37.385727 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7feee-3655-4e73-bb14-075718839c41 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:37.390331 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af800ed-3cfc-4673-82b1-23b3bcc5a61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:37.390987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af800ed-3cfc-4673-82b1-23b3bcc5a61d admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:37.391269 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af800ed-3cfc-4673-82b1-23b3bcc5a61d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:37.391545 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af800ed-3cfc-4673-82b1-23b3bcc5a61d admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:37.392351 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af800ed-3cfc-4673-82b1-23b3bcc5a61d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:57:37.392653 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af800ed-3cfc-4673-82b1-23b3bcc5a61d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:37.394926 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af800ed-3cfc-4673-82b1-23b3bcc5a61d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:37.406287 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1198/2402] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:57:37.411195 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc507514-8433-479b-98ca-5a085cf8a354 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:37.420573 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc507514-8433-479b-98ca-5a085cf8a354 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:37.425353 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3506b-823f-4cf6-bc14-d5cdd7541471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:37.426000 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3506b-823f-4cf6-bc14-d5cdd7541471 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:37.426281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3506b-823f-4cf6-bc14-d5cdd7541471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:37.426555 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3506b-823f-4cf6-bc14-d5cdd7541471 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:37.427247 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3506b-823f-4cf6-bc14-d5cdd7541471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:37.429321 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3506b-823f-4cf6-bc14-d5cdd7541471 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:37.453531 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1205/2403] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:57:37 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:57:37.458312 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af800ed-3cfc-4673-82b1-23b3bcc5a61d admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:37.468197 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af800ed-3cfc-4673-82b1-23b3bcc5a61d admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:37.522684 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75dc8da-03ab-4d90-a67e-06f67a929cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:37.523272 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dc8da-03ab-4d90-a67e-06f67a929cdf admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:37.523616 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dc8da-03ab-4d90-a67e-06f67a929cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:37.523924 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dc8da-03ab-4d90-a67e-06f67a929cdf admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:37.524607 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75dc8da-03ab-4d90-a67e-06f67a929cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:37.526537 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75dc8da-03ab-4d90-a67e-06f67a929cdf admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:37.547929 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1199/2404] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:57:37 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:57:37.551946 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3506b-823f-4cf6-bc14-d5cdd7541471 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:37.561949 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3506b-823f-4cf6-bc14-d5cdd7541471 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:37.566590 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4e142-5d07-4a02-b443-6337e6f070e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:37.567236 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4e142-5d07-4a02-b443-6337e6f070e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:37.567514 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4e142-5d07-4a02-b443-6337e6f070e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:37.567824 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4e142-5d07-4a02-b443-6337e6f070e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:37.568544 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4e142-5d07-4a02-b443-6337e6f070e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:37.570215 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4e142-5d07-4a02-b443-6337e6f070e9 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:37.580465 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1206/2405] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:57:37.585310 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75dc8da-03ab-4d90-a67e-06f67a929cdf admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:37.595432 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75dc8da-03ab-4d90-a67e-06f67a929cdf admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:37.600851 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aab303-6f28-4d5e-a15e-6365f9959d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:37.601512 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aab303-6f28-4d5e-a15e-6365f9959d89 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:37.601796 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aab303-6f28-4d5e-a15e-6365f9959d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:37.602073 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aab303-6f28-4d5e-a15e-6365f9959d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:37.602803 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aab303-6f28-4d5e-a15e-6365f9959d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:37.604446 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aab303-6f28-4d5e-a15e-6365f9959d89 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:37.614105 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1200/2406] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:57:37.618046 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4e142-5d07-4a02-b443-6337e6f070e9 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:37.627950 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4e142-5d07-4a02-b443-6337e6f070e9 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:37.632824 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1694f7-3cb8-4a82-8eed-d3d83ac9917b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:37.633941 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1694f7-3cb8-4a82-8eed-d3d83ac9917b admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:37.634311 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1694f7-3cb8-4a82-8eed-d3d83ac9917b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:37.634594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1694f7-3cb8-4a82-8eed-d3d83ac9917b admin admin] PATH_INFO: `/v3/projects/644547f80e2543079781f0c7b34c40b4/users/b3d95fb42f294675a9e9bb5f03304390/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:37.649343 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1694f7-3cb8-4a82-8eed-d3d83ac9917b admin admin] RBAC: Authorizing `identity:create_grant(project_id=644547f80e2543079781f0c7b34c40b4, user_id=b3d95fb42f294675a9e9bb5f03304390, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:37.652138 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1694f7-3cb8-4a82-8eed-d3d83ac9917b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:37.664960 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1207/2407] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:57:37 2022] PUT /identity/v3/projects/644547f80e2543079781f0c7b34c40b4/users/b3d95fb42f294675a9e9bb5f03304390/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:57:37.670167 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403f151-7aed-4fa2-a650-0ce576dd7b49 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:37.670463 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403f151-7aed-4fa2-a650-0ce576dd7b49 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:37.670745 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403f151-7aed-4fa2-a650-0ce576dd7b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:37.688038 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-f403f151-7aed-4fa2-a650-0ce576dd7b49 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:37.689235 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f403f151-7aed-4fa2-a650-0ce576dd7b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:37.745709 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1201/2408] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:37.755722 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1694f7-3cb8-4a82-8eed-d3d83ac9917b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:37.757417 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7b1694f7-3cb8-4a82-8eed-d3d83ac9917b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:37.812492 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1694f7-3cb8-4a82-8eed-d3d83ac9917b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:37.816136 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308dc7ed-1f0d-4146-afb6-6a335fa37730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:37.816780 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308dc7ed-1f0d-4146-afb6-6a335fa37730 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:37.817069 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308dc7ed-1f0d-4146-afb6-6a335fa37730 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:37.817342 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308dc7ed-1f0d-4146-afb6-6a335fa37730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:37.826122 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308dc7ed-1f0d-4146-afb6-6a335fa37730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:37.827554 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308dc7ed-1f0d-4146-afb6-6a335fa37730 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:37.836910 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1208/2409] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:57:42.830371 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725f614-72c1-485e-9454-6decbc7d2178 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:42.830867 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725f614-72c1-485e-9454-6decbc7d2178 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:42.831331 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725f614-72c1-485e-9454-6decbc7d2178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:42.867115 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-f725f614-72c1-485e-9454-6decbc7d2178 None None] MFA Rules not processed for user `b3d95fb42f294675a9e9bb5f03304390`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:42.869236 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f725f614-72c1-485e-9454-6decbc7d2178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:43.072849 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1202/2410] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:57:43.073303 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308dc7ed-1f0d-4146-afb6-6a335fa37730 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:43.085029 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308dc7ed-1f0d-4146-afb6-6a335fa37730 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:43.109246 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ae532-2333-4cf3-b778-373d2beeb39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:43.110329 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ae532-2333-4cf3-b778-373d2beeb39e admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:43.110820 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ae532-2333-4cf3-b778-373d2beeb39e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:43.111311 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ae532-2333-4cf3-b778-373d2beeb39e admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:43.112814 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ae532-2333-4cf3-b778-373d2beeb39e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:43.115328 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ae532-2333-4cf3-b778-373d2beeb39e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:43.165847 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1209/2411] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:57:43 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:57:43.170427 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725f614-72c1-485e-9454-6decbc7d2178 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:43.186117 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725f614-72c1-485e-9454-6decbc7d2178 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:43.298073 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfb744-62f0-4b19-8ac8-fae4842c75f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:43.299024 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfb744-62f0-4b19-8ac8-fae4842c75f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:43.299585 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfb744-62f0-4b19-8ac8-fae4842c75f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:43.300606 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfb744-62f0-4b19-8ac8-fae4842c75f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:43.301528 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfb744-62f0-4b19-8ac8-fae4842c75f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:43.304738 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfb744-62f0-4b19-8ac8-fae4842c75f9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:43.347184 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1203/2412] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:57:43 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:57:43.351952 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ae532-2333-4cf3-b778-373d2beeb39e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:43.382562 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ae532-2333-4cf3-b778-373d2beeb39e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:43.407552 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a1046-81fa-429d-a38d-f5f9761c740c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:43.408414 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a1046-81fa-429d-a38d-f5f9761c740c admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:43.408701 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a1046-81fa-429d-a38d-f5f9761c740c admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:43.409189 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a1046-81fa-429d-a38d-f5f9761c740c admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:43.410409 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a1046-81fa-429d-a38d-f5f9761c740c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:43.412100 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a1046-81fa-429d-a38d-f5f9761c740c admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:43.447309 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1210/2413] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:57:43.451852 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfb744-62f0-4b19-8ac8-fae4842c75f9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:43.472804 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfb744-62f0-4b19-8ac8-fae4842c75f9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:43.478241 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6161655-45d7-4d52-829b-3c52ccd7eec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:43.479287 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6161655-45d7-4d52-829b-3c52ccd7eec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:43.479420 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6161655-45d7-4d52-829b-3c52ccd7eec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:43.479800 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6161655-45d7-4d52-829b-3c52ccd7eec3 admin admin] PATH_INFO: `/v3/projects/43cdac2d08374f7691e431b85ad81bc1/users/2e30dc9f40ab4a5cb18be722c914b833/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:43.501276 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6161655-45d7-4d52-829b-3c52ccd7eec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43cdac2d08374f7691e431b85ad81bc1, user_id=2e30dc9f40ab4a5cb18be722c914b833, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:43.512542 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6161655-45d7-4d52-829b-3c52ccd7eec3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:43.529862 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1204/2414] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:57:43 2022] PUT /identity/v3/projects/43cdac2d08374f7691e431b85ad81bc1/users/2e30dc9f40ab4a5cb18be722c914b833/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:43.533596 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a1046-81fa-429d-a38d-f5f9761c740c admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:43.544351 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a1046-81fa-429d-a38d-f5f9761c740c admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:43.607083 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56282716-62a1-4d90-8b45-cf4d09703338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:43.608136 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56282716-62a1-4d90-8b45-cf4d09703338 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:43.608430 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56282716-62a1-4d90-8b45-cf4d09703338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:43.608844 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56282716-62a1-4d90-8b45-cf4d09703338 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:43.609563 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56282716-62a1-4d90-8b45-cf4d09703338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:43.611186 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56282716-62a1-4d90-8b45-cf4d09703338 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:43.625207 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1211/2415] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:57:43.627216 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6161655-45d7-4d52-829b-3c52ccd7eec3 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:43.642533 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6161655-45d7-4d52-829b-3c52ccd7eec3 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:43.657956 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f5649-1f04-4177-8a4a-39cc88e23ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:43.659430 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f5649-1f04-4177-8a4a-39cc88e23ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:43.660076 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f5649-1f04-4177-8a4a-39cc88e23ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:43.660439 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f5649-1f04-4177-8a4a-39cc88e23ddc admin admin] PATH_INFO: `/v3/projects/43cdac2d08374f7691e431b85ad81bc1/users/2e30dc9f40ab4a5cb18be722c914b833/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:43.663099 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f5649-1f04-4177-8a4a-39cc88e23ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=43cdac2d08374f7691e431b85ad81bc1, user_id=2e30dc9f40ab4a5cb18be722c914b833, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:43.666500 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f5649-1f04-4177-8a4a-39cc88e23ddc admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:43.678533 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1205/2416] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:57:43 2022] PUT /identity/v3/projects/43cdac2d08374f7691e431b85ad81bc1/users/2e30dc9f40ab4a5cb18be722c914b833/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:44.824935 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3303d-13a0-4d1c-8bef-42045aca3b7e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:44.825873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3303d-13a0-4d1c-8bef-42045aca3b7e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:44.826336 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3303d-13a0-4d1c-8bef-42045aca3b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:44.848756 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-73e3303d-13a0-4d1c-8bef-42045aca3b7e None None] MFA Rules not processed for user `cfe3f01cd2f742f4903ed97da6b6923c`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:44.850254 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-73e3303d-13a0-4d1c-8bef-42045aca3b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:44.946540 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1212/2417] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:50.310936 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f5649-1f04-4177-8a4a-39cc88e23ddc admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:50.313287 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ea7f5649-1f04-4177-8a4a-39cc88e23ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:50.422868 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f5649-1f04-4177-8a4a-39cc88e23ddc admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:50.428734 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e663d4-8ef0-4bf7-94ac-c63d4fc184d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:50.430296 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e663d4-8ef0-4bf7-94ac-c63d4fc184d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:50.430733 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e663d4-8ef0-4bf7-94ac-c63d4fc184d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:50.431199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e663d4-8ef0-4bf7-94ac-c63d4fc184d8 admin admin] PATH_INFO: `/v3/users/0d53d4b828dd4cf3bcf2a72fad0e58c5` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:50.433052 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e663d4-8ef0-4bf7-94ac-c63d4fc184d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d53d4b828dd4cf3bcf2a72fad0e58c5)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:50.444932 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e663d4-8ef0-4bf7-94ac-c63d4fc184d8 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:50.558841 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b6e663d4-8ef0-4bf7-94ac-c63d4fc184d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d53d4b828dd4cf3bcf2a72fad0e58c5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:50.570124 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b6e663d4-8ef0-4bf7-94ac-c63d4fc184d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d53d4b828dd4cf3bcf2a72fad0e58c5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:50.582284 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b6e663d4-8ef0-4bf7-94ac-c63d4fc184d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d53d4b828dd4cf3bcf2a72fad0e58c5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:50.583419 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b6e663d4-8ef0-4bf7-94ac-c63d4fc184d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d53d4b828dd4cf3bcf2a72fad0e58c5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:50.586170 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b6e663d4-8ef0-4bf7-94ac-c63d4fc184d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d53d4b828dd4cf3bcf2a72fad0e58c5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:50.611571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1206/2418] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:57:50 2022] DELETE /identity/v3/users/0d53d4b828dd4cf3bcf2a72fad0e58c5 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:50.616425 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6724ee-e904-4b51-b803-d35d1db943b3 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:50.616978 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6724ee-e904-4b51-b803-d35d1db943b3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:50.616978 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6724ee-e904-4b51-b803-d35d1db943b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:50.641049 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7e6724ee-e904-4b51-b803-d35d1db943b3 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:50.642595 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7e6724ee-e904-4b51-b803-d35d1db943b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:50.669157 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6207c6-319a-4348-8f5e-e5caa542abf5 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:50.669447 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6207c6-319a-4348-8f5e-e5caa542abf5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:50.669739 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6207c6-319a-4348-8f5e-e5caa542abf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:50.700754 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-6f6207c6-319a-4348-8f5e-e5caa542abf5 None None] MFA Rules not processed for user `920ed843195243f8abd6dfb2ebb3a549`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:50.701906 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6f6207c6-319a-4348-8f5e-e5caa542abf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:50.755687 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1213/2419] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:50.776565 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6724ee-e904-4b51-b803-d35d1db943b3 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:50.778538 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7e6724ee-e904-4b51-b803-d35d1db943b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:50.824815 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1207/2420] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Apr 11 13:57:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:57:50.895104 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6207c6-319a-4348-8f5e-e5caa542abf5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:50.896554 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6f6207c6-319a-4348-8f5e-e5caa542abf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:50.938747 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6724ee-e904-4b51-b803-d35d1db943b3 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:50.944141 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc4bf9-def6-4f27-90eb-d7bbbe312f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:50.944819 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc4bf9-def6-4f27-90eb-d7bbbe312f54 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:50.945103 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc4bf9-def6-4f27-90eb-d7bbbe312f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:50.945497 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc4bf9-def6-4f27-90eb-d7bbbe312f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:50.973140 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc4bf9-def6-4f27-90eb-d7bbbe312f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:50.977032 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc4bf9-def6-4f27-90eb-d7bbbe312f54 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:51.013836 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1214/2421] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 13:57:51.046644 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d554997-5e9c-4f83-97ab-e9f45942d464 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:51.047365 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d554997-5e9c-4f83-97ab-e9f45942d464 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:51.047836 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d554997-5e9c-4f83-97ab-e9f45942d464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:51.074512 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6207c6-319a-4348-8f5e-e5caa542abf5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:51.080669 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b778f-bad1-41d4-bfcf-ea4f738f03f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6660794b27ff4a7bbe9b6b043593598c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:51.081595 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b778f-bad1-41d4-bfcf-ea4f738f03f2 service swift] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:51.081886 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b778f-bad1-41d4-bfcf-ea4f738f03f2 service swift] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:51.082168 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b778f-bad1-41d4-bfcf-ea4f738f03f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:51.096539 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b778f-bad1-41d4-bfcf-ea4f738f03f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:51.098319 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b778f-bad1-41d4-bfcf-ea4f738f03f2 service swift] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:51.113715 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7d554997-5e9c-4f83-97ab-e9f45942d464 None None] MFA Rules not processed for user `2e30dc9f40ab4a5cb18be722c914b833`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:51.120462 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7d554997-5e9c-4f83-97ab-e9f45942d464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:51.124552 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1208/2422] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Apr 11 13:57:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 11 13:57:51.395730 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1215/2423] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:51.422480 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b778f-bad1-41d4-bfcf-ea4f738f03f2 service swift] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:51.424917 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-e52b778f-bad1-41d4-bfcf-ea4f738f03f2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:51.642001 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b778f-bad1-41d4-bfcf-ea4f738f03f2 service swift] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:51.649041 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6590c-2857-4bd3-b862-427ee72a2a21 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cbf69574af4e25b940ec038f9e1bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:51.650715 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6590c-2857-4bd3-b862-427ee72a2a21 service glance] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:51.651103 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6590c-2857-4bd3-b862-427ee72a2a21 service glance] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:51.651485 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6590c-2857-4bd3-b862-427ee72a2a21 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:51.653702 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-deb6590c-2857-4bd3-b862-427ee72a2a21 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:51.803492 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6590c-2857-4bd3-b862-427ee72a2a21 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:51.805285 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6590c-2857-4bd3-b862-427ee72a2a21 service glance] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:51.835318 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1209/2424] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:57:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:57:52.092487 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c948c-5c90-4fdb-a60c-e96951586545 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:52.093016 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c948c-5c90-4fdb-a60c-e96951586545 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:52.093138 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c948c-5c90-4fdb-a60c-e96951586545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:52.102795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6590c-2857-4bd3-b862-427ee72a2a21 service glance] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:52.104631 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-deb6590c-2857-4bd3-b862-427ee72a2a21 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:52.122940 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6590c-2857-4bd3-b862-427ee72a2a21 service glance] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:52.130959 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9e4d2-769e-4f8a-95c9-ab626a38e4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:52.133890 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9e4d2-769e-4f8a-95c9-ab626a38e4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:52.134909 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9e4d2-769e-4f8a-95c9-ab626a38e4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:52.135905 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9e4d2-769e-4f8a-95c9-ab626a38e4ac admin admin] PATH_INFO: `/v3/projects/c6ffd5b8181740e4b3e1c1a0fc1c170f` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:52.149746 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-495c948c-5c90-4fdb-a60c-e96951586545 None None] MFA Rules not processed for user `920ed843195243f8abd6dfb2ebb3a549`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:52.151921 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-495c948c-5c90-4fdb-a60c-e96951586545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:52.159882 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca9e4d2-769e-4f8a-95c9-ab626a38e4ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6ffd5b8181740e4b3e1c1a0fc1c170f)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:52.168935 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca9e4d2-769e-4f8a-95c9-ab626a38e4ac admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:52.176593 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1216/2425] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Apr 11 13:57:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:52.214118 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c948c-5c90-4fdb-a60c-e96951586545 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:52.247950 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c948c-5c90-4fdb-a60c-e96951586545 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:52.274524 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2ca9e4d2-769e-4f8a-95c9-ab626a38e4ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6ffd5b8181740e4b3e1c1a0fc1c170f', 'request_id': 'req-2ca9e4d2-769e-4f8a-95c9-ab626a38e4ac'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:52.295618 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2ca9e4d2-769e-4f8a-95c9-ab626a38e4ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6ffd5b8181740e4b3e1c1a0fc1c170f', 'request_id': 'req-2ca9e4d2-769e-4f8a-95c9-ab626a38e4ac'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:52.324832 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2ca9e4d2-769e-4f8a-95c9-ab626a38e4ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6ffd5b8181740e4b3e1c1a0fc1c170f', 'request_id': 'req-2ca9e4d2-769e-4f8a-95c9-ab626a38e4ac'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:52.378888 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2ca9e4d2-769e-4f8a-95c9-ab626a38e4ac admin admin] The token cache is being invalidate because project c6ffd5b8181740e4b3e1c1a0fc1c170f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:57:52.379390 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2ca9e4d2-769e-4f8a-95c9-ab626a38e4ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:52.380205 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-2ca9e4d2-769e-4f8a-95c9-ab626a38e4ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:52.382003 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1210/2426] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:57:52 2022] DELETE /identity/v3/projects/c6ffd5b8181740e4b3e1c1a0fc1c170f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:52.387141 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9bb61-b230-4dd0-bc68-802b14ab0ff4 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:52.387526 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9bb61-b230-4dd0-bc68-802b14ab0ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:52.387959 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9bb61-b230-4dd0-bc68-802b14ab0ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:52.442650 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-69a9bb61-b230-4dd0-bc68-802b14ab0ff4 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:52.453735 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-69a9bb61-b230-4dd0-bc68-802b14ab0ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:52.468854 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe5f9e-92e6-4b1f-92be-afd3a08a742d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6660794b27ff4a7bbe9b6b043593598c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:52.471840 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe5f9e-92e6-4b1f-92be-afd3a08a742d service swift] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:52.471840 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe5f9e-92e6-4b1f-92be-afd3a08a742d service swift] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:52.472393 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe5f9e-92e6-4b1f-92be-afd3a08a742d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:52.477329 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-02fe5f9e-92e6-4b1f-92be-afd3a08a742d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:52.569747 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe5f9e-92e6-4b1f-92be-afd3a08a742d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:52.572063 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe5f9e-92e6-4b1f-92be-afd3a08a742d service swift] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:52.586238 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1211/2427] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:57:52.593888 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fb9d8-f414-443d-8b34-efdd019c47c8 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:52.594287 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fb9d8-f414-443d-8b34-efdd019c47c8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:52.594573 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fb9d8-f414-443d-8b34-efdd019c47c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:52.610923 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1217/2428] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Apr 11 13:57:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:57:52.648701 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-7f8fb9d8-f414-443d-8b34-efdd019c47c8 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:52.649911 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7f8fb9d8-f414-443d-8b34-efdd019c47c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:52.661635 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1212/2429] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:57:52.668221 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe5f9e-92e6-4b1f-92be-afd3a08a742d service swift] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:52.706987 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe5f9e-92e6-4b1f-92be-afd3a08a742d service swift] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:52.718961 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314c9d2-0249-49cf-8852-0b3659a78b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:52.719663 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314c9d2-0249-49cf-8852-0b3659a78b67 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:52.719955 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314c9d2-0249-49cf-8852-0b3659a78b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:52.720232 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314c9d2-0249-49cf-8852-0b3659a78b67 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:52.721173 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314c9d2-0249-49cf-8852-0b3659a78b67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:57:52.721479 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314c9d2-0249-49cf-8852-0b3659a78b67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:52.723097 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314c9d2-0249-49cf-8852-0b3659a78b67 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:52.755049 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1218/2430] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:57:52.759454 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fb9d8-f414-443d-8b34-efdd019c47c8 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:52.770046 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fb9d8-f414-443d-8b34-efdd019c47c8 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:52.786667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a64cef-eeac-4fb3-9dbe-3ad94ca6cca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:52.787359 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a64cef-eeac-4fb3-9dbe-3ad94ca6cca5 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:52.787663 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a64cef-eeac-4fb3-9dbe-3ad94ca6cca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:52.787993 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a64cef-eeac-4fb3-9dbe-3ad94ca6cca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:52.788689 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a64cef-eeac-4fb3-9dbe-3ad94ca6cca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:52.790672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a64cef-eeac-4fb3-9dbe-3ad94ca6cca5 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:52.898206 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1213/2431] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:57:52 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:57:52.900510 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314c9d2-0249-49cf-8852-0b3659a78b67 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:52.920627 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314c9d2-0249-49cf-8852-0b3659a78b67 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:53.144538 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d22646-3291-4130-ad09-90b7c402274f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:53.146302 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d22646-3291-4130-ad09-90b7c402274f admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:53.146302 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d22646-3291-4130-ad09-90b7c402274f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:53.146302 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d22646-3291-4130-ad09-90b7c402274f admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:53.146836 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d22646-3291-4130-ad09-90b7c402274f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:53.149196 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d22646-3291-4130-ad09-90b7c402274f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:53.184505 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1219/2432] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:57:52 2022] POST /identity/v3/users => generated 285 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:57:53.187825 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a64cef-eeac-4fb3-9dbe-3ad94ca6cca5 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:53.207041 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a64cef-eeac-4fb3-9dbe-3ad94ca6cca5 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:53.226092 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1cd88-b2ac-4e6d-9210-708c7908311c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:53.227302 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1cd88-b2ac-4e6d-9210-708c7908311c admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:53.228477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1cd88-b2ac-4e6d-9210-708c7908311c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:53.228945 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1cd88-b2ac-4e6d-9210-708c7908311c admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:53.229860 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1cd88-b2ac-4e6d-9210-708c7908311c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:53.235976 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1cd88-b2ac-4e6d-9210-708c7908311c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:53.267890 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1214/2433] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:57:53.272132 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d22646-3291-4130-ad09-90b7c402274f admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:53.293922 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d22646-3291-4130-ad09-90b7c402274f admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:53.311365 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a75b8-2426-460c-b4bb-372f052e2a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:53.313361 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a75b8-2426-460c-b4bb-372f052e2a19 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:53.316187 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a75b8-2426-460c-b4bb-372f052e2a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:53.316673 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a75b8-2426-460c-b4bb-372f052e2a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:53.321242 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a75b8-2426-460c-b4bb-372f052e2a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:53.328044 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a75b8-2426-460c-b4bb-372f052e2a19 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:53.368486 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1220/2434] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:57:53.369921 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1cd88-b2ac-4e6d-9210-708c7908311c admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:53.386421 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1cd88-b2ac-4e6d-9210-708c7908311c admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:53.406534 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f2c62-6e6e-4aad-b137-b7f106aceef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:53.407497 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f2c62-6e6e-4aad-b137-b7f106aceef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:53.407840 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f2c62-6e6e-4aad-b137-b7f106aceef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:53.408189 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f2c62-6e6e-4aad-b137-b7f106aceef6 admin admin] PATH_INFO: `/v3/projects/626d5ba1efe34953a6d00b0f0afd5013/users/4fd5089d5b5d4f71b5789cc10b7ff971/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:53.429310 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f2c62-6e6e-4aad-b137-b7f106aceef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=626d5ba1efe34953a6d00b0f0afd5013, user_id=4fd5089d5b5d4f71b5789cc10b7ff971, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:53.433097 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f2c62-6e6e-4aad-b137-b7f106aceef6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:53.454456 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1215/2435] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:57:53 2022] PUT /identity/v3/projects/626d5ba1efe34953a6d00b0f0afd5013/users/4fd5089d5b5d4f71b5789cc10b7ff971/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:53.456113 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa069869-6e93-42c0-9947-ed91eb852c5c None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:53.456887 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa069869-6e93-42c0-9947-ed91eb852c5c None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:53.456887 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa069869-6e93-42c0-9947-ed91eb852c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:53.496656 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-aa069869-6e93-42c0-9947-ed91eb852c5c None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:53.498700 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-aa069869-6e93-42c0-9947-ed91eb852c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:53.671750 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1221/2436] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:57:53.690242 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f2c62-6e6e-4aad-b137-b7f106aceef6 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:53.692194 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-dc6f2c62-6e6e-4aad-b137-b7f106aceef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:53.853861 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f2c62-6e6e-4aad-b137-b7f106aceef6 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:53.868358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90877eba-9b12-46d2-96fc-4317f5f59222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:53.871761 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90877eba-9b12-46d2-96fc-4317f5f59222 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:53.871761 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90877eba-9b12-46d2-96fc-4317f5f59222 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:53.871761 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90877eba-9b12-46d2-96fc-4317f5f59222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:53.893431 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90877eba-9b12-46d2-96fc-4317f5f59222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:53.895103 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90877eba-9b12-46d2-96fc-4317f5f59222 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:53.915770 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1216/2437] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:57:54.159979 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa069869-6e93-42c0-9947-ed91eb852c5c None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:54.162285 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-aa069869-6e93-42c0-9947-ed91eb852c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:54.191116 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa069869-6e93-42c0-9947-ed91eb852c5c None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:54.215356 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc816a-aab0-4162-8dde-b2c802f14e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:54.216598 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc816a-aab0-4162-8dde-b2c802f14e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:54.217175 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc816a-aab0-4162-8dde-b2c802f14e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:54.217606 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc816a-aab0-4162-8dde-b2c802f14e2d admin admin] PATH_INFO: `/v3/users/0d6e758bb05949339f9aff998a2e28ab` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:54.220773 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc816a-aab0-4162-8dde-b2c802f14e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d6e758bb05949339f9aff998a2e28ab)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:54.224686 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc816a-aab0-4162-8dde-b2c802f14e2d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:54.354711 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-22dc816a-aab0-4162-8dde-b2c802f14e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d6e758bb05949339f9aff998a2e28ab'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:54.355728 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-22dc816a-aab0-4162-8dde-b2c802f14e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d6e758bb05949339f9aff998a2e28ab'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:54.374690 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-22dc816a-aab0-4162-8dde-b2c802f14e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d6e758bb05949339f9aff998a2e28ab'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:54.407592 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-22dc816a-aab0-4162-8dde-b2c802f14e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d6e758bb05949339f9aff998a2e28ab'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:54.409116 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-22dc816a-aab0-4162-8dde-b2c802f14e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d6e758bb05949339f9aff998a2e28ab'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:54.449879 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1222/2438] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:57:54 2022] DELETE /identity/v3/users/0d6e758bb05949339f9aff998a2e28ab => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:54.451946 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba26e78-7fb4-4668-b11b-4bf8567eff2b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:54.452244 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba26e78-7fb4-4668-b11b-4bf8567eff2b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:54.452528 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba26e78-7fb4-4668-b11b-4bf8567eff2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:54.498210 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-dba26e78-7fb4-4668-b11b-4bf8567eff2b None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:54.500475 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-dba26e78-7fb4-4668-b11b-4bf8567eff2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:54.644875 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1217/2439] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:57:54.652055 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc816a-aab0-4162-8dde-b2c802f14e2d admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:54.654857 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-22dc816a-aab0-4162-8dde-b2c802f14e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:54.797838 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc816a-aab0-4162-8dde-b2c802f14e2d admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:54.806291 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4efc1-ef52-4993-a151-4840fdb2cef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:54.808816 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4efc1-ef52-4993-a151-4840fdb2cef9 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:54.809181 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4efc1-ef52-4993-a151-4840fdb2cef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:54.809689 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4efc1-ef52-4993-a151-4840fdb2cef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:54.840743 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4efc1-ef52-4993-a151-4840fdb2cef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:54.843199 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4efc1-ef52-4993-a151-4840fdb2cef9 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:54.874949 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1223/2440] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:57:55.479007 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba26e78-7fb4-4668-b11b-4bf8567eff2b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:55.480548 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-dba26e78-7fb4-4668-b11b-4bf8567eff2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:55.504938 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba26e78-7fb4-4668-b11b-4bf8567eff2b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:55.526836 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9115c2-7a2c-4f2b-87a4-ae77ae33b198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:55.526836 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9115c2-7a2c-4f2b-87a4-ae77ae33b198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:55.529586 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9115c2-7a2c-4f2b-87a4-ae77ae33b198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:55.529883 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9115c2-7a2c-4f2b-87a4-ae77ae33b198 admin admin] PATH_INFO: `/v3/projects/39d6b2131a8648e4abd488464eb030d8` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:55.533176 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9115c2-7a2c-4f2b-87a4-ae77ae33b198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d6b2131a8648e4abd488464eb030d8)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:55.540941 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9115c2-7a2c-4f2b-87a4-ae77ae33b198 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:55.714163 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-fa9115c2-7a2c-4f2b-87a4-ae77ae33b198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d6b2131a8648e4abd488464eb030d8', 'request_id': 'req-fa9115c2-7a2c-4f2b-87a4-ae77ae33b198'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:55.744987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-fa9115c2-7a2c-4f2b-87a4-ae77ae33b198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d6b2131a8648e4abd488464eb030d8', 'request_id': 'req-fa9115c2-7a2c-4f2b-87a4-ae77ae33b198'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:55.756238 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-fa9115c2-7a2c-4f2b-87a4-ae77ae33b198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d6b2131a8648e4abd488464eb030d8', 'request_id': 'req-fa9115c2-7a2c-4f2b-87a4-ae77ae33b198'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:55.781490 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-fa9115c2-7a2c-4f2b-87a4-ae77ae33b198 admin admin] The token cache is being invalidate because project 39d6b2131a8648e4abd488464eb030d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:57:55.781817 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-fa9115c2-7a2c-4f2b-87a4-ae77ae33b198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:55.784543 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-fa9115c2-7a2c-4f2b-87a4-ae77ae33b198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:57:55.787823 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1218/2441] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:57:55 2022] DELETE /identity/v3/projects/39d6b2131a8648e4abd488464eb030d8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:55.792813 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794a2f2-8a13-40b5-991b-aa06fa4066e4 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:55.793335 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794a2f2-8a13-40b5-991b-aa06fa4066e4 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:55.793418 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794a2f2-8a13-40b5-991b-aa06fa4066e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:55.839876 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-6794a2f2-8a13-40b5-991b-aa06fa4066e4 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:55.841168 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6794a2f2-8a13-40b5-991b-aa06fa4066e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:56.004452 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1224/2442] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:56.008788 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457258d0-4ea3-4414-86ef-897f7e3a6e1a None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:56.009382 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457258d0-4ea3-4414-86ef-897f7e3a6e1a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:56.009823 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457258d0-4ea3-4414-86ef-897f7e3a6e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:56.081230 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-457258d0-4ea3-4414-86ef-897f7e3a6e1a None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:56.084971 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-457258d0-4ea3-4414-86ef-897f7e3a6e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:56.116470 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1219/2443] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:56.123201 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794a2f2-8a13-40b5-991b-aa06fa4066e4 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:56.141416 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794a2f2-8a13-40b5-991b-aa06fa4066e4 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:56.152267 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da7b2e-2abc-4054-8e17-9dd537be32f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:56.152928 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da7b2e-2abc-4054-8e17-9dd537be32f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:56.153205 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da7b2e-2abc-4054-8e17-9dd537be32f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:56.153486 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da7b2e-2abc-4054-8e17-9dd537be32f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:56.154864 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da7b2e-2abc-4054-8e17-9dd537be32f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:57:56.155178 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da7b2e-2abc-4054-8e17-9dd537be32f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:56.156884 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da7b2e-2abc-4054-8e17-9dd537be32f6 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:56.185205 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1225/2444] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:57:56.190411 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457258d0-4ea3-4414-86ef-897f7e3a6e1a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:56.206928 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457258d0-4ea3-4414-86ef-897f7e3a6e1a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:56.221662 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dfa39-d3a0-4a5a-8dab-6009630eaea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:56.222638 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dfa39-d3a0-4a5a-8dab-6009630eaea2 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:56.222929 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dfa39-d3a0-4a5a-8dab-6009630eaea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:56.223207 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dfa39-d3a0-4a5a-8dab-6009630eaea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:56.224977 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74dfa39-d3a0-4a5a-8dab-6009630eaea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:56.227564 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74dfa39-d3a0-4a5a-8dab-6009630eaea2 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:56.360536 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da7b2e-2abc-4054-8e17-9dd537be32f6 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:56.364072 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1220/2445] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:57:56 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:57:56.375806 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da7b2e-2abc-4054-8e17-9dd537be32f6 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:56.567902 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1b460-0e91-4c49-b80e-103619247329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:56.568596 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1b460-0e91-4c49-b80e-103619247329 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:56.573290 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1b460-0e91-4c49-b80e-103619247329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:56.574951 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1b460-0e91-4c49-b80e-103619247329 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:56.575519 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1b460-0e91-4c49-b80e-103619247329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:56.587753 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1b460-0e91-4c49-b80e-103619247329 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:56.638083 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1226/2446] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:57:56 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:57:56.643011 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dfa39-d3a0-4a5a-8dab-6009630eaea2 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:56.666491 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dfa39-d3a0-4a5a-8dab-6009630eaea2 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:56.701908 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaff0bc-528f-4d1e-9d96-06b035e516fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:56.702862 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaff0bc-528f-4d1e-9d96-06b035e516fb admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:56.704072 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaff0bc-528f-4d1e-9d96-06b035e516fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:56.705568 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaff0bc-528f-4d1e-9d96-06b035e516fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:56.706688 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaff0bc-528f-4d1e-9d96-06b035e516fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:56.709124 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaff0bc-528f-4d1e-9d96-06b035e516fb admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:56.793159 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1221/2447] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:57:56.797571 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1b460-0e91-4c49-b80e-103619247329 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:56.819723 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1b460-0e91-4c49-b80e-103619247329 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:56.852350 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bf721-6843-4549-a337-125a86cc518d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:56.853051 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bf721-6843-4549-a337-125a86cc518d admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:56.853338 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bf721-6843-4549-a337-125a86cc518d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:56.853622 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bf721-6843-4549-a337-125a86cc518d admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:56.855489 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bf721-6843-4549-a337-125a86cc518d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:56.857029 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bf721-6843-4549-a337-125a86cc518d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:56.901820 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1227/2448] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:57:56.904362 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaff0bc-528f-4d1e-9d96-06b035e516fb admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:56.918613 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaff0bc-528f-4d1e-9d96-06b035e516fb admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:56.952418 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a584d52-2daa-4459-8286-94f715e237d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:56.953342 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a584d52-2daa-4459-8286-94f715e237d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:56.953625 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a584d52-2daa-4459-8286-94f715e237d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:56.953903 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a584d52-2daa-4459-8286-94f715e237d3 admin admin] PATH_INFO: `/v3/projects/267a407eb4994efbabe013ce88013e82/users/66296cb322d74c96bd657aed4a79eb00/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:57.020822 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a584d52-2daa-4459-8286-94f715e237d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=267a407eb4994efbabe013ce88013e82, user_id=66296cb322d74c96bd657aed4a79eb00, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:57.027728 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a584d52-2daa-4459-8286-94f715e237d3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:57.097299 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab75639-03c8-40fe-ab7c-fb2d9bf9bd77 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:57.097788 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab75639-03c8-40fe-ab7c-fb2d9bf9bd77 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:57.098012 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1222/2449] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:57:56 2022] PUT /identity/v3/projects/267a407eb4994efbabe013ce88013e82/users/66296cb322d74c96bd657aed4a79eb00/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:57:57.098289 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab75639-03c8-40fe-ab7c-fb2d9bf9bd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:57.326388 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7ab75639-03c8-40fe-ab7c-fb2d9bf9bd77 None None] MFA Rules not processed for user `66296cb322d74c96bd657aed4a79eb00`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:57:57.328196 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7ab75639-03c8-40fe-ab7c-fb2d9bf9bd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:57.661876 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1228/2450] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:57:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 566 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:57:57.679448 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a584d52-2daa-4459-8286-94f715e237d3 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:57:57.684319 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0a584d52-2daa-4459-8286-94f715e237d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:57:57.874883 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a584d52-2daa-4459-8286-94f715e237d3 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:57:57.889270 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be0b3d-d211-4d43-aeec-f2522f551e99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:57:57.892678 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be0b3d-d211-4d43-aeec-f2522f551e99 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:57:57.893152 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be0b3d-d211-4d43-aeec-f2522f551e99 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:57:57.893580 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be0b3d-d211-4d43-aeec-f2522f551e99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:57:57.913828 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be0b3d-d211-4d43-aeec-f2522f551e99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:57:57.915776 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be0b3d-d211-4d43-aeec-f2522f551e99 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:57:57.949080 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1223/2451] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:57:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:58:01.274058 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab75639-03c8-40fe-ab7c-fb2d9bf9bd77 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:01.485990 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab75639-03c8-40fe-ab7c-fb2d9bf9bd77 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:01.504023 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c2a4e-f055-40f0-b509-02000cc13ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:01.507096 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c2a4e-f055-40f0-b509-02000cc13ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:01.508464 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c2a4e-f055-40f0-b509-02000cc13ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:01.508817 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c2a4e-f055-40f0-b509-02000cc13ca5 admin admin] PATH_INFO: `/v3/users/66296cb322d74c96bd657aed4a79eb00` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:01.511749 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c2a4e-f055-40f0-b509-02000cc13ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66296cb322d74c96bd657aed4a79eb00)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:01.520564 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c2a4e-f055-40f0-b509-02000cc13ca5 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:01.636701 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-749c2a4e-f055-40f0-b509-02000cc13ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66296cb322d74c96bd657aed4a79eb00'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:58:01.637586 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-749c2a4e-f055-40f0-b509-02000cc13ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66296cb322d74c96bd657aed4a79eb00'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:58:01.657967 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-749c2a4e-f055-40f0-b509-02000cc13ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66296cb322d74c96bd657aed4a79eb00'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:58:01.684873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-749c2a4e-f055-40f0-b509-02000cc13ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66296cb322d74c96bd657aed4a79eb00'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:58:01.685597 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-749c2a4e-f055-40f0-b509-02000cc13ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66296cb322d74c96bd657aed4a79eb00'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:58:01.723856 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1229/2452] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:58:01 2022] DELETE /identity/v3/users/66296cb322d74c96bd657aed4a79eb00 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:58:01.728354 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8e8f2-b9a8-48e0-a5e2-d2e9e133eb89 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:01.729633 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8e8f2-b9a8-48e0-a5e2-d2e9e133eb89 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:01.730085 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8e8f2-b9a8-48e0-a5e2-d2e9e133eb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:01.777185 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-78b8e8f2-b9a8-48e0-a5e2-d2e9e133eb89 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:58:01.778704 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-78b8e8f2-b9a8-48e0-a5e2-d2e9e133eb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:02.046955 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1224/2453] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:58:02.057199 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c2a4e-f055-40f0-b509-02000cc13ca5 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:02.059027 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-749c2a4e-f055-40f0-b509-02000cc13ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:02.229970 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c2a4e-f055-40f0-b509-02000cc13ca5 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:02.239777 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ed19c-deb8-4371-b7f0-cf4021b507ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:02.240478 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ed19c-deb8-4371-b7f0-cf4021b507ac service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:02.240764 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ed19c-deb8-4371-b7f0-cf4021b507ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:02.241042 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ed19c-deb8-4371-b7f0-cf4021b507ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:02.271828 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ed19c-deb8-4371-b7f0-cf4021b507ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:02.273370 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ed19c-deb8-4371-b7f0-cf4021b507ac service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:02.304178 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1230/2454] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:58:03.375458 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8e8f2-b9a8-48e0-a5e2-d2e9e133eb89 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:03.377949 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-78b8e8f2-b9a8-48e0-a5e2-d2e9e133eb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:03.405426 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8e8f2-b9a8-48e0-a5e2-d2e9e133eb89 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:03.429034 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d7ed5-1f18-4204-8841-b3e6d0c01a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:03.429967 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d7ed5-1f18-4204-8841-b3e6d0c01a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:03.430291 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d7ed5-1f18-4204-8841-b3e6d0c01a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:03.430573 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d7ed5-1f18-4204-8841-b3e6d0c01a01 admin admin] PATH_INFO: `/v3/projects/267a407eb4994efbabe013ce88013e82` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:03.431890 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d7ed5-1f18-4204-8841-b3e6d0c01a01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=267a407eb4994efbabe013ce88013e82)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:03.434365 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d7ed5-1f18-4204-8841-b3e6d0c01a01 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:03.578555 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-0f5d7ed5-1f18-4204-8841-b3e6d0c01a01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '267a407eb4994efbabe013ce88013e82', 'request_id': 'req-0f5d7ed5-1f18-4204-8841-b3e6d0c01a01'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:58:03.598471 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-0f5d7ed5-1f18-4204-8841-b3e6d0c01a01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '267a407eb4994efbabe013ce88013e82', 'request_id': 'req-0f5d7ed5-1f18-4204-8841-b3e6d0c01a01'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:58:03.617904 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-0f5d7ed5-1f18-4204-8841-b3e6d0c01a01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '267a407eb4994efbabe013ce88013e82', 'request_id': 'req-0f5d7ed5-1f18-4204-8841-b3e6d0c01a01'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:58:03.661403 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-0f5d7ed5-1f18-4204-8841-b3e6d0c01a01 admin admin] The token cache is being invalidate because project 267a407eb4994efbabe013ce88013e82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:58:03.661607 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-0f5d7ed5-1f18-4204-8841-b3e6d0c01a01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:58:03.664074 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-0f5d7ed5-1f18-4204-8841-b3e6d0c01a01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:58:03.668842 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1225/2455] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:58:03 2022] DELETE /identity/v3/projects/267a407eb4994efbabe013ce88013e82 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:58:07.533269 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a725ac3-e3ab-4428-8f6b-e112cdd5b4d6 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:07.534211 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a725ac3-e3ab-4428-8f6b-e112cdd5b4d6 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:07.534669 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a725ac3-e3ab-4428-8f6b-e112cdd5b4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:07.569677 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-6a725ac3-e3ab-4428-8f6b-e112cdd5b4d6 None None] MFA Rules not processed for user `4fd5089d5b5d4f71b5789cc10b7ff971`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:58:07.571321 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6a725ac3-e3ab-4428-8f6b-e112cdd5b4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:07.696918 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d7ed5-1f18-4204-8841-b3e6d0c01a01 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:07.699218 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0f5d7ed5-1f18-4204-8841-b3e6d0c01a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:07.700016 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1231/2456] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:58:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:58:07.889045 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d7ed5-1f18-4204-8841-b3e6d0c01a01 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:07.896735 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15bc69-4f35-4fbd-ad43-ba56bbff1492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:07.903846 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15bc69-4f35-4fbd-ad43-ba56bbff1492 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:07.904294 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15bc69-4f35-4fbd-ad43-ba56bbff1492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:07.904686 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15bc69-4f35-4fbd-ad43-ba56bbff1492 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:07.905507 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15bc69-4f35-4fbd-ad43-ba56bbff1492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:07.908229 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15bc69-4f35-4fbd-ad43-ba56bbff1492 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:07.992660 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1226/2457] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:58:07 2022] POST /identity/v3/projects => generated 371 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 13:58:07.997826 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a725ac3-e3ab-4428-8f6b-e112cdd5b4d6 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:08.014973 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a725ac3-e3ab-4428-8f6b-e112cdd5b4d6 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:08.159268 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab7637-ce1b-4921-87a1-7ea7be02ddae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:08.160320 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab7637-ce1b-4921-87a1-7ea7be02ddae admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:08.161062 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab7637-ce1b-4921-87a1-7ea7be02ddae admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:08.161536 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab7637-ce1b-4921-87a1-7ea7be02ddae admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:08.162687 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab7637-ce1b-4921-87a1-7ea7be02ddae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:08.165091 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab7637-ce1b-4921-87a1-7ea7be02ddae admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:08.215764 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1232/2458] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:58:07 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:58:08.216857 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15bc69-4f35-4fbd-ad43-ba56bbff1492 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:08.234627 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15bc69-4f35-4fbd-ad43-ba56bbff1492 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:08.248710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacaad83-e156-4188-9066-2685f017dbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:08.250136 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacaad83-e156-4188-9066-2685f017dbcf admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:08.251166 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacaad83-e156-4188-9066-2685f017dbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:08.251931 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacaad83-e156-4188-9066-2685f017dbcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:08.252972 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacaad83-e156-4188-9066-2685f017dbcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:08.256851 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacaad83-e156-4188-9066-2685f017dbcf admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:08.286507 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1227/2459] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:58:08.288667 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab7637-ce1b-4921-87a1-7ea7be02ddae admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:08.301668 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab7637-ce1b-4921-87a1-7ea7be02ddae admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:08.320382 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b85be2-d02d-41fc-82ce-30c9bc0002df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:08.321691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b85be2-d02d-41fc-82ce-30c9bc0002df admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:08.322224 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b85be2-d02d-41fc-82ce-30c9bc0002df admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:08.322730 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b85be2-d02d-41fc-82ce-30c9bc0002df admin admin] PATH_INFO: `/v3/projects/d32bc40164104932a96a6eebb3b739b2/users/98c29b19e1f045849ddd61394c63989f/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:08.358046 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b85be2-d02d-41fc-82ce-30c9bc0002df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32bc40164104932a96a6eebb3b739b2, user_id=98c29b19e1f045849ddd61394c63989f, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:08.365334 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b85be2-d02d-41fc-82ce-30c9bc0002df admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:08.409193 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1233/2460] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:58:08 2022] PUT /identity/v3/projects/d32bc40164104932a96a6eebb3b739b2/users/98c29b19e1f045849ddd61394c63989f/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:58:08.410605 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacaad83-e156-4188-9066-2685f017dbcf admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:08.439968 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacaad83-e156-4188-9066-2685f017dbcf admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:08.864255 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7e6fc-181c-4336-9e3e-7d6a1134813c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:08.865832 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7e6fc-181c-4336-9e3e-7d6a1134813c admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:08.867772 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7e6fc-181c-4336-9e3e-7d6a1134813c admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:08.868315 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7e6fc-181c-4336-9e3e-7d6a1134813c admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:08.869292 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7e6fc-181c-4336-9e3e-7d6a1134813c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:08.877719 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7e6fc-181c-4336-9e3e-7d6a1134813c admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:08.907124 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1228/2461] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 13:58:08.909066 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b85be2-d02d-41fc-82ce-30c9bc0002df admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:08.928303 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b85be2-d02d-41fc-82ce-30c9bc0002df admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:08.950012 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808e373-8ea8-41b0-a593-ff8340f2c88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:08.961182 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808e373-8ea8-41b0-a593-ff8340f2c88e admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:08.961482 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808e373-8ea8-41b0-a593-ff8340f2c88e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:08.961769 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808e373-8ea8-41b0-a593-ff8340f2c88e admin admin] PATH_INFO: `/v3/projects/d32bc40164104932a96a6eebb3b739b2/users/98c29b19e1f045849ddd61394c63989f/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:08.968384 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808e373-8ea8-41b0-a593-ff8340f2c88e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32bc40164104932a96a6eebb3b739b2, user_id=98c29b19e1f045849ddd61394c63989f, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:08.989110 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808e373-8ea8-41b0-a593-ff8340f2c88e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:09.024082 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1234/2462] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:58:08 2022] PUT /identity/v3/projects/d32bc40164104932a96a6eebb3b739b2/users/98c29b19e1f045849ddd61394c63989f/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:58:11.470817 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c192f-c1da-4e83-810b-c16c2d92e1b4 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:11.471879 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c192f-c1da-4e83-810b-c16c2d92e1b4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:11.472417 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c192f-c1da-4e83-810b-c16c2d92e1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:11.493003 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4a7c192f-c1da-4e83-810b-c16c2d92e1b4 None None] MFA Rules not processed for user `920ed843195243f8abd6dfb2ebb3a549`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:58:11.494985 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4a7c192f-c1da-4e83-810b-c16c2d92e1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:11.663884 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1229/2463] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Apr 11 13:58:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:58:11.677504 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808e373-8ea8-41b0-a593-ff8340f2c88e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:11.679526 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2808e373-8ea8-41b0-a593-ff8340f2c88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:11.868235 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808e373-8ea8-41b0-a593-ff8340f2c88e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:11.882209 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e23a6-ff89-40e4-b7fd-b8beb56a2db0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6660794b27ff4a7bbe9b6b043593598c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:11.882961 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e23a6-ff89-40e4-b7fd-b8beb56a2db0 service swift] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:11.883304 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e23a6-ff89-40e4-b7fd-b8beb56a2db0 service swift] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:11.883580 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e23a6-ff89-40e4-b7fd-b8beb56a2db0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:11.904145 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e23a6-ff89-40e4-b7fd-b8beb56a2db0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:11.905766 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e23a6-ff89-40e4-b7fd-b8beb56a2db0 service swift] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:11.937505 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1235/2464] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Apr 11 13:58:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:58:11.995904 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bbe1b-41ff-4b07-b2aa-1d1639457ef3 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:11.998476 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bbe1b-41ff-4b07-b2aa-1d1639457ef3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:11.998476 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bbe1b-41ff-4b07-b2aa-1d1639457ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:12.030020 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-1d9bbe1b-41ff-4b07-b2aa-1d1639457ef3 None None] MFA Rules not processed for user `b3d95fb42f294675a9e9bb5f03304390`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:58:12.033762 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1d9bbe1b-41ff-4b07-b2aa-1d1639457ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:12.280016 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1230/2465] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:58:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:58:13.184603 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72270e9-a801-49cd-b2ce-f260388ab74e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:13.185146 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72270e9-a801-49cd-b2ce-f260388ab74e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:13.185146 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72270e9-a801-49cd-b2ce-f260388ab74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:13.219127 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a72270e9-a801-49cd-b2ce-f260388ab74e None None] MFA Rules not processed for user `920ed843195243f8abd6dfb2ebb3a549`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:58:13.220488 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a72270e9-a801-49cd-b2ce-f260388ab74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:13.240117 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1236/2466] 10.222.0.67 () {58 vars in 967 bytes} [Mon Apr 11 13:58:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:58:13.255051 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9bbe1b-41ff-4b07-b2aa-1d1639457ef3 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:13.282530 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9bbe1b-41ff-4b07-b2aa-1d1639457ef3 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:13.312386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e72af8-6202-42d6-b65b-d7ea7d3e4168 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6660794b27ff4a7bbe9b6b043593598c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:13.313378 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e72af8-6202-42d6-b65b-d7ea7d3e4168 service swift] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:13.313666 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e72af8-6202-42d6-b65b-d7ea7d3e4168 service swift] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:13.313951 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e72af8-6202-42d6-b65b-d7ea7d3e4168 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:13.350611 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e72af8-6202-42d6-b65b-d7ea7d3e4168 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:13.353868 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e72af8-6202-42d6-b65b-d7ea7d3e4168 service swift] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:13.393541 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1231/2467] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Apr 11 13:58:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:58:13.761270 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96831b1-afda-4eab-b012-7d756150b5b0 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:13.761563 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96831b1-afda-4eab-b012-7d756150b5b0 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:13.761848 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96831b1-afda-4eab-b012-7d756150b5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:13.798224 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-f96831b1-afda-4eab-b012-7d756150b5b0 None None] MFA Rules not processed for user `920ed843195243f8abd6dfb2ebb3a549`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:58:13.801001 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f96831b1-afda-4eab-b012-7d756150b5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:13.838368 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1237/2468] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Apr 11 13:58:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:58:13.846586 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e72af8-6202-42d6-b65b-d7ea7d3e4168 service swift] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:13.869627 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e72af8-6202-42d6-b65b-d7ea7d3e4168 service swift] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:13.882358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc9310-dbc4-410f-90b3-9faca5133b98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6660794b27ff4a7bbe9b6b043593598c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:13.883425 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc9310-dbc4-410f-90b3-9faca5133b98 service swift] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:13.884002 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc9310-dbc4-410f-90b3-9faca5133b98 service swift] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:13.884486 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc9310-dbc4-410f-90b3-9faca5133b98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:13.910134 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc9310-dbc4-410f-90b3-9faca5133b98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:13.912241 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc9310-dbc4-410f-90b3-9faca5133b98 service swift] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:13.927087 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1232/2469] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Apr 11 13:58:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:58:14.464071 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039d27d-448a-40f2-b12e-a24ab3000860 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:14.464572 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039d27d-448a-40f2-b12e-a24ab3000860 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:14.464783 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039d27d-448a-40f2-b12e-a24ab3000860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:14.483005 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7039d27d-448a-40f2-b12e-a24ab3000860 None None] MFA Rules not processed for user `920ed843195243f8abd6dfb2ebb3a549`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:58:14.484911 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7039d27d-448a-40f2-b12e-a24ab3000860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:14.494498 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1238/2470] 10.222.0.67 () {58 vars in 967 bytes} [Mon Apr 11 13:58:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:58:14.508899 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc9310-dbc4-410f-90b3-9faca5133b98 service swift] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:14.521079 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc9310-dbc4-410f-90b3-9faca5133b98 service swift] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:14.527446 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff39b3-fed5-48c5-9315-a2144e0e0eda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6660794b27ff4a7bbe9b6b043593598c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:14.528132 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff39b3-fed5-48c5-9315-a2144e0e0eda service swift] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:14.528421 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff39b3-fed5-48c5-9315-a2144e0e0eda service swift] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:14.528697 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff39b3-fed5-48c5-9315-a2144e0e0eda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:14.539256 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff39b3-fed5-48c5-9315-a2144e0e0eda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:14.542325 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff39b3-fed5-48c5-9315-a2144e0e0eda service swift] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:14.553907 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1233/2471] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Apr 11 13:58:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:58:17.157470 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039d27d-448a-40f2-b12e-a24ab3000860 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:17.157974 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7039d27d-448a-40f2-b12e-a24ab3000860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:17.269843 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039d27d-448a-40f2-b12e-a24ab3000860 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:17.276838 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824f71c-412a-4646-86f4-73577d537970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:17.277730 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824f71c-412a-4646-86f4-73577d537970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:17.278012 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824f71c-412a-4646-86f4-73577d537970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:17.278286 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824f71c-412a-4646-86f4-73577d537970 admin admin] PATH_INFO: `/v3/users/73000e2a51b8452e9e25ecde059ce0a8` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:17.279979 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824f71c-412a-4646-86f4-73577d537970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73000e2a51b8452e9e25ecde059ce0a8)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:17.283091 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824f71c-412a-4646-86f4-73577d537970 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:17.341862 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d824f71c-412a-4646-86f4-73577d537970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73000e2a51b8452e9e25ecde059ce0a8'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:58:17.342763 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d824f71c-412a-4646-86f4-73577d537970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73000e2a51b8452e9e25ecde059ce0a8'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:58:17.351956 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d824f71c-412a-4646-86f4-73577d537970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73000e2a51b8452e9e25ecde059ce0a8'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:58:17.361309 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d824f71c-412a-4646-86f4-73577d537970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73000e2a51b8452e9e25ecde059ce0a8'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:58:17.362016 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d824f71c-412a-4646-86f4-73577d537970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73000e2a51b8452e9e25ecde059ce0a8'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:58:17.382686 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1239/2472] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 13:58:17 2022] DELETE /identity/v3/users/73000e2a51b8452e9e25ecde059ce0a8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:58:17.387444 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99ba07-1054-4cf8-b8fb-f5177fe269f9 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:17.387959 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99ba07-1054-4cf8-b8fb-f5177fe269f9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:17.388059 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99ba07-1054-4cf8-b8fb-f5177fe269f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:17.418121 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-1c99ba07-1054-4cf8-b8fb-f5177fe269f9 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:58:17.419560 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1c99ba07-1054-4cf8-b8fb-f5177fe269f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:17.768772 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1234/2473] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:58:17.789298 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824f71c-412a-4646-86f4-73577d537970 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:17.791998 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d824f71c-412a-4646-86f4-73577d537970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:17.947090 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824f71c-412a-4646-86f4-73577d537970 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:17.969231 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da316fe6-89d9-496e-a1a8-6d7e351ae4d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:17.970703 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da316fe6-89d9-496e-a1a8-6d7e351ae4d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:17.970996 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da316fe6-89d9-496e-a1a8-6d7e351ae4d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:17.972243 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da316fe6-89d9-496e-a1a8-6d7e351ae4d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:17.984202 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da316fe6-89d9-496e-a1a8-6d7e351ae4d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:17.986370 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da316fe6-89d9-496e-a1a8-6d7e351ae4d2 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:17.999177 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1240/2474] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:58:18.017570 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99260cd9-8595-4826-952a-aaecdd4b2796 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:18.017922 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99260cd9-8595-4826-952a-aaecdd4b2796 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:18.018206 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99260cd9-8595-4826-952a-aaecdd4b2796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:18.047545 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-99260cd9-8595-4826-952a-aaecdd4b2796 None None] MFA Rules not processed for user `920ed843195243f8abd6dfb2ebb3a549`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:58:18.049402 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-99260cd9-8595-4826-952a-aaecdd4b2796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:18.139290 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1235/2475] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Apr 11 13:58:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:58:18.157397 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da316fe6-89d9-496e-a1a8-6d7e351ae4d2 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:18.159441 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-da316fe6-89d9-496e-a1a8-6d7e351ae4d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:18.248407 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da316fe6-89d9-496e-a1a8-6d7e351ae4d2 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:18.256875 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd1eaa-f5a2-420d-a404-9884c4701e5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6660794b27ff4a7bbe9b6b043593598c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:18.257929 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd1eaa-f5a2-420d-a404-9884c4701e5f service swift] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:18.259037 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd1eaa-f5a2-420d-a404-9884c4701e5f service swift] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:18.259533 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd1eaa-f5a2-420d-a404-9884c4701e5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:18.269756 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd1eaa-f5a2-420d-a404-9884c4701e5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:18.272579 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd1eaa-f5a2-420d-a404-9884c4701e5f service swift] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:18.286701 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1241/2476] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Apr 11 13:58:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:58:18.803164 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4eb73-229e-4c43-b743-057215531fb0 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:18.803831 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4eb73-229e-4c43-b743-057215531fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:18.803831 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4eb73-229e-4c43-b743-057215531fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:18.848723 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd1eaa-f5a2-420d-a404-9884c4701e5f service swift] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:18.850587 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f1cd1eaa-f5a2-420d-a404-9884c4701e5f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:18.875495 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd1eaa-f5a2-420d-a404-9884c4701e5f service swift] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:18.886869 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d836ab-88af-447d-95b3-bd60fd80a419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:18.888226 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d836ab-88af-447d-95b3-bd60fd80a419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:18.890144 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-22c4eb73-229e-4c43-b743-057215531fb0 None None] MFA Rules not processed for user `98c29b19e1f045849ddd61394c63989f`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:58:18.890669 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d836ab-88af-447d-95b3-bd60fd80a419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:18.891579 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d836ab-88af-447d-95b3-bd60fd80a419 admin admin] PATH_INFO: `/v3/projects/6b883dc95a4349fba7f113cbe48b4c51` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:18.892714 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-22c4eb73-229e-4c43-b743-057215531fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:18.894625 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d836ab-88af-447d-95b3-bd60fd80a419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b883dc95a4349fba7f113cbe48b4c51)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:18.915049 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d836ab-88af-447d-95b3-bd60fd80a419 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:19.026458 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a4d836ab-88af-447d-95b3-bd60fd80a419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b883dc95a4349fba7f113cbe48b4c51', 'request_id': 'req-a4d836ab-88af-447d-95b3-bd60fd80a419'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:58:19.051385 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a4d836ab-88af-447d-95b3-bd60fd80a419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b883dc95a4349fba7f113cbe48b4c51', 'request_id': 'req-a4d836ab-88af-447d-95b3-bd60fd80a419'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:58:19.068960 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a4d836ab-88af-447d-95b3-bd60fd80a419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b883dc95a4349fba7f113cbe48b4c51', 'request_id': 'req-a4d836ab-88af-447d-95b3-bd60fd80a419'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:58:19.092565 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a4d836ab-88af-447d-95b3-bd60fd80a419 admin admin] The token cache is being invalidate because project 6b883dc95a4349fba7f113cbe48b4c51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 13:58:19.092875 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a4d836ab-88af-447d-95b3-bd60fd80a419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:58:19.093295 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1236/2477] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:58:18 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:58:19.095122 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4eb73-229e-4c43-b743-057215531fb0 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:19.096186 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a4d836ab-88af-447d-95b3-bd60fd80a419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 13:58:19.097211 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-22c4eb73-229e-4c43-b743-057215531fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:19.099850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1242/2478] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 13:58:18 2022] DELETE /identity/v3/projects/6b883dc95a4349fba7f113cbe48b4c51 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 13:58:19.105260 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070261c-43ba-4751-92cf-09ba562cbf01 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:19.105543 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070261c-43ba-4751-92cf-09ba562cbf01 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:19.105865 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070261c-43ba-4751-92cf-09ba562cbf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:19.172586 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-f070261c-43ba-4751-92cf-09ba562cbf01 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:58:19.175059 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f070261c-43ba-4751-92cf-09ba562cbf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:19.314471 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1243/2479] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:58:19.316556 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac48b31-4525-4560-b8d5-16ca823c629a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:19.317119 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac48b31-4525-4560-b8d5-16ca823c629a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:19.318481 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac48b31-4525-4560-b8d5-16ca823c629a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:19.347403 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4eb73-229e-4c43-b743-057215531fb0 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:19.425707 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-3ac48b31-4525-4560-b8d5-16ca823c629a None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:58:19.430928 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3ac48b31-4525-4560-b8d5-16ca823c629a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:19.474106 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1244/2480] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:58:19.477745 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac48b31-4525-4560-b8d5-16ca823c629a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:19.516666 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac48b31-4525-4560-b8d5-16ca823c629a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:19.522832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33902d14-81b4-4145-b07f-aa6f7589ea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:19.524264 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33902d14-81b4-4145-b07f-aa6f7589ea28 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:19.525223 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33902d14-81b4-4145-b07f-aa6f7589ea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:19.525223 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33902d14-81b4-4145-b07f-aa6f7589ea28 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:19.525977 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33902d14-81b4-4145-b07f-aa6f7589ea28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 13:58:19.526414 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33902d14-81b4-4145-b07f-aa6f7589ea28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:19.529558 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33902d14-81b4-4145-b07f-aa6f7589ea28 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:19.560129 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1245/2481] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 13:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 13:58:19.561478 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33902d14-81b4-4145-b07f-aa6f7589ea28 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:19.585782 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30a1ed-fde0-44a5-9333-7399ac5dbedf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:19.587744 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30a1ed-fde0-44a5-9333-7399ac5dbedf service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:19.589522 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30a1ed-fde0-44a5-9333-7399ac5dbedf service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:19.589522 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30a1ed-fde0-44a5-9333-7399ac5dbedf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:19.594045 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-de30a1ed-fde0-44a5-9333-7399ac5dbedf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:19.600529 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33902d14-81b4-4145-b07f-aa6f7589ea28 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:19.612836 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee017ac-18f1-4238-bc53-53fc3fe179bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:19.615729 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee017ac-18f1-4238-bc53-53fc3fe179bf admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:19.615970 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee017ac-18f1-4238-bc53-53fc3fe179bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:19.616785 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee017ac-18f1-4238-bc53-53fc3fe179bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:19.616941 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee017ac-18f1-4238-bc53-53fc3fe179bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:19.619313 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee017ac-18f1-4238-bc53-53fc3fe179bf admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:19.657459 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1246/2482] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 13:58:19 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:58:19.663832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee017ac-18f1-4238-bc53-53fc3fe179bf admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:19.745036 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30a1ed-fde0-44a5-9333-7399ac5dbedf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:19.747918 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30a1ed-fde0-44a5-9333-7399ac5dbedf service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:19.771049 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee017ac-18f1-4238-bc53-53fc3fe179bf admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:19.776146 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1237/2483] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:58:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:58:19.787469 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec7a2f-36a4-429d-a022-dfc461576470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:19.788375 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec7a2f-36a4-429d-a022-dfc461576470 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:19.788886 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec7a2f-36a4-429d-a022-dfc461576470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:19.789193 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec7a2f-36a4-429d-a022-dfc461576470 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:19.789940 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec7a2f-36a4-429d-a022-dfc461576470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:19.795962 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec7a2f-36a4-429d-a022-dfc461576470 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:19.848094 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1247/2484] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 13:58:19 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 13:58:19.849141 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30a1ed-fde0-44a5-9333-7399ac5dbedf service nova] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:19.863875 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30a1ed-fde0-44a5-9333-7399ac5dbedf service nova] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:19.877745 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e6045-d5de-487d-9175-3311c9f31cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:19.878772 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e6045-d5de-487d-9175-3311c9f31cbc admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:19.879210 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e6045-d5de-487d-9175-3311c9f31cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:19.879656 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e6045-d5de-487d-9175-3311c9f31cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:19.880560 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e6045-d5de-487d-9175-3311c9f31cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:19.885062 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e6045-d5de-487d-9175-3311c9f31cbc admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:19.915998 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1238/2485] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:58:19.920950 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec7a2f-36a4-429d-a022-dfc461576470 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:19.942788 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec7a2f-36a4-429d-a022-dfc461576470 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:19.960356 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5710a-4eba-432b-bf63-fe23d7afa123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:19.961404 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5710a-4eba-432b-bf63-fe23d7afa123 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:19.961639 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5710a-4eba-432b-bf63-fe23d7afa123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:19.962082 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5710a-4eba-432b-bf63-fe23d7afa123 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:19.974385 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5710a-4eba-432b-bf63-fe23d7afa123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:19.977710 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5710a-4eba-432b-bf63-fe23d7afa123 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:20.041838 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1248/2486] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 13:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 13:58:20.042672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e6045-d5de-487d-9175-3311c9f31cbc admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:20.052900 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e6045-d5de-487d-9175-3311c9f31cbc admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:20.072325 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda2184-c487-474d-bbcf-c48ac2c319f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:20.074213 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda2184-c487-474d-bbcf-c48ac2c319f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:20.075812 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda2184-c487-474d-bbcf-c48ac2c319f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:20.076320 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda2184-c487-474d-bbcf-c48ac2c319f3 admin admin] PATH_INFO: `/v3/projects/62982ff988ec462a8189ea9ba7c8496b/users/f57da915d2c14f1484f6a30c86d4eadd/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:20.133801 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda2184-c487-474d-bbcf-c48ac2c319f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62982ff988ec462a8189ea9ba7c8496b, user_id=f57da915d2c14f1484f6a30c86d4eadd, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:20.139297 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda2184-c487-474d-bbcf-c48ac2c319f3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:20.165655 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1239/2487] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 13:58:20 2022] PUT /identity/v3/projects/62982ff988ec462a8189ea9ba7c8496b/users/f57da915d2c14f1484f6a30c86d4eadd/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 13:58:20.170199 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72934e87-bf2e-4ccb-8e94-12703f05bb87 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:20.170681 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72934e87-bf2e-4ccb-8e94-12703f05bb87 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:20.171039 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72934e87-bf2e-4ccb-8e94-12703f05bb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:20.205046 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-72934e87-bf2e-4ccb-8e94-12703f05bb87 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:58:20.219420 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-72934e87-bf2e-4ccb-8e94-12703f05bb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:20.486358 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1249/2488] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:58:20.524500 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda2184-c487-474d-bbcf-c48ac2c319f3 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:20.526746 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-8dda2184-c487-474d-bbcf-c48ac2c319f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:20.719535 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda2184-c487-474d-bbcf-c48ac2c319f3 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:20.726800 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45e112-871c-47ed-b2ca-de8e034e2cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:20.728522 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45e112-871c-47ed-b2ca-de8e034e2cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:20.729040 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45e112-871c-47ed-b2ca-de8e034e2cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:20.730571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45e112-871c-47ed-b2ca-de8e034e2cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:20.734824 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c199bd-933c-4b59-8499-47add6dad8ba None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:20.735122 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c199bd-933c-4b59-8499-47add6dad8ba None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:20.735656 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c199bd-933c-4b59-8499-47add6dad8ba None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:20.737492 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1250/2489] 10.222.0.67 () {54 vars in 921 bytes} [Mon Apr 11 13:58:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:58:20.747410 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45e112-871c-47ed-b2ca-de8e034e2cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:20.747922 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c32e41-2a69-43da-aa0b-de98724b1f91 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:20.748370 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c32e41-2a69-43da-aa0b-de98724b1f91 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:20.748834 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c32e41-2a69-43da-aa0b-de98724b1f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:20.750015 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45e112-871c-47ed-b2ca-de8e034e2cc3 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:20.764543 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1240/2490] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:58:20.860917 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c7c32e41-2a69-43da-aa0b-de98724b1f91 None None] MFA Rules not processed for user `fedd2314dc594bcba749bf7b0d1e50fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:58:20.866241 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c7c32e41-2a69-43da-aa0b-de98724b1f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:21.060885 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1251/2491] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Apr 11 13:58:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:58:21.074883 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45e112-871c-47ed-b2ca-de8e034e2cc3 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:21.077017 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ad45e112-871c-47ed-b2ca-de8e034e2cc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:21.266616 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45e112-871c-47ed-b2ca-de8e034e2cc3 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:21.270705 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59770219-07f8-420e-a1ba-14fc72d0a559 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cbf69574af4e25b940ec038f9e1bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:21.271615 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59770219-07f8-420e-a1ba-14fc72d0a559 service glance] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:21.272111 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59770219-07f8-420e-a1ba-14fc72d0a559 service glance] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:21.272543 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59770219-07f8-420e-a1ba-14fc72d0a559 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:21.304386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59770219-07f8-420e-a1ba-14fc72d0a559 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:21.304386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59770219-07f8-420e-a1ba-14fc72d0a559 service glance] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:21.318053 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1241/2492] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:58:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:58:21.429201 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3664beb-ded2-414b-bb6b-d6deedfbcaaf None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:21.430262 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3664beb-ded2-414b-bb6b-d6deedfbcaaf None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:21.430837 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3664beb-ded2-414b-bb6b-d6deedfbcaaf None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:21.432595 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1252/2493] 10.222.0.67 () {54 vars in 921 bytes} [Mon Apr 11 13:58:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 13:58:21.441905 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ed0a9-65d0-4a7d-bacc-38cc5e995edb None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:21.442241 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ed0a9-65d0-4a7d-bacc-38cc5e995edb None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:21.443098 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ed0a9-65d0-4a7d-bacc-38cc5e995edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:21.477694 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-6e5ed0a9-65d0-4a7d-bacc-38cc5e995edb None None] MFA Rules not processed for user `c084d218ea414d638ef2dc45364a492c`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:58:21.481096 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6e5ed0a9-65d0-4a7d-bacc-38cc5e995edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:21.499138 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1242/2494] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Apr 11 13:58:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:58:21.511367 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3664beb-ded2-414b-bb6b-d6deedfbcaaf None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:21.514731 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f3664beb-ded2-414b-bb6b-d6deedfbcaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:21.547325 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3664beb-ded2-414b-bb6b-d6deedfbcaaf None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:21.551836 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2febff-6633-453a-ae1a-12377c56f766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:21.552718 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2febff-6633-453a-ae1a-12377c56f766 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:21.553161 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2febff-6633-453a-ae1a-12377c56f766 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:21.553806 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2febff-6633-453a-ae1a-12377c56f766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:21.564681 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2febff-6633-453a-ae1a-12377c56f766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:21.566384 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2febff-6633-453a-ae1a-12377c56f766 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:21.576780 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1253/2495] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:58:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:58:21.836127 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73dd51-d252-43ff-9af9-a01ddc5607f2 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:21.836428 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73dd51-d252-43ff-9af9-a01ddc5607f2 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:21.836836 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73dd51-d252-43ff-9af9-a01ddc5607f2 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:21.838513 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1243/2496] 10.222.0.67 () {54 vars in 921 bytes} [Mon Apr 11 13:58:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 13:58:21.858801 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0548cbf-ec6b-4856-aa5f-f84ed7d40c53 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:21.859601 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0548cbf-ec6b-4856-aa5f-f84ed7d40c53 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:21.859876 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0548cbf-ec6b-4856-aa5f-f84ed7d40c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:21.934053 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a0548cbf-ec6b-4856-aa5f-f84ed7d40c53 None None] MFA Rules not processed for user `fedd2314dc594bcba749bf7b0d1e50fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:58:21.935385 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a0548cbf-ec6b-4856-aa5f-f84ed7d40c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:21.968841 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1254/2497] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Apr 11 13:58:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:58:21.990792 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73dd51-d252-43ff-9af9-a01ddc5607f2 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:22.008983 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73dd51-d252-43ff-9af9-a01ddc5607f2 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:22.018467 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c13f4f-c7d9-443a-a984-d9d5050ce4d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:22.019285 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c13f4f-c7d9-443a-a984-d9d5050ce4d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:22.019574 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c13f4f-c7d9-443a-a984-d9d5050ce4d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:22.019954 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c13f4f-c7d9-443a-a984-d9d5050ce4d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:22.044524 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c13f4f-c7d9-443a-a984-d9d5050ce4d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:22.049827 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c13f4f-c7d9-443a-a984-d9d5050ce4d4 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:22.080989 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1244/2498] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:58:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:58:23.372045 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cac4d-9a3b-4291-816c-d44f5b95d1b6 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:23.373340 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cac4d-9a3b-4291-816c-d44f5b95d1b6 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:23.373943 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cac4d-9a3b-4291-816c-d44f5b95d1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:23.438403 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-271cac4d-9a3b-4291-816c-d44f5b95d1b6 None None] MFA Rules not processed for user `f57da915d2c14f1484f6a30c86d4eadd`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:58:23.439680 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-271cac4d-9a3b-4291-816c-d44f5b95d1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:23.618823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1255/2499] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:58:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:58:23.628325 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c13f4f-c7d9-443a-a984-d9d5050ce4d4 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:23.629821 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-09c13f4f-c7d9-443a-a984-d9d5050ce4d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:23.737142 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcddb65-59e5-439c-b204-141aacddf390 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:23.737750 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcddb65-59e5-439c-b204-141aacddf390 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:23.738296 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcddb65-59e5-439c-b204-141aacddf390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:23.798256 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-dbcddb65-59e5-439c-b204-141aacddf390 None None] MFA Rules not processed for user `4fd5089d5b5d4f71b5789cc10b7ff971`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:58:23.799649 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-dbcddb65-59e5-439c-b204-141aacddf390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:23.877901 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c13f4f-c7d9-443a-a984-d9d5050ce4d4 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:23.882589 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0bc3b-f30a-4d47-9aad-e12e2243fbac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:23.883385 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0bc3b-f30a-4d47-9aad-e12e2243fbac service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:23.883808 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0bc3b-f30a-4d47-9aad-e12e2243fbac service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:23.884243 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0bc3b-f30a-4d47-9aad-e12e2243fbac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:23.907320 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0bc3b-f30a-4d47-9aad-e12e2243fbac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:23.909174 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0bc3b-f30a-4d47-9aad-e12e2243fbac service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:23.930139 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1245/2500] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:58:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:58:23.980660 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1256/2501] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:58:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:58:26.002903 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192033eb-d004-4626-bbe2-fc1ae7d98344 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:26.003599 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192033eb-d004-4626-bbe2-fc1ae7d98344 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:26.003599 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192033eb-d004-4626-bbe2-fc1ae7d98344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:26.026779 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-192033eb-d004-4626-bbe2-fc1ae7d98344 None None] MFA Rules not processed for user `f57da915d2c14f1484f6a30c86d4eadd`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:58:26.028590 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-192033eb-d004-4626-bbe2-fc1ae7d98344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:26.040904 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1246/2502] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:58:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:58:30.775206 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcddb65-59e5-439c-b204-141aacddf390 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:30.776718 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-dbcddb65-59e5-439c-b204-141aacddf390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:30.872356 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcddb65-59e5-439c-b204-141aacddf390 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:30.878650 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac971c7-2f1d-4a08-9f1d-f7cb359a8b36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1885d4d35b6743299a73b3c12b1793b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:30.879516 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac971c7-2f1d-4a08-9f1d-f7cb359a8b36 service placement] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:30.883754 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac971c7-2f1d-4a08-9f1d-f7cb359a8b36 service placement] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:30.883754 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac971c7-2f1d-4a08-9f1d-f7cb359a8b36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:30.883754 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0ac971c7-2f1d-4a08-9f1d-f7cb359a8b36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:30.899950 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac971c7-2f1d-4a08-9f1d-f7cb359a8b36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:30.901583 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac971c7-2f1d-4a08-9f1d-f7cb359a8b36 service placement] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:30.912228 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1257/2503] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:58:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:58:32.006720 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92fd16-fbbb-434d-8415-45fc52af44f4 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:32.007241 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92fd16-fbbb-434d-8415-45fc52af44f4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:32.007343 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92fd16-fbbb-434d-8415-45fc52af44f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:32.062298 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-9c92fd16-fbbb-434d-8415-45fc52af44f4 None None] MFA Rules not processed for user `920ed843195243f8abd6dfb2ebb3a549`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:58:32.063486 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9c92fd16-fbbb-434d-8415-45fc52af44f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:32.135861 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1247/2504] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Apr 11 13:58:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:58:32.146303 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac971c7-2f1d-4a08-9f1d-f7cb359a8b36 service placement] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:32.148830 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0ac971c7-2f1d-4a08-9f1d-f7cb359a8b36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:32.261691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac971c7-2f1d-4a08-9f1d-f7cb359a8b36 service placement] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:32.269351 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fd641-f577-42cd-9201-ebe3b88479ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6660794b27ff4a7bbe9b6b043593598c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:32.270020 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fd641-f577-42cd-9201-ebe3b88479ae service swift] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:32.270306 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fd641-f577-42cd-9201-ebe3b88479ae service swift] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:32.270579 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fd641-f577-42cd-9201-ebe3b88479ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:32.287970 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3fd641-f577-42cd-9201-ebe3b88479ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:32.290036 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3fd641-f577-42cd-9201-ebe3b88479ae service swift] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:32.299665 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1258/2505] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Apr 11 13:58:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:58:56.519172 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a0362-2ac6-4f96-8d62-7d7c1237be34 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:56.520101 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a0362-2ac6-4f96-8d62-7d7c1237be34 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:56.520459 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a0362-2ac6-4f96-8d62-7d7c1237be34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:56.541102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-056a0362-2ac6-4f96-8d62-7d7c1237be34 None None] MFA Rules not processed for user `920ed843195243f8abd6dfb2ebb3a549`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:58:56.542315 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-056a0362-2ac6-4f96-8d62-7d7c1237be34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:58:56.550073 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1248/2506] 10.222.0.67 () {58 vars in 967 bytes} [Mon Apr 11 13:58:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 13:58:56.571654 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fd641-f577-42cd-9201-ebe3b88479ae service swift] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:58:56.582851 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fd641-f577-42cd-9201-ebe3b88479ae service swift] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:58:56.588173 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec68d5a-279c-4abc-bc6a-4b7e2db2a6c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6660794b27ff4a7bbe9b6b043593598c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:58:56.588829 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec68d5a-279c-4abc-bc6a-4b7e2db2a6c9 service swift] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:58:56.589112 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec68d5a-279c-4abc-bc6a-4b7e2db2a6c9 service swift] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:58:56.589425 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec68d5a-279c-4abc-bc6a-4b7e2db2a6c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:58:56.598546 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec68d5a-279c-4abc-bc6a-4b7e2db2a6c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:58:56.600169 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec68d5a-279c-4abc-bc6a-4b7e2db2a6c9 service swift] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:58:56.608778 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1259/2507] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Apr 11 13:58:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 13:59:03.526917 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a0362-2ac6-4f96-8d62-7d7c1237be34 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:59:03.536798 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a0362-2ac6-4f96-8d62-7d7c1237be34 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:59:03.540792 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce1533-72df-487b-8395-4675d45beaa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:59:03.541531 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce1533-72df-487b-8395-4675d45beaa2 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:59:03.541882 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce1533-72df-487b-8395-4675d45beaa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:59:03.542182 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce1533-72df-487b-8395-4675d45beaa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:59:03.544001 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-90ce1533-72df-487b-8395-4675d45beaa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:59:03.606368 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce1533-72df-487b-8395-4675d45beaa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:59:03.608010 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce1533-72df-487b-8395-4675d45beaa2 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:59:03.617696 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1249/2508] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:59:03 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:59:06.561639 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec68d5a-279c-4abc-bc6a-4b7e2db2a6c9 service swift] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 13:59:06.571505 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec68d5a-279c-4abc-bc6a-4b7e2db2a6c9 service swift] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 13:59:06.575240 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68003de-8614-47b0-ab52-2ef940725460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 13:59:06.576464 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68003de-8614-47b0-ab52-2ef940725460 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:59:06.576846 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68003de-8614-47b0-ab52-2ef940725460 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:59:06.577159 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68003de-8614-47b0-ab52-2ef940725460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:59:06.579063 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f68003de-8614-47b0-ab52-2ef940725460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:59:06.641728 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68003de-8614-47b0-ab52-2ef940725460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 13:59:06.643183 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68003de-8614-47b0-ab52-2ef940725460 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 13:59:06.652902 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1260/2509] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 13:59:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 13:59:18.246261 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e37c5-c69d-49d7-a37e-c4b3842ee086 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:59:18.247302 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e37c5-c69d-49d7-a37e-c4b3842ee086 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:59:18.247412 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e37c5-c69d-49d7-a37e-c4b3842ee086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:59:18.264575 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-803e37c5-c69d-49d7-a37e-c4b3842ee086 None None] MFA Rules not processed for user `cfe3f01cd2f742f4903ed97da6b6923c`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:59:18.265786 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-803e37c5-c69d-49d7-a37e-c4b3842ee086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:59:18.317129 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1250/2510] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:59:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 13:59:49.588369 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a5f64-3c22-45af-bc23-b0832fcb421d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 13:59:49.588929 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a5f64-3c22-45af-bc23-b0832fcb421d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 13:59:49.588929 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a5f64-3c22-45af-bc23-b0832fcb421d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 13:59:49.606637 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-a68a5f64-3c22-45af-bc23-b0832fcb421d None None] MFA Rules not processed for user `f57da915d2c14f1484f6a30c86d4eadd`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 13:59:49.608358 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a68a5f64-3c22-45af-bc23-b0832fcb421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 13:59:49.615216 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1261/2511] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 13:59:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:00:10.772532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4470220-55f3-442c-866e-951be73b3b28 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:10.773007 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4470220-55f3-442c-866e-951be73b3b28 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:10.773007 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4470220-55f3-442c-866e-951be73b3b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:10.790329 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-d4470220-55f3-442c-866e-951be73b3b28 None None] MFA Rules not processed for user `539174103f414528829d033481b83b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:00:10.791535 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d4470220-55f3-442c-866e-951be73b3b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:00:10.843395 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1251/2512] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:00:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:00:31.909819 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a5f64-3c22-45af-bc23-b0832fcb421d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:00:31.919708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a5f64-3c22-45af-bc23-b0832fcb421d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:00:31.923217 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60f69f-f972-47e8-b253-246e713822b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:00:31.923899 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60f69f-f972-47e8-b253-246e713822b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:31.925266 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60f69f-f972-47e8-b253-246e713822b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:31.925553 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60f69f-f972-47e8-b253-246e713822b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:31.927327 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ec60f69f-f972-47e8-b253-246e713822b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:00:31.940563 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60f69f-f972-47e8-b253-246e713822b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:00:31.941983 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60f69f-f972-47e8-b253-246e713822b0 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:00:31.953445 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1262/2513] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:00:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:00:33.122635 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4470220-55f3-442c-866e-951be73b3b28 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:00:33.131874 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4470220-55f3-442c-866e-951be73b3b28 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:00:33.135307 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0d5ed-80bb-4cc2-95ec-968882fecb8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:00:33.136488 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0d5ed-80bb-4cc2-95ec-968882fecb8e service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:33.136983 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0d5ed-80bb-4cc2-95ec-968882fecb8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:33.137264 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0d5ed-80bb-4cc2-95ec-968882fecb8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:33.139006 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-30f0d5ed-80bb-4cc2-95ec-968882fecb8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:00:33.152477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0d5ed-80bb-4cc2-95ec-968882fecb8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:00:33.154032 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f0d5ed-80bb-4cc2-95ec-968882fecb8e service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:00:33.165401 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1252/2514] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:00:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:00:37.784550 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60f69f-f972-47e8-b253-246e713822b0 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:00:37.786624 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ec60f69f-f972-47e8-b253-246e713822b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:00:37.801298 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60f69f-f972-47e8-b253-246e713822b0 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:00:37.808276 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc18b2-a34f-4fee-9bd5-bc4fe00846f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:00:37.809127 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc18b2-a34f-4fee-9bd5-bc4fe00846f3 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:37.809388 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc18b2-a34f-4fee-9bd5-bc4fe00846f3 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:37.809747 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc18b2-a34f-4fee-9bd5-bc4fe00846f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:37.811835 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-08bc18b2-a34f-4fee-9bd5-bc4fe00846f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:00:37.825017 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc18b2-a34f-4fee-9bd5-bc4fe00846f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:00:37.826671 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc18b2-a34f-4fee-9bd5-bc4fe00846f3 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:00:37.836978 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1263/2515] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:00:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:00:42.911325 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0d5ed-80bb-4cc2-95ec-968882fecb8e service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:00:42.920377 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0d5ed-80bb-4cc2-95ec-968882fecb8e service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:00:42.924210 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8f542-57f5-4f41-98f4-ade877f282f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:00:42.924848 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8f542-57f5-4f41-98f4-ade877f282f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:42.925203 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8f542-57f5-4f41-98f4-ade877f282f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:42.925464 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8f542-57f5-4f41-98f4-ade877f282f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:42.927274 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b8d8f542-57f5-4f41-98f4-ade877f282f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:00:42.939549 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8f542-57f5-4f41-98f4-ade877f282f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:00:42.941012 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8f542-57f5-4f41-98f4-ade877f282f4 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:00:42.950412 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1253/2516] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:00:43.877304 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc18b2-a34f-4fee-9bd5-bc4fe00846f3 service nova] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:00:43.887858 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc18b2-a34f-4fee-9bd5-bc4fe00846f3 service nova] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:00:43.892721 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76f582-40bd-4df9-8b34-fda97bc511f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:00:43.893604 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76f582-40bd-4df9-8b34-fda97bc511f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:43.893871 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76f582-40bd-4df9-8b34-fda97bc511f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:43.894154 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76f582-40bd-4df9-8b34-fda97bc511f4 admin admin] PATH_INFO: `/v3/users/f57da915d2c14f1484f6a30c86d4eadd` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:43.895450 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76f582-40bd-4df9-8b34-fda97bc511f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f57da915d2c14f1484f6a30c86d4eadd)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:00:43.897433 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76f582-40bd-4df9-8b34-fda97bc511f4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:00:43.945491 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bb76f582-40bd-4df9-8b34-fda97bc511f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f57da915d2c14f1484f6a30c86d4eadd'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:00:43.946163 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bb76f582-40bd-4df9-8b34-fda97bc511f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f57da915d2c14f1484f6a30c86d4eadd'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:00:43.953188 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bb76f582-40bd-4df9-8b34-fda97bc511f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f57da915d2c14f1484f6a30c86d4eadd'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:00:43.962052 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bb76f582-40bd-4df9-8b34-fda97bc511f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f57da915d2c14f1484f6a30c86d4eadd'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:00:43.962708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-bb76f582-40bd-4df9-8b34-fda97bc511f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f57da915d2c14f1484f6a30c86d4eadd'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:00:43.980666 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1264/2517] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:00:43 2022] DELETE /identity/v3/users/f57da915d2c14f1484f6a30c86d4eadd => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:00:44.410665 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8f542-57f5-4f41-98f4-ade877f282f4 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:00:44.425880 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8f542-57f5-4f41-98f4-ade877f282f4 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:00:44.483446 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c7d8f-5ef8-4f4c-b892-e89f75921cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:00:44.484353 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c7d8f-5ef8-4f4c-b892-e89f75921cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:44.484632 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c7d8f-5ef8-4f4c-b892-e89f75921cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:44.484897 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c7d8f-5ef8-4f4c-b892-e89f75921cd5 admin admin] PATH_INFO: `/v3/projects/62982ff988ec462a8189ea9ba7c8496b` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:44.486060 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c7d8f-5ef8-4f4c-b892-e89f75921cd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62982ff988ec462a8189ea9ba7c8496b)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:00:44.488014 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c7d8f-5ef8-4f4c-b892-e89f75921cd5 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:00:44.535177 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-652c7d8f-5ef8-4f4c-b892-e89f75921cd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62982ff988ec462a8189ea9ba7c8496b', 'request_id': 'req-652c7d8f-5ef8-4f4c-b892-e89f75921cd5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:00:44.543986 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-652c7d8f-5ef8-4f4c-b892-e89f75921cd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62982ff988ec462a8189ea9ba7c8496b', 'request_id': 'req-652c7d8f-5ef8-4f4c-b892-e89f75921cd5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:00:44.550138 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-652c7d8f-5ef8-4f4c-b892-e89f75921cd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62982ff988ec462a8189ea9ba7c8496b', 'request_id': 'req-652c7d8f-5ef8-4f4c-b892-e89f75921cd5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:00:44.562783 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-652c7d8f-5ef8-4f4c-b892-e89f75921cd5 admin admin] The token cache is being invalidate because project 62982ff988ec462a8189ea9ba7c8496b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:00:44.563070 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-652c7d8f-5ef8-4f4c-b892-e89f75921cd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:00:44.563749 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-652c7d8f-5ef8-4f4c-b892-e89f75921cd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:00:44.565301 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1254/2518] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:00:44 2022] DELETE /identity/v3/projects/62982ff988ec462a8189ea9ba7c8496b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:00:46.323330 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76f582-40bd-4df9-8b34-fda97bc511f4 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:00:46.325137 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-bb76f582-40bd-4df9-8b34-fda97bc511f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:00:46.343551 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76f582-40bd-4df9-8b34-fda97bc511f4 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:00:46.398609 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b579f-bba3-4639-b025-cb80441051b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:00:46.399583 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b579f-bba3-4639-b025-cb80441051b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:46.399903 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b579f-bba3-4639-b025-cb80441051b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:46.400182 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b579f-bba3-4639-b025-cb80441051b6 admin admin] PATH_INFO: `/v3/users/cfe3f01cd2f742f4903ed97da6b6923c` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:46.401506 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b579f-bba3-4639-b025-cb80441051b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe3f01cd2f742f4903ed97da6b6923c)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:00:46.403437 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b579f-bba3-4639-b025-cb80441051b6 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:00:46.448983 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-875b579f-bba3-4639-b025-cb80441051b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe3f01cd2f742f4903ed97da6b6923c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:00:46.449664 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-875b579f-bba3-4639-b025-cb80441051b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe3f01cd2f742f4903ed97da6b6923c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:00:46.456323 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-875b579f-bba3-4639-b025-cb80441051b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe3f01cd2f742f4903ed97da6b6923c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:00:46.463180 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-875b579f-bba3-4639-b025-cb80441051b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe3f01cd2f742f4903ed97da6b6923c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:00:46.463902 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-875b579f-bba3-4639-b025-cb80441051b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe3f01cd2f742f4903ed97da6b6923c'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:00:46.481188 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1265/2519] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:00:46 2022] DELETE /identity/v3/users/cfe3f01cd2f742f4903ed97da6b6923c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:00:46.651710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c7d8f-5ef8-4f4c-b892-e89f75921cd5 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:00:46.653176 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-652c7d8f-5ef8-4f4c-b892-e89f75921cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:00:46.667746 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c7d8f-5ef8-4f4c-b892-e89f75921cd5 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:00:46.724606 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca3237-239a-43c4-91ce-24751f19a7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:00:46.725468 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca3237-239a-43c4-91ce-24751f19a7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:46.725750 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca3237-239a-43c4-91ce-24751f19a7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:46.726024 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca3237-239a-43c4-91ce-24751f19a7fe admin admin] PATH_INFO: `/v3/projects/7e9487af89de4df6b7592a993fc4827e` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:46.727189 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca3237-239a-43c4-91ce-24751f19a7fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e9487af89de4df6b7592a993fc4827e)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:00:46.729761 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca3237-239a-43c4-91ce-24751f19a7fe admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:00:46.772834 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-40ca3237-239a-43c4-91ce-24751f19a7fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e9487af89de4df6b7592a993fc4827e', 'request_id': 'req-40ca3237-239a-43c4-91ce-24751f19a7fe'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:00:46.780384 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-40ca3237-239a-43c4-91ce-24751f19a7fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e9487af89de4df6b7592a993fc4827e', 'request_id': 'req-40ca3237-239a-43c4-91ce-24751f19a7fe'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:00:46.785903 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-40ca3237-239a-43c4-91ce-24751f19a7fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e9487af89de4df6b7592a993fc4827e', 'request_id': 'req-40ca3237-239a-43c4-91ce-24751f19a7fe'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:00:46.797019 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-40ca3237-239a-43c4-91ce-24751f19a7fe admin admin] The token cache is being invalidate because project 7e9487af89de4df6b7592a993fc4827e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:00:46.797305 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-40ca3237-239a-43c4-91ce-24751f19a7fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:00:46.797945 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-40ca3237-239a-43c4-91ce-24751f19a7fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:00:46.799476 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1255/2520] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:00:46 2022] DELETE /identity/v3/projects/7e9487af89de4df6b7592a993fc4827e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:00:46.804448 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a00a9-71eb-4895-af1f-a860979896e7 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:46.804766 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a00a9-71eb-4895-af1f-a860979896e7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:46.805045 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a00a9-71eb-4895-af1f-a860979896e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:46.823206 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-4e5a00a9-71eb-4895-af1f-a860979896e7 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:00:46.824441 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4e5a00a9-71eb-4895-af1f-a860979896e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:00:46.881191 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1266/2521] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:00:46.888888 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d15c4-3319-4237-95a9-8e33085ece4c None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:46.889179 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d15c4-3319-4237-95a9-8e33085ece4c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:46.889459 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d15c4-3319-4237-95a9-8e33085ece4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:46.907442 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-1e0d15c4-3319-4237-95a9-8e33085ece4c None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:00:46.908682 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1e0d15c4-3319-4237-95a9-8e33085ece4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:00:46.916948 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1256/2522] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:00:46.921165 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a00a9-71eb-4895-af1f-a860979896e7 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:00:46.930639 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a00a9-71eb-4895-af1f-a860979896e7 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:00:46.935878 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b7978-6587-4a10-910c-0ca95ab7d191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:00:46.936532 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b7978-6587-4a10-910c-0ca95ab7d191 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:46.936815 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b7978-6587-4a10-910c-0ca95ab7d191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:46.937094 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b7978-6587-4a10-910c-0ca95ab7d191 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:46.937819 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b7978-6587-4a10-910c-0ca95ab7d191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 14:00:46.938124 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b7978-6587-4a10-910c-0ca95ab7d191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:00:46.939744 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b7978-6587-4a10-910c-0ca95ab7d191 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:00:46.951216 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1267/2523] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 14:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 14:00:46.955215 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d15c4-3319-4237-95a9-8e33085ece4c None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:00:46.964851 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d15c4-3319-4237-95a9-8e33085ece4c None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:00:46.969510 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899805b-9bd8-40fb-8843-9bbc47a61578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:00:46.970153 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899805b-9bd8-40fb-8843-9bbc47a61578 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:46.970493 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899805b-9bd8-40fb-8843-9bbc47a61578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:46.970772 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899805b-9bd8-40fb-8843-9bbc47a61578 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:46.971466 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899805b-9bd8-40fb-8843-9bbc47a61578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:00:46.973391 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899805b-9bd8-40fb-8843-9bbc47a61578 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:00:46.998477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1257/2524] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:00:46 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:00:47.002511 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b7978-6587-4a10-910c-0ca95ab7d191 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:00:47.012442 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b7978-6587-4a10-910c-0ca95ab7d191 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:00:47.068067 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbffb66-6826-4126-a6ef-ba79c27fe6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:00:47.068671 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbffb66-6826-4126-a6ef-ba79c27fe6ce admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:47.068956 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbffb66-6826-4126-a6ef-ba79c27fe6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:47.069232 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbffb66-6826-4126-a6ef-ba79c27fe6ce admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:47.069924 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbffb66-6826-4126-a6ef-ba79c27fe6ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:00:47.071920 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbffb66-6826-4126-a6ef-ba79c27fe6ce admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:00:47.090866 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1268/2525] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:00:47 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:00:47.094952 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899805b-9bd8-40fb-8843-9bbc47a61578 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:00:47.105759 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899805b-9bd8-40fb-8843-9bbc47a61578 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:00:47.110346 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61f10a-74b7-428f-be0a-d2e38d3916d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:00:47.111013 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61f10a-74b7-428f-be0a-d2e38d3916d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:47.111297 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61f10a-74b7-428f-be0a-d2e38d3916d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:47.111576 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61f10a-74b7-428f-be0a-d2e38d3916d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:47.112343 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61f10a-74b7-428f-be0a-d2e38d3916d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:00:47.113991 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61f10a-74b7-428f-be0a-d2e38d3916d3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:00:47.126257 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1258/2526] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:00:47.130249 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbffb66-6826-4126-a6ef-ba79c27fe6ce admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:00:47.140415 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbffb66-6826-4126-a6ef-ba79c27fe6ce admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:00:47.145016 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abcfcc-b92c-40ed-82cc-9e45a20caade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:00:47.145670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abcfcc-b92c-40ed-82cc-9e45a20caade admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:47.145956 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abcfcc-b92c-40ed-82cc-9e45a20caade admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:47.146232 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abcfcc-b92c-40ed-82cc-9e45a20caade admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:47.146958 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abcfcc-b92c-40ed-82cc-9e45a20caade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:00:47.148606 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abcfcc-b92c-40ed-82cc-9e45a20caade admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:00:47.160424 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1269/2527] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:00:47.164528 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61f10a-74b7-428f-be0a-d2e38d3916d3 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:00:47.174343 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61f10a-74b7-428f-be0a-d2e38d3916d3 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:00:47.179144 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a777848-f7c1-4daf-b259-e778ba5e7e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:00:47.180057 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a777848-f7c1-4daf-b259-e778ba5e7e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:47.180345 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a777848-f7c1-4daf-b259-e778ba5e7e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:47.180616 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a777848-f7c1-4daf-b259-e778ba5e7e38 admin admin] PATH_INFO: `/v3/projects/63cddbab1b664b5a89b56d5632d2f62e/users/2cbcdc40fea745f48e1dfc62a732b7ee/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:47.195133 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a777848-f7c1-4daf-b259-e778ba5e7e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cddbab1b664b5a89b56d5632d2f62e, user_id=2cbcdc40fea745f48e1dfc62a732b7ee, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:00:47.198604 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a777848-f7c1-4daf-b259-e778ba5e7e38 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:00:47.210586 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1259/2528] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:00:47 2022] PUT /identity/v3/projects/63cddbab1b664b5a89b56d5632d2f62e/users/2cbcdc40fea745f48e1dfc62a732b7ee/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:00:47.215615 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf92591-283f-462a-adff-7794d0c2992b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:47.215926 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf92591-283f-462a-adff-7794d0c2992b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:47.216207 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf92591-283f-462a-adff-7794d0c2992b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:47.233011 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-6cf92591-283f-462a-adff-7794d0c2992b None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:00:47.234198 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6cf92591-283f-462a-adff-7794d0c2992b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:00:47.291252 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1270/2529] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:00:47.300855 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a777848-f7c1-4daf-b259-e778ba5e7e38 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:00:47.302551 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0a777848-f7c1-4daf-b259-e778ba5e7e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:00:47.357544 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a777848-f7c1-4daf-b259-e778ba5e7e38 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:00:47.361069 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d741ce-a079-4fba-a1ef-12f1a50cdf49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:00:47.361707 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d741ce-a079-4fba-a1ef-12f1a50cdf49 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:47.361984 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d741ce-a079-4fba-a1ef-12f1a50cdf49 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:47.362255 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d741ce-a079-4fba-a1ef-12f1a50cdf49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:47.371875 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d741ce-a079-4fba-a1ef-12f1a50cdf49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:00:47.373363 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d741ce-a079-4fba-a1ef-12f1a50cdf49 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:00:47.382814 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1260/2530] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:00:51.557673 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30984c-9c45-48f9-b4c9-cbb0382af5fe None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:51.558520 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30984c-9c45-48f9-b4c9-cbb0382af5fe None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:51.558979 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30984c-9c45-48f9-b4c9-cbb0382af5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:51.591234 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-0e30984c-9c45-48f9-b4c9-cbb0382af5fe None None] MFA Rules not processed for user `2cbcdc40fea745f48e1dfc62a732b7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:00:51.592517 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0e30984c-9c45-48f9-b4c9-cbb0382af5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:00:51.663667 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1271/2531] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:00:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:00:51.674794 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d741ce-a079-4fba-a1ef-12f1a50cdf49 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:00:51.676297 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-22d741ce-a079-4fba-a1ef-12f1a50cdf49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:00:51.757233 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d741ce-a079-4fba-a1ef-12f1a50cdf49 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:00:51.763712 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fc2a4-472c-412e-8fcc-19be1109ce06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:00:51.764401 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fc2a4-472c-412e-8fcc-19be1109ce06 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:51.764677 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fc2a4-472c-412e-8fcc-19be1109ce06 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:51.764948 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fc2a4-472c-412e-8fcc-19be1109ce06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:51.773083 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fc2a4-472c-412e-8fcc-19be1109ce06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:00:51.774671 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fc2a4-472c-412e-8fcc-19be1109ce06 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:00:51.785450 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1261/2532] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:00:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:00:53.231731 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d29d5-2857-4cb6-8d9b-8d44b384d8d7 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:53.232475 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d29d5-2857-4cb6-8d9b-8d44b384d8d7 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:53.232475 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d29d5-2857-4cb6-8d9b-8d44b384d8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:53.251883 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-e87d29d5-2857-4cb6-8d9b-8d44b384d8d7 None None] MFA Rules not processed for user `2cbcdc40fea745f48e1dfc62a732b7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:00:53.253176 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e87d29d5-2857-4cb6-8d9b-8d44b384d8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:00:53.262089 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1272/2533] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:00:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:00:53.616892 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fc2a4-472c-412e-8fcc-19be1109ce06 service nova] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:00:53.629397 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fc2a4-472c-412e-8fcc-19be1109ce06 service nova] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:00:53.633478 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84c514-75ed-4313-b6a5-d341071f2cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:00:53.635206 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84c514-75ed-4313-b6a5-d341071f2cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:53.635694 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84c514-75ed-4313-b6a5-d341071f2cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:53.636063 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84c514-75ed-4313-b6a5-d341071f2cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:53.638260 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6b84c514-75ed-4313-b6a5-d341071f2cb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:00:53.649026 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84c514-75ed-4313-b6a5-d341071f2cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:00:53.651348 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84c514-75ed-4313-b6a5-d341071f2cb4 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:00:53.661706 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1262/2534] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:00:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:00:53.999272 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d29d5-2857-4cb6-8d9b-8d44b384d8d7 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:00:54.000366 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e87d29d5-2857-4cb6-8d9b-8d44b384d8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:00:54.080119 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d29d5-2857-4cb6-8d9b-8d44b384d8d7 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:00:54.086895 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b53142-4124-4d8e-ac9b-38adf1ccfe95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1885d4d35b6743299a73b3c12b1793b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:00:54.087912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b53142-4124-4d8e-ac9b-38adf1ccfe95 service placement] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:54.089503 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b53142-4124-4d8e-ac9b-38adf1ccfe95 service placement] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:54.089503 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b53142-4124-4d8e-ac9b-38adf1ccfe95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:54.090933 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a3b53142-4124-4d8e-ac9b-38adf1ccfe95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:00:54.104081 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b53142-4124-4d8e-ac9b-38adf1ccfe95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:00:54.105858 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b53142-4124-4d8e-ac9b-38adf1ccfe95 service placement] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:00:54.116004 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1273/2535] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:00:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:00:57.180818 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84c514-75ed-4313-b6a5-d341071f2cb4 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:00:57.189964 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84c514-75ed-4313-b6a5-d341071f2cb4 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:00:57.193649 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac7d8a-1c3e-4646-9396-61220928606a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:00:57.194288 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac7d8a-1c3e-4646-9396-61220928606a service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:57.194570 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac7d8a-1c3e-4646-9396-61220928606a service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:57.194848 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac7d8a-1c3e-4646-9396-61220928606a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:57.196634 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-afac7d8a-1c3e-4646-9396-61220928606a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:00:57.206699 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac7d8a-1c3e-4646-9396-61220928606a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:00:57.208176 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac7d8a-1c3e-4646-9396-61220928606a service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:00:57.216784 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1263/2536] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:00:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:00:58.348286 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b53142-4124-4d8e-ac9b-38adf1ccfe95 service placement] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:00:58.351189 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a3b53142-4124-4d8e-ac9b-38adf1ccfe95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:00:58.371964 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b53142-4124-4d8e-ac9b-38adf1ccfe95 service placement] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:00:58.379134 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c949d-624b-4020-b692-9910804006f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:00:58.380168 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c949d-624b-4020-b692-9910804006f7 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:00:58.380661 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c949d-624b-4020-b692-9910804006f7 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:00:58.381122 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c949d-624b-4020-b692-9910804006f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:00:58.383162 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-0d5c949d-624b-4020-b692-9910804006f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:00:58.399910 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c949d-624b-4020-b692-9910804006f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:00:58.401510 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c949d-624b-4020-b692-9910804006f7 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:00:58.413931 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1274/2537] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:00:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:01:03.833255 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac7d8a-1c3e-4646-9396-61220928606a service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:03.856548 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac7d8a-1c3e-4646-9396-61220928606a service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:03.863143 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214650ab-3e3c-46ff-ab6b-2ffedda1c1a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:03.864015 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214650ab-3e3c-46ff-ab6b-2ffedda1c1a3 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:03.864290 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214650ab-3e3c-46ff-ab6b-2ffedda1c1a3 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:03.864735 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214650ab-3e3c-46ff-ab6b-2ffedda1c1a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:03.866824 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-214650ab-3e3c-46ff-ab6b-2ffedda1c1a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:03.884478 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214650ab-3e3c-46ff-ab6b-2ffedda1c1a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:03.886705 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214650ab-3e3c-46ff-ab6b-2ffedda1c1a3 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:03.909185 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1264/2538] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:01:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:01:04.189327 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49957d-3e4e-48f3-a315-b5dbef662a0d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:04.189804 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49957d-3e4e-48f3-a315-b5dbef662a0d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:04.189899 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49957d-3e4e-48f3-a315-b5dbef662a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:04.207072 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-ca49957d-3e4e-48f3-a315-b5dbef662a0d None None] MFA Rules not processed for user `1bcde529b708471eb9c1b74e15b588b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:01:04.208293 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ca49957d-3e4e-48f3-a315-b5dbef662a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:04.260318 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1275/2539] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:01:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:01:05.345478 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214650ab-3e3c-46ff-ab6b-2ffedda1c1a3 service nova] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:05.356627 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214650ab-3e3c-46ff-ab6b-2ffedda1c1a3 service nova] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:05.362034 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ee4fc-bd7f-473b-9ba8-d71e22a94be2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:05.362668 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ee4fc-bd7f-473b-9ba8-d71e22a94be2 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:05.362948 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ee4fc-bd7f-473b-9ba8-d71e22a94be2 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:05.363223 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ee4fc-bd7f-473b-9ba8-d71e22a94be2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:05.365004 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-356ee4fc-bd7f-473b-9ba8-d71e22a94be2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:05.421356 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ee4fc-bd7f-473b-9ba8-d71e22a94be2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:05.422876 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ee4fc-bd7f-473b-9ba8-d71e22a94be2 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:05.431849 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1265/2540] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:01:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:01:08.091593 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652abb3-8960-4268-b4d9-341a8098caf5 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:08.092177 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652abb3-8960-4268-b4d9-341a8098caf5 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:08.094035 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652abb3-8960-4268-b4d9-341a8098caf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:08.114437 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d652abb3-8960-4268-b4d9-341a8098caf5 None None] MFA Rules not processed for user `920ed843195243f8abd6dfb2ebb3a549`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:01:08.115814 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d652abb3-8960-4268-b4d9-341a8098caf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:08.196270 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1276/2541] 10.222.0.67 () {58 vars in 967 bytes} [Mon Apr 11 14:01:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:01:08.277522 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ee4fc-bd7f-473b-9ba8-d71e22a94be2 service nova] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:08.279887 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-356ee4fc-bd7f-473b-9ba8-d71e22a94be2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:08.363727 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ee4fc-bd7f-473b-9ba8-d71e22a94be2 service nova] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:08.374560 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70ff64-704f-4074-8dfe-843cac846f18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6660794b27ff4a7bbe9b6b043593598c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:08.375677 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70ff64-704f-4074-8dfe-843cac846f18 service swift] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:08.376033 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70ff64-704f-4074-8dfe-843cac846f18 service swift] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:08.376321 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70ff64-704f-4074-8dfe-843cac846f18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:08.407610 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70ff64-704f-4074-8dfe-843cac846f18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:08.409497 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70ff64-704f-4074-8dfe-843cac846f18 service swift] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:08.434038 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1266/2542] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Apr 11 14:01:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 14:01:09.060760 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652abb3-8960-4268-b4d9-341a8098caf5 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:09.075258 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652abb3-8960-4268-b4d9-341a8098caf5 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:09.081654 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bb56d-5dd5-4700-a828-1810e5ac15c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:09.082309 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bb56d-5dd5-4700-a828-1810e5ac15c5 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:09.082594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bb56d-5dd5-4700-a828-1810e5ac15c5 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:09.082900 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bb56d-5dd5-4700-a828-1810e5ac15c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:09.084761 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d42bb56d-5dd5-4700-a828-1810e5ac15c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:09.097749 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bb56d-5dd5-4700-a828-1810e5ac15c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:09.100044 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bb56d-5dd5-4700-a828-1810e5ac15c5 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:09.113782 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1277/2543] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:01:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:01:17.417058 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70ff64-704f-4074-8dfe-843cac846f18 service swift] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:17.418585 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-8b70ff64-704f-4074-8dfe-843cac846f18 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:17.434533 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70ff64-704f-4074-8dfe-843cac846f18 service swift] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:17.439321 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f55df2-0d7f-4351-b7e2-05a842755a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:17.440634 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f55df2-0d7f-4351-b7e2-05a842755a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:17.440916 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f55df2-0d7f-4351-b7e2-05a842755a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:17.441188 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f55df2-0d7f-4351-b7e2-05a842755a2f admin admin] PATH_INFO: `/v3/users/b3d95fb42f294675a9e9bb5f03304390` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:17.442379 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f55df2-0d7f-4351-b7e2-05a842755a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3d95fb42f294675a9e9bb5f03304390)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:17.444360 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f55df2-0d7f-4351-b7e2-05a842755a2f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:17.491390 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-53f55df2-0d7f-4351-b7e2-05a842755a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3d95fb42f294675a9e9bb5f03304390'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:01:17.498619 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-53f55df2-0d7f-4351-b7e2-05a842755a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3d95fb42f294675a9e9bb5f03304390'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:01:17.506306 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-53f55df2-0d7f-4351-b7e2-05a842755a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3d95fb42f294675a9e9bb5f03304390'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:01:17.507077 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-53f55df2-0d7f-4351-b7e2-05a842755a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3d95fb42f294675a9e9bb5f03304390'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:01:17.507704 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-53f55df2-0d7f-4351-b7e2-05a842755a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3d95fb42f294675a9e9bb5f03304390'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:01:17.524758 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1267/2544] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:01:17 2022] DELETE /identity/v3/users/b3d95fb42f294675a9e9bb5f03304390 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:01:17.703000 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bb56d-5dd5-4700-a828-1810e5ac15c5 service nova] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:17.714247 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bb56d-5dd5-4700-a828-1810e5ac15c5 service nova] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:17.773370 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6f712-0a00-485d-8b66-9853076e59cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:17.774833 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6f712-0a00-485d-8b66-9853076e59cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:17.775919 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6f712-0a00-485d-8b66-9853076e59cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:17.776236 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6f712-0a00-485d-8b66-9853076e59cc admin admin] PATH_INFO: `/v3/projects/644547f80e2543079781f0c7b34c40b4` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:17.778099 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6f712-0a00-485d-8b66-9853076e59cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=644547f80e2543079781f0c7b34c40b4)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:17.780043 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6f712-0a00-485d-8b66-9853076e59cc admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:17.825313 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4ea6f712-0a00-485d-8b66-9853076e59cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '644547f80e2543079781f0c7b34c40b4', 'request_id': 'req-4ea6f712-0a00-485d-8b66-9853076e59cc'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:01:17.831321 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4ea6f712-0a00-485d-8b66-9853076e59cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '644547f80e2543079781f0c7b34c40b4', 'request_id': 'req-4ea6f712-0a00-485d-8b66-9853076e59cc'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:01:17.837018 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4ea6f712-0a00-485d-8b66-9853076e59cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '644547f80e2543079781f0c7b34c40b4', 'request_id': 'req-4ea6f712-0a00-485d-8b66-9853076e59cc'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:01:17.848586 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4ea6f712-0a00-485d-8b66-9853076e59cc admin admin] The token cache is being invalidate because project 644547f80e2543079781f0c7b34c40b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:01:17.848868 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4ea6f712-0a00-485d-8b66-9853076e59cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:01:17.849475 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4ea6f712-0a00-485d-8b66-9853076e59cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:01:17.850992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1278/2545] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:01:17 2022] DELETE /identity/v3/projects/644547f80e2543079781f0c7b34c40b4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:01:17.855608 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f55df2-0d7f-4351-b7e2-05a842755a2f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:17.857142 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-53f55df2-0d7f-4351-b7e2-05a842755a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:17.869655 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f55df2-0d7f-4351-b7e2-05a842755a2f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:17.924986 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00968b08-f304-4cb8-9d0f-237cabdd89fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:17.925867 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00968b08-f304-4cb8-9d0f-237cabdd89fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:17.926153 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00968b08-f304-4cb8-9d0f-237cabdd89fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:17.926428 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00968b08-f304-4cb8-9d0f-237cabdd89fd admin admin] PATH_INFO: `/v3/users/2e30dc9f40ab4a5cb18be722c914b833` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:17.927780 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00968b08-f304-4cb8-9d0f-237cabdd89fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e30dc9f40ab4a5cb18be722c914b833)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:17.929740 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00968b08-f304-4cb8-9d0f-237cabdd89fd admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:17.975758 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-00968b08-f304-4cb8-9d0f-237cabdd89fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e30dc9f40ab4a5cb18be722c914b833'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:01:17.984057 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-00968b08-f304-4cb8-9d0f-237cabdd89fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e30dc9f40ab4a5cb18be722c914b833'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:01:17.991958 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-00968b08-f304-4cb8-9d0f-237cabdd89fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e30dc9f40ab4a5cb18be722c914b833'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:01:17.992622 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-00968b08-f304-4cb8-9d0f-237cabdd89fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e30dc9f40ab4a5cb18be722c914b833'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:01:17.993296 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-00968b08-f304-4cb8-9d0f-237cabdd89fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e30dc9f40ab4a5cb18be722c914b833'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:01:18.011128 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1268/2546] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:01:17 2022] DELETE /identity/v3/users/2e30dc9f40ab4a5cb18be722c914b833 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:01:18.224302 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6f712-0a00-485d-8b66-9853076e59cc admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:18.226088 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4ea6f712-0a00-485d-8b66-9853076e59cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:18.243652 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6f712-0a00-485d-8b66-9853076e59cc admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:18.302414 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659d07a-61db-41b4-95c4-72fdf0bc9d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:18.303281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659d07a-61db-41b4-95c4-72fdf0bc9d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:18.303561 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659d07a-61db-41b4-95c4-72fdf0bc9d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:18.303866 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659d07a-61db-41b4-95c4-72fdf0bc9d29 admin admin] PATH_INFO: `/v3/projects/43cdac2d08374f7691e431b85ad81bc1` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:18.305062 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659d07a-61db-41b4-95c4-72fdf0bc9d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43cdac2d08374f7691e431b85ad81bc1)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:18.307336 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659d07a-61db-41b4-95c4-72fdf0bc9d29 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:18.354396 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8659d07a-61db-41b4-95c4-72fdf0bc9d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43cdac2d08374f7691e431b85ad81bc1', 'request_id': 'req-8659d07a-61db-41b4-95c4-72fdf0bc9d29'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:01:18.360826 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8659d07a-61db-41b4-95c4-72fdf0bc9d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43cdac2d08374f7691e431b85ad81bc1', 'request_id': 'req-8659d07a-61db-41b4-95c4-72fdf0bc9d29'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:01:18.366392 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8659d07a-61db-41b4-95c4-72fdf0bc9d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43cdac2d08374f7691e431b85ad81bc1', 'request_id': 'req-8659d07a-61db-41b4-95c4-72fdf0bc9d29'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:01:18.380891 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8659d07a-61db-41b4-95c4-72fdf0bc9d29 admin admin] The token cache is being invalidate because project 43cdac2d08374f7691e431b85ad81bc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:01:18.381177 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8659d07a-61db-41b4-95c4-72fdf0bc9d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:01:18.381814 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-8659d07a-61db-41b4-95c4-72fdf0bc9d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:01:18.383414 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1279/2547] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:01:18 2022] DELETE /identity/v3/projects/43cdac2d08374f7691e431b85ad81bc1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:01:18.388691 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5bb0f-3bdf-480b-b014-bebace6952a9 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:18.389006 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5bb0f-3bdf-480b-b014-bebace6952a9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:18.389301 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5bb0f-3bdf-480b-b014-bebace6952a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:18.407505 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-6fe5bb0f-3bdf-480b-b014-bebace6952a9 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:01:18.408829 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6fe5bb0f-3bdf-480b-b014-bebace6952a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:18.467856 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1269/2548] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:01:18.475538 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccdf96-574c-4633-9d35-c845c875303e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:18.475864 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccdf96-574c-4633-9d35-c845c875303e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:18.476193 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccdf96-574c-4633-9d35-c845c875303e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:18.497053 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-b6ccdf96-574c-4633-9d35-c845c875303e None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:01:18.498343 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b6ccdf96-574c-4633-9d35-c845c875303e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:18.508130 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1280/2549] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 14:01:18.512273 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5bb0f-3bdf-480b-b014-bebace6952a9 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:18.521825 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5bb0f-3bdf-480b-b014-bebace6952a9 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:18.528185 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb80064-90d2-4618-8796-4fd4a73eaefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:18.528918 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb80064-90d2-4618-8796-4fd4a73eaefe admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:18.529204 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb80064-90d2-4618-8796-4fd4a73eaefe admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:18.529479 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb80064-90d2-4618-8796-4fd4a73eaefe admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:18.530211 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb80064-90d2-4618-8796-4fd4a73eaefe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 14:01:18.530516 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb80064-90d2-4618-8796-4fd4a73eaefe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:18.532246 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb80064-90d2-4618-8796-4fd4a73eaefe admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:18.545822 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1270/2550] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 14:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 14:01:18.549951 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccdf96-574c-4633-9d35-c845c875303e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:18.559379 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccdf96-574c-4633-9d35-c845c875303e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:18.564327 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28809b96-de2c-41d2-b37c-b9000955866a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:18.564978 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28809b96-de2c-41d2-b37c-b9000955866a admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:18.565261 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28809b96-de2c-41d2-b37c-b9000955866a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:18.565539 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28809b96-de2c-41d2-b37c-b9000955866a admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:18.566273 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28809b96-de2c-41d2-b37c-b9000955866a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:18.568443 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28809b96-de2c-41d2-b37c-b9000955866a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:18.602795 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1281/2551] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:01:18 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:01:18.606798 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb80064-90d2-4618-8796-4fd4a73eaefe admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:18.617142 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb80064-90d2-4618-8796-4fd4a73eaefe admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:18.674702 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a54186-c805-47c4-896f-a9aa75424701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:18.675392 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a54186-c805-47c4-896f-a9aa75424701 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:18.675700 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a54186-c805-47c4-896f-a9aa75424701 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:18.676022 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a54186-c805-47c4-896f-a9aa75424701 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:18.676669 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a54186-c805-47c4-896f-a9aa75424701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:18.678617 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a54186-c805-47c4-896f-a9aa75424701 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:18.700870 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1271/2552] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:01:18 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 14:01:18.704818 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28809b96-de2c-41d2-b37c-b9000955866a admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:18.715864 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28809b96-de2c-41d2-b37c-b9000955866a admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:18.720643 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfeb40-2e21-449d-9417-e49122c119e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:18.721413 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfeb40-2e21-449d-9417-e49122c119e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:18.721767 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfeb40-2e21-449d-9417-e49122c119e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:18.722113 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfeb40-2e21-449d-9417-e49122c119e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:18.722913 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfeb40-2e21-449d-9417-e49122c119e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:18.724630 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfeb40-2e21-449d-9417-e49122c119e1 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:18.738065 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1282/2553] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:01:18.739897 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a54186-c805-47c4-896f-a9aa75424701 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:18.750140 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a54186-c805-47c4-896f-a9aa75424701 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:18.754816 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86a984-68e0-4f75-9499-8924cef0a939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:18.755483 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86a984-68e0-4f75-9499-8924cef0a939 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:18.755813 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86a984-68e0-4f75-9499-8924cef0a939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:18.756091 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86a984-68e0-4f75-9499-8924cef0a939 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:18.756849 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86a984-68e0-4f75-9499-8924cef0a939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:18.758461 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86a984-68e0-4f75-9499-8924cef0a939 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:18.768589 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1272/2554] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:01:18.773281 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfeb40-2e21-449d-9417-e49122c119e1 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:18.784198 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfeb40-2e21-449d-9417-e49122c119e1 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:18.789289 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d11e4-9841-48ad-9adc-9c03465f8914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:18.790964 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d11e4-9841-48ad-9adc-9c03465f8914 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:18.791333 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d11e4-9841-48ad-9adc-9c03465f8914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:18.791703 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d11e4-9841-48ad-9adc-9c03465f8914 admin admin] PATH_INFO: `/v3/projects/40c040f0c3e74276bcab8dbc8e439de5/users/64643f7804ba42f5886f949134dd4d06/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:18.807251 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d11e4-9841-48ad-9adc-9c03465f8914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c040f0c3e74276bcab8dbc8e439de5, user_id=64643f7804ba42f5886f949134dd4d06, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:18.809931 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d11e4-9841-48ad-9adc-9c03465f8914 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:18.823500 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1283/2555] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:01:18 2022] PUT /identity/v3/projects/40c040f0c3e74276bcab8dbc8e439de5/users/64643f7804ba42f5886f949134dd4d06/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 14:01:18.828669 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3953d-254d-4356-902f-84ef7fe05978 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:18.828961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3953d-254d-4356-902f-84ef7fe05978 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:18.829237 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3953d-254d-4356-902f-84ef7fe05978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:18.847008 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-3db3953d-254d-4356-902f-84ef7fe05978 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:01:18.848238 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3db3953d-254d-4356-902f-84ef7fe05978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:18.904782 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1273/2556] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:01:18.914754 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d11e4-9841-48ad-9adc-9c03465f8914 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:18.916515 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ca8d11e4-9841-48ad-9adc-9c03465f8914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:18.974141 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d11e4-9841-48ad-9adc-9c03465f8914 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:18.977995 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a6cc6-69ea-4e6f-b6ed-6b4d924a5542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:18.978636 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a6cc6-69ea-4e6f-b6ed-6b4d924a5542 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:18.978914 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a6cc6-69ea-4e6f-b6ed-6b4d924a5542 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:18.979187 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a6cc6-69ea-4e6f-b6ed-6b4d924a5542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:18.988248 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a6cc6-69ea-4e6f-b6ed-6b4d924a5542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:18.989605 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a6cc6-69ea-4e6f-b6ed-6b4d924a5542 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:18.999103 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1284/2557] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:01:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:01:23.935254 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f39035-24ac-48e2-9520-5a9bb991b9b1 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:23.936238 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f39035-24ac-48e2-9520-5a9bb991b9b1 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:23.936522 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f39035-24ac-48e2-9520-5a9bb991b9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:23.972954 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-d4f39035-24ac-48e2-9520-5a9bb991b9b1 None None] MFA Rules not processed for user `64643f7804ba42f5886f949134dd4d06`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:01:23.975459 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d4f39035-24ac-48e2-9520-5a9bb991b9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:24.051437 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1274/2558] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:01:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:01:24.056361 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a6cc6-69ea-4e6f-b6ed-6b4d924a5542 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:24.066906 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a6cc6-69ea-4e6f-b6ed-6b4d924a5542 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:24.071955 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef77770-1401-47f7-b6b2-924554c22556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:24.072646 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef77770-1401-47f7-b6b2-924554c22556 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:24.072932 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef77770-1401-47f7-b6b2-924554c22556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:24.073203 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef77770-1401-47f7-b6b2-924554c22556 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:24.073900 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef77770-1401-47f7-b6b2-924554c22556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:24.075833 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef77770-1401-47f7-b6b2-924554c22556 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:24.104288 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1285/2559] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:01:24 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:01:24.109688 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f39035-24ac-48e2-9520-5a9bb991b9b1 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:24.124483 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f39035-24ac-48e2-9520-5a9bb991b9b1 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:24.185982 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f66abb-9f91-4e16-bf34-78758a31f16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:24.186650 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f66abb-9f91-4e16-bf34-78758a31f16f admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:24.186931 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f66abb-9f91-4e16-bf34-78758a31f16f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:24.187201 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f66abb-9f91-4e16-bf34-78758a31f16f admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:24.187909 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f66abb-9f91-4e16-bf34-78758a31f16f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:24.189819 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f66abb-9f91-4e16-bf34-78758a31f16f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:24.210086 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1275/2560] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:01:24 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:01:24.215059 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef77770-1401-47f7-b6b2-924554c22556 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:24.225220 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef77770-1401-47f7-b6b2-924554c22556 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:24.229865 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ca09d-aa4c-44e6-a974-e3e886c8f55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:24.230518 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ca09d-aa4c-44e6-a974-e3e886c8f55a admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:24.230802 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ca09d-aa4c-44e6-a974-e3e886c8f55a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:24.231122 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ca09d-aa4c-44e6-a974-e3e886c8f55a admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:24.231880 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ca09d-aa4c-44e6-a974-e3e886c8f55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:24.233465 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ca09d-aa4c-44e6-a974-e3e886c8f55a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:24.243720 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1286/2561] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 14:01:24.247825 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f66abb-9f91-4e16-bf34-78758a31f16f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:24.257619 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f66abb-9f91-4e16-bf34-78758a31f16f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:24.262819 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec0656-7774-4af7-9684-ce4c40c74815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:24.263736 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec0656-7774-4af7-9684-ce4c40c74815 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:24.264027 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec0656-7774-4af7-9684-ce4c40c74815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:24.264304 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec0656-7774-4af7-9684-ce4c40c74815 admin admin] PATH_INFO: `/v3/projects/3376c318d5ca400588d96924b596052c/users/025fc3ead3654c8989a0fdca8af5a7ef/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:24.279552 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec0656-7774-4af7-9684-ce4c40c74815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3376c318d5ca400588d96924b596052c, user_id=025fc3ead3654c8989a0fdca8af5a7ef, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:24.282220 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec0656-7774-4af7-9684-ce4c40c74815 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:24.296410 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1276/2562] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:01:24 2022] PUT /identity/v3/projects/3376c318d5ca400588d96924b596052c/users/025fc3ead3654c8989a0fdca8af5a7ef/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 14:01:24.300467 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ca09d-aa4c-44e6-a974-e3e886c8f55a admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:24.311599 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ca09d-aa4c-44e6-a974-e3e886c8f55a admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:24.368425 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16293912-cc85-4181-98f3-b48d3ae6048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:24.369004 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16293912-cc85-4181-98f3-b48d3ae6048b admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:24.369286 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16293912-cc85-4181-98f3-b48d3ae6048b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:24.369562 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16293912-cc85-4181-98f3-b48d3ae6048b admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:24.370288 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16293912-cc85-4181-98f3-b48d3ae6048b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:24.371975 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16293912-cc85-4181-98f3-b48d3ae6048b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:24.381479 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1287/2563] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 14:01:24.386026 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec0656-7774-4af7-9684-ce4c40c74815 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:24.396403 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec0656-7774-4af7-9684-ce4c40c74815 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:24.401795 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010dfd4-0431-45a6-b715-2aa62e7cb1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:24.402943 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010dfd4-0431-45a6-b715-2aa62e7cb1fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:24.403218 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010dfd4-0431-45a6-b715-2aa62e7cb1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:24.403490 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010dfd4-0431-45a6-b715-2aa62e7cb1fc admin admin] PATH_INFO: `/v3/projects/3376c318d5ca400588d96924b596052c/users/025fc3ead3654c8989a0fdca8af5a7ef/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:24.405681 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010dfd4-0431-45a6-b715-2aa62e7cb1fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3376c318d5ca400588d96924b596052c, user_id=025fc3ead3654c8989a0fdca8af5a7ef, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:24.408357 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010dfd4-0431-45a6-b715-2aa62e7cb1fc admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:24.418627 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1277/2564] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:01:24 2022] PUT /identity/v3/projects/3376c318d5ca400588d96924b596052c/users/025fc3ead3654c8989a0fdca8af5a7ef/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:01:26.171352 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b02c87-1915-469b-990f-7776ffdd12a3 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:26.171891 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b02c87-1915-469b-990f-7776ffdd12a3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:26.171974 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b02c87-1915-469b-990f-7776ffdd12a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:26.197843 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-73b02c87-1915-469b-990f-7776ffdd12a3 None None] MFA Rules not processed for user `920ed843195243f8abd6dfb2ebb3a549`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:01:26.199300 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-73b02c87-1915-469b-990f-7776ffdd12a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:26.269585 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1288/2565] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Apr 11 14:01:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:01:26.285410 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010dfd4-0431-45a6-b715-2aa62e7cb1fc admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:26.287862 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3010dfd4-0431-45a6-b715-2aa62e7cb1fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:26.392930 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010dfd4-0431-45a6-b715-2aa62e7cb1fc admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:26.411240 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3e27d-8aec-4016-ba2d-58280e65daa7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6660794b27ff4a7bbe9b6b043593598c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:26.412127 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3e27d-8aec-4016-ba2d-58280e65daa7 service swift] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:26.412554 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3e27d-8aec-4016-ba2d-58280e65daa7 service swift] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:26.412968 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3e27d-8aec-4016-ba2d-58280e65daa7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:26.429295 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3e27d-8aec-4016-ba2d-58280e65daa7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:26.431983 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3e27d-8aec-4016-ba2d-58280e65daa7 service swift] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:26.456321 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1278/2566] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Apr 11 14:01:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 14:01:30.913818 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0232303-6f31-4a3b-b93d-85e8fa9fe3bf None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:30.914439 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0232303-6f31-4a3b-b93d-85e8fa9fe3bf None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:30.914551 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0232303-6f31-4a3b-b93d-85e8fa9fe3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:30.954570 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-b0232303-6f31-4a3b-b93d-85e8fa9fe3bf None None] MFA Rules not processed for user `025fc3ead3654c8989a0fdca8af5a7ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:01:30.958926 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b0232303-6f31-4a3b-b93d-85e8fa9fe3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:31.049235 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1289/2567] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:01:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:01:31.064731 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3e27d-8aec-4016-ba2d-58280e65daa7 service swift] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:31.068551 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fae3e27d-8aec-4016-ba2d-58280e65daa7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:31.191514 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3e27d-8aec-4016-ba2d-58280e65daa7 service swift] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:31.198799 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3431d-f358-4411-aabd-6a59149ad59f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:31.199540 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3431d-f358-4411-aabd-6a59149ad59f service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:31.199926 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3431d-f358-4411-aabd-6a59149ad59f service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:31.200279 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3431d-f358-4411-aabd-6a59149ad59f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:31.276146 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3431d-f358-4411-aabd-6a59149ad59f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:31.277969 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3431d-f358-4411-aabd-6a59149ad59f service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:31.288057 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1279/2568] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:01:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:01:43.961038 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af97a4d-bfc0-4ee4-883f-e93c16f664fd None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:43.961566 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af97a4d-bfc0-4ee4-883f-e93c16f664fd None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:43.961691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af97a4d-bfc0-4ee4-883f-e93c16f664fd None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:43.963376 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1290/2569] 10.222.0.67 () {54 vars in 921 bytes} [Mon Apr 11 14:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 14:01:43.969593 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a4dae-5bf5-4d0c-851d-980fe8b0e016 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:43.970087 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a4dae-5bf5-4d0c-851d-980fe8b0e016 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:43.970240 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a4dae-5bf5-4d0c-851d-980fe8b0e016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:43.997982 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-420a4dae-5bf5-4d0c-851d-980fe8b0e016 None None] MFA Rules not processed for user `fedd2314dc594bcba749bf7b0d1e50fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:01:43.999222 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-420a4dae-5bf5-4d0c-851d-980fe8b0e016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:44.044172 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1280/2570] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Apr 11 14:01:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:01:44.059605 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af97a4d-bfc0-4ee4-883f-e93c16f664fd None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:44.066992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7af97a4d-bfc0-4ee4-883f-e93c16f664fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:44.182419 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af97a4d-bfc0-4ee4-883f-e93c16f664fd None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:44.191778 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b322f-2028-4cf1-a51d-70790e7cf387 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08cbf69574af4e25b940ec038f9e1bd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:44.192448 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b322f-2028-4cf1-a51d-70790e7cf387 service glance] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:44.193574 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b322f-2028-4cf1-a51d-70790e7cf387 service glance] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:44.194357 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b322f-2028-4cf1-a51d-70790e7cf387 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:44.210956 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b322f-2028-4cf1-a51d-70790e7cf387 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:44.216473 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b322f-2028-4cf1-a51d-70790e7cf387 service glance] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:44.228993 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1291/2571] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:01:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:01:44.306811 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e746193-aa18-4ba9-a8a5-5834c0bc4be5 None None] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:44.307103 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e746193-aa18-4ba9-a8a5-5834c0bc4be5 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:44.307376 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e746193-aa18-4ba9-a8a5-5834c0bc4be5 None None] PATH_INFO: `/` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:44.308770 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1281/2572] 10.222.0.67 () {54 vars in 921 bytes} [Mon Apr 11 14:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 14:01:44.313598 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2490bc-31a1-49e9-9136-4726bc57fe6a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:44.313891 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2490bc-31a1-49e9-9136-4726bc57fe6a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:44.314175 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2490bc-31a1-49e9-9136-4726bc57fe6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:44.333025 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-cb2490bc-31a1-49e9-9136-4726bc57fe6a None None] MFA Rules not processed for user `c084d218ea414d638ef2dc45364a492c`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:01:44.334891 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-cb2490bc-31a1-49e9-9136-4726bc57fe6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:44.385665 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1292/2573] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Apr 11 14:01:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 14:01:44.398038 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e746193-aa18-4ba9-a8a5-5834c0bc4be5 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:44.409131 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e746193-aa18-4ba9-a8a5-5834c0bc4be5 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:44.413054 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfa923-7072-4ab0-8538-0490ce401fe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:44.413688 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfa923-7072-4ab0-8538-0490ce401fe9 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:44.413970 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfa923-7072-4ab0-8538-0490ce401fe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:44.414245 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfa923-7072-4ab0-8538-0490ce401fe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:44.421289 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfa923-7072-4ab0-8538-0490ce401fe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:44.422655 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfa923-7072-4ab0-8538-0490ce401fe9 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:44.430208 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1282/2574] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:01:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:01:44.521525 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9715d-9768-43b6-a7aa-2ce85f08e07a None None] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:44.522586 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9715d-9768-43b6-a7aa-2ce85f08e07a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:44.522935 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9715d-9768-43b6-a7aa-2ce85f08e07a None None] PATH_INFO: `/` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:44.524385 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1293/2575] 10.222.0.67 () {54 vars in 921 bytes} [Mon Apr 11 14:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 14:01:44.529996 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5b3ad-336a-4bc2-b094-895c848fe7d8 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:44.530305 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5b3ad-336a-4bc2-b094-895c848fe7d8 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:44.530582 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5b3ad-336a-4bc2-b094-895c848fe7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:44.548157 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-a6d5b3ad-336a-4bc2-b094-895c848fe7d8 None None] MFA Rules not processed for user `fedd2314dc594bcba749bf7b0d1e50fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:01:44.549400 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-a6d5b3ad-336a-4bc2-b094-895c848fe7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:44.558613 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1283/2576] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Apr 11 14:01:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:01:44.569276 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9715d-9768-43b6-a7aa-2ce85f08e07a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:44.579957 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9715d-9768-43b6-a7aa-2ce85f08e07a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:44.583441 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d3f3c-8971-4c3f-9732-f2742919f0cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:44.584287 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d3f3c-8971-4c3f-9732-f2742919f0cb service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:44.585196 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d3f3c-8971-4c3f-9732-f2742919f0cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:44.585542 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d3f3c-8971-4c3f-9732-f2742919f0cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:44.595840 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d3f3c-8971-4c3f-9732-f2742919f0cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:44.597261 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d3f3c-8971-4c3f-9732-f2742919f0cb service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:44.608182 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1294/2577] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:01:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:01:47.457649 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3e758-abfc-4cb0-bdb9-b3ef4bd4be57 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:47.458098 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3e758-abfc-4cb0-bdb9-b3ef4bd4be57 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:47.458206 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3e758-abfc-4cb0-bdb9-b3ef4bd4be57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:47.475949 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-3cb3e758-abfc-4cb0-bdb9-b3ef4bd4be57 None None] MFA Rules not processed for user `920ed843195243f8abd6dfb2ebb3a549`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:01:47.477137 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3cb3e758-abfc-4cb0-bdb9-b3ef4bd4be57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:47.484198 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1284/2578] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Apr 11 14:01:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:01:47.496424 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d3f3c-8971-4c3f-9732-f2742919f0cb service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:47.507916 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d3f3c-8971-4c3f-9732-f2742919f0cb service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:47.512919 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24889093-d7ef-44ec-bdfb-e22017ed768e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6660794b27ff4a7bbe9b6b043593598c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:47.513551 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24889093-d7ef-44ec-bdfb-e22017ed768e service swift] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:47.513839 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24889093-d7ef-44ec-bdfb-e22017ed768e service swift] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:47.514118 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24889093-d7ef-44ec-bdfb-e22017ed768e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:47.522613 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24889093-d7ef-44ec-bdfb-e22017ed768e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:47.524228 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24889093-d7ef-44ec-bdfb-e22017ed768e service swift] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:47.532598 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1295/2579] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Apr 11 14:01:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 14:01:49.854005 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e470e-a4ce-4fde-8c81-8be8b8fccaa9 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:49.854532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e470e-a4ce-4fde-8c81-8be8b8fccaa9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:49.854532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e470e-a4ce-4fde-8c81-8be8b8fccaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:49.872321 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-bc1e470e-a4ce-4fde-8c81-8be8b8fccaa9 None None] MFA Rules not processed for user `64643f7804ba42f5886f949134dd4d06`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:01:49.873505 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-bc1e470e-a4ce-4fde-8c81-8be8b8fccaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:49.880271 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1285/2580] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:01:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:01:50.332878 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24889093-d7ef-44ec-bdfb-e22017ed768e service swift] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:50.343672 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24889093-d7ef-44ec-bdfb-e22017ed768e service swift] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:50.349544 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10193e4c-3454-401f-8110-448dc4048ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:50.349544 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10193e4c-3454-401f-8110-448dc4048ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:50.349544 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10193e4c-3454-401f-8110-448dc4048ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:50.349959 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10193e4c-3454-401f-8110-448dc4048ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:50.352479 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-10193e4c-3454-401f-8110-448dc4048ab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:50.364213 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10193e4c-3454-401f-8110-448dc4048ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:50.366142 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10193e4c-3454-401f-8110-448dc4048ab9 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:50.387743 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1296/2581] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:01:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:01:58.152412 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e470e-a4ce-4fde-8c81-8be8b8fccaa9 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:01:58.154279 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-bc1e470e-a4ce-4fde-8c81-8be8b8fccaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:58.175109 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e470e-a4ce-4fde-8c81-8be8b8fccaa9 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:01:58.181580 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0ddf3-2c84-4c79-b301-8d1a447efb26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:01:58.182269 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0ddf3-2c84-4c79-b301-8d1a447efb26 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:01:58.182786 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0ddf3-2c84-4c79-b301-8d1a447efb26 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:01:58.183070 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0ddf3-2c84-4c79-b301-8d1a447efb26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:01:58.185331 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-55b0ddf3-2c84-4c79-b301-8d1a447efb26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:01:58.243309 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0ddf3-2c84-4c79-b301-8d1a447efb26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:01:58.244951 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0ddf3-2c84-4c79-b301-8d1a447efb26 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:01:58.255690 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1286/2582] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:01:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:02:03.508547 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a7f14-a523-4ad3-a742-f4ea85deb3d9 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:03.509038 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a7f14-a523-4ad3-a742-f4ea85deb3d9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:03.509162 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a7f14-a523-4ad3-a742-f4ea85deb3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:03.528498 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-819a7f14-a523-4ad3-a742-f4ea85deb3d9 None None] MFA Rules not processed for user `920ed843195243f8abd6dfb2ebb3a549`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:02:03.529626 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-819a7f14-a523-4ad3-a742-f4ea85deb3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:03.537322 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1297/2583] 10.222.0.67 () {58 vars in 967 bytes} [Mon Apr 11 14:02:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:02:03.549491 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0ddf3-2c84-4c79-b301-8d1a447efb26 service nova] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:03.560572 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0ddf3-2c84-4c79-b301-8d1a447efb26 service nova] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:03.565649 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab544034-fdde-40a5-b60a-8739957258cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6660794b27ff4a7bbe9b6b043593598c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:03.566173 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab544034-fdde-40a5-b60a-8739957258cb service swift] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:03.566456 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab544034-fdde-40a5-b60a-8739957258cb service swift] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:03.566735 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab544034-fdde-40a5-b60a-8739957258cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:03.574824 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab544034-fdde-40a5-b60a-8739957258cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:03.576440 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab544034-fdde-40a5-b60a-8739957258cb service swift] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:03.585098 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1287/2584] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Apr 11 14:02:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 14:02:06.482098 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8c1c7-be80-407e-895b-74856f8d85ae None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:06.482559 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8c1c7-be80-407e-895b-74856f8d85ae None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:06.482703 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8c1c7-be80-407e-895b-74856f8d85ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:06.500659 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-dee8c1c7-be80-407e-895b-74856f8d85ae None None] MFA Rules not processed for user `2cbcdc40fea745f48e1dfc62a732b7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:02:06.501862 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-dee8c1c7-be80-407e-895b-74856f8d85ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:06.557813 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1298/2585] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:02:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 14:02:19.384425 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab544034-fdde-40a5-b60a-8739957258cb service swift] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:19.393521 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab544034-fdde-40a5-b60a-8739957258cb service swift] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:19.397165 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de7ecc-aa03-4b9a-9455-2396b1525472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:19.397806 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de7ecc-aa03-4b9a-9455-2396b1525472 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:19.398093 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de7ecc-aa03-4b9a-9455-2396b1525472 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:19.398621 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de7ecc-aa03-4b9a-9455-2396b1525472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:19.407812 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de7ecc-aa03-4b9a-9455-2396b1525472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:19.409349 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de7ecc-aa03-4b9a-9455-2396b1525472 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:19.419154 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1288/2586] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:02:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:02:36.210693 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8c1c7-be80-407e-895b-74856f8d85ae None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:36.212138 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-dee8c1c7-be80-407e-895b-74856f8d85ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:36.224294 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8c1c7-be80-407e-895b-74856f8d85ae None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:36.227879 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d82d62-1497-4f99-8112-cdcdacaa9cce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:36.228519 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d82d62-1497-4f99-8112-cdcdacaa9cce service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:36.228799 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d82d62-1497-4f99-8112-cdcdacaa9cce service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:36.229076 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d82d62-1497-4f99-8112-cdcdacaa9cce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:36.230778 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d0d82d62-1497-4f99-8112-cdcdacaa9cce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:36.292020 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d82d62-1497-4f99-8112-cdcdacaa9cce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:36.293454 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d82d62-1497-4f99-8112-cdcdacaa9cce service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:36.303548 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1299/2587] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:02:39.689071 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de7ecc-aa03-4b9a-9455-2396b1525472 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:39.691266 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-67de7ecc-aa03-4b9a-9455-2396b1525472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:39.706789 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de7ecc-aa03-4b9a-9455-2396b1525472 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:39.711680 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dcc1c-ba4a-478a-92d0-f4cefb875f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:39.713402 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dcc1c-ba4a-478a-92d0-f4cefb875f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:39.713750 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dcc1c-ba4a-478a-92d0-f4cefb875f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:39.714179 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dcc1c-ba4a-478a-92d0-f4cefb875f79 admin admin] PATH_INFO: `/v3/users/1bcde529b708471eb9c1b74e15b588b7` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:39.715475 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dcc1c-ba4a-478a-92d0-f4cefb875f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bcde529b708471eb9c1b74e15b588b7)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:39.717445 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dcc1c-ba4a-478a-92d0-f4cefb875f79 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:39.769299 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4c3dcc1c-ba4a-478a-92d0-f4cefb875f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bcde529b708471eb9c1b74e15b588b7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:39.776258 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4c3dcc1c-ba4a-478a-92d0-f4cefb875f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bcde529b708471eb9c1b74e15b588b7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:39.782919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4c3dcc1c-ba4a-478a-92d0-f4cefb875f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bcde529b708471eb9c1b74e15b588b7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:39.783815 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4c3dcc1c-ba4a-478a-92d0-f4cefb875f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bcde529b708471eb9c1b74e15b588b7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:39.784450 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4c3dcc1c-ba4a-478a-92d0-f4cefb875f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bcde529b708471eb9c1b74e15b588b7'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:39.800899 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1289/2588] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:02:39 2022] DELETE /identity/v3/users/1bcde529b708471eb9c1b74e15b588b7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:02:39.969325 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d82d62-1497-4f99-8112-cdcdacaa9cce service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:39.980690 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d82d62-1497-4f99-8112-cdcdacaa9cce service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:40.035081 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540c200-ef37-447e-8a61-8948d96430b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:40.035960 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540c200-ef37-447e-8a61-8948d96430b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:40.036240 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540c200-ef37-447e-8a61-8948d96430b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:40.036510 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540c200-ef37-447e-8a61-8948d96430b1 admin admin] PATH_INFO: `/v3/projects/f8720d1d0e26443d96a5f29175402af6` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:40.037661 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540c200-ef37-447e-8a61-8948d96430b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8720d1d0e26443d96a5f29175402af6)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:40.039552 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540c200-ef37-447e-8a61-8948d96430b1 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:40.084183 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c540c200-ef37-447e-8a61-8948d96430b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8720d1d0e26443d96a5f29175402af6', 'request_id': 'req-c540c200-ef37-447e-8a61-8948d96430b1'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:40.089960 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c540c200-ef37-447e-8a61-8948d96430b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8720d1d0e26443d96a5f29175402af6', 'request_id': 'req-c540c200-ef37-447e-8a61-8948d96430b1'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:40.095009 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c540c200-ef37-447e-8a61-8948d96430b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8720d1d0e26443d96a5f29175402af6', 'request_id': 'req-c540c200-ef37-447e-8a61-8948d96430b1'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:40.106215 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c540c200-ef37-447e-8a61-8948d96430b1 admin admin] The token cache is being invalidate because project f8720d1d0e26443d96a5f29175402af6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:02:40.106497 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c540c200-ef37-447e-8a61-8948d96430b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:40.107104 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c540c200-ef37-447e-8a61-8948d96430b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:40.108649 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1300/2589] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:02:39 2022] DELETE /identity/v3/projects/f8720d1d0e26443d96a5f29175402af6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:02:40.113691 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c669ebe-d03e-4b55-b76e-44fe4bbb6ff3 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:40.113984 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c669ebe-d03e-4b55-b76e-44fe4bbb6ff3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:40.114263 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c669ebe-d03e-4b55-b76e-44fe4bbb6ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:40.131919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4c669ebe-d03e-4b55-b76e-44fe4bbb6ff3 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:02:40.133131 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4c669ebe-d03e-4b55-b76e-44fe4bbb6ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:40.191343 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1290/2590] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:02:40.198954 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64053eb7-b998-4a70-a9cf-8239b8eec6e4 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:40.199243 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64053eb7-b998-4a70-a9cf-8239b8eec6e4 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:40.199524 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64053eb7-b998-4a70-a9cf-8239b8eec6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:40.217252 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-64053eb7-b998-4a70-a9cf-8239b8eec6e4 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:02:40.218400 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-64053eb7-b998-4a70-a9cf-8239b8eec6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:40.226676 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1301/2591] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:02:40.230896 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c669ebe-d03e-4b55-b76e-44fe4bbb6ff3 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:40.241167 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c669ebe-d03e-4b55-b76e-44fe4bbb6ff3 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:40.246030 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0cd54-3bfb-48e9-a739-4b0f6d9bb76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:40.246729 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0cd54-3bfb-48e9-a739-4b0f6d9bb76b admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:40.247015 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0cd54-3bfb-48e9-a739-4b0f6d9bb76b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:40.247321 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0cd54-3bfb-48e9-a739-4b0f6d9bb76b admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:40.248134 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0cd54-3bfb-48e9-a739-4b0f6d9bb76b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 14:02:40.248494 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0cd54-3bfb-48e9-a739-4b0f6d9bb76b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:40.250165 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0cd54-3bfb-48e9-a739-4b0f6d9bb76b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:40.262171 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1291/2592] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 14:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 14:02:40.266454 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64053eb7-b998-4a70-a9cf-8239b8eec6e4 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:40.276468 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64053eb7-b998-4a70-a9cf-8239b8eec6e4 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:40.281092 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742fb7e-9cf0-4928-a6fe-f74bbb1c3cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:40.281796 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742fb7e-9cf0-4928-a6fe-f74bbb1c3cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:40.282080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742fb7e-9cf0-4928-a6fe-f74bbb1c3cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:40.282360 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742fb7e-9cf0-4928-a6fe-f74bbb1c3cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:40.283080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742fb7e-9cf0-4928-a6fe-f74bbb1c3cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:40.285092 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6742fb7e-9cf0-4928-a6fe-f74bbb1c3cd9 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:40.320000 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1302/2593] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:02:40 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:02:40.324010 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0cd54-3bfb-48e9-a739-4b0f6d9bb76b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:40.334530 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0cd54-3bfb-48e9-a739-4b0f6d9bb76b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:40.389159 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424ff2d-46f2-46b7-9557-d059f9f970b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:40.389860 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424ff2d-46f2-46b7-9557-d059f9f970b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:40.390146 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424ff2d-46f2-46b7-9557-d059f9f970b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:40.390425 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424ff2d-46f2-46b7-9557-d059f9f970b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:40.391124 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424ff2d-46f2-46b7-9557-d059f9f970b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:40.393144 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424ff2d-46f2-46b7-9557-d059f9f970b9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:40.414038 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1292/2594] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:02:40 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:02:40.418031 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742fb7e-9cf0-4928-a6fe-f74bbb1c3cd9 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:40.428818 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742fb7e-9cf0-4928-a6fe-f74bbb1c3cd9 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:40.433505 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ceac60-1279-4f9b-a60d-5ac47497d117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:40.434196 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceac60-1279-4f9b-a60d-5ac47497d117 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:40.434505 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceac60-1279-4f9b-a60d-5ac47497d117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:40.434787 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceac60-1279-4f9b-a60d-5ac47497d117 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:40.435515 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ceac60-1279-4f9b-a60d-5ac47497d117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:40.437221 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ceac60-1279-4f9b-a60d-5ac47497d117 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:40.447805 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1303/2595] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:02:40.451458 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424ff2d-46f2-46b7-9557-d059f9f970b9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:40.461072 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424ff2d-46f2-46b7-9557-d059f9f970b9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:40.465546 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65971e-0060-481a-bab6-5d1aea36bb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:40.466191 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65971e-0060-481a-bab6-5d1aea36bb62 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:40.466469 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65971e-0060-481a-bab6-5d1aea36bb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:40.466742 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65971e-0060-481a-bab6-5d1aea36bb62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:40.467507 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65971e-0060-481a-bab6-5d1aea36bb62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:40.469130 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65971e-0060-481a-bab6-5d1aea36bb62 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:40.478614 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1293/2596] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:02:40.482454 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ceac60-1279-4f9b-a60d-5ac47497d117 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:40.492812 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ceac60-1279-4f9b-a60d-5ac47497d117 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:40.497607 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344525d-f88c-410a-83e4-c16b861b5bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:40.498612 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344525d-f88c-410a-83e4-c16b861b5bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:40.498897 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344525d-f88c-410a-83e4-c16b861b5bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:40.499172 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344525d-f88c-410a-83e4-c16b861b5bc1 admin admin] PATH_INFO: `/v3/projects/1064a6b553fb4c94a1e46d890b3a7ca9/users/a542486e0ca24e00ab7c8760e2b32f35/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:40.514392 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344525d-f88c-410a-83e4-c16b861b5bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1064a6b553fb4c94a1e46d890b3a7ca9, user_id=a542486e0ca24e00ab7c8760e2b32f35, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:40.517038 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344525d-f88c-410a-83e4-c16b861b5bc1 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:40.530224 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1304/2597] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:02:40 2022] PUT /identity/v3/projects/1064a6b553fb4c94a1e46d890b3a7ca9/users/a542486e0ca24e00ab7c8760e2b32f35/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:02:40.541762 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fee7be-d311-4b16-9824-b91fb324718a None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:40.542077 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fee7be-d311-4b16-9824-b91fb324718a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:40.542358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fee7be-d311-4b16-9824-b91fb324718a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:40.569071 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-39fee7be-d311-4b16-9824-b91fb324718a None None] MFA Rules not processed for user `a542486e0ca24e00ab7c8760e2b32f35`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:02:40.570272 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-39fee7be-d311-4b16-9824-b91fb324718a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:40.632606 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1294/2598] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:02:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:02:40.643915 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344525d-f88c-410a-83e4-c16b861b5bc1 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:40.645598 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-a344525d-f88c-410a-83e4-c16b861b5bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:40.715068 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344525d-f88c-410a-83e4-c16b861b5bc1 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:40.720575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273877d-ec5c-4224-ad09-945cff7e777a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:40.721642 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273877d-ec5c-4224-ad09-945cff7e777a service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:40.721919 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273877d-ec5c-4224-ad09-945cff7e777a service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:40.722185 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273877d-ec5c-4224-ad09-945cff7e777a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:40.729955 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273877d-ec5c-4224-ad09-945cff7e777a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:40.731526 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273877d-ec5c-4224-ad09-945cff7e777a service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:40.740804 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1305/2599] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:02:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:02:43.371586 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fee7be-d311-4b16-9824-b91fb324718a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:43.433216 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fee7be-d311-4b16-9824-b91fb324718a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:43.438538 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eed3d-e3cd-4206-a208-3d46c5ea429f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:43.439409 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eed3d-e3cd-4206-a208-3d46c5ea429f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:43.439717 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eed3d-e3cd-4206-a208-3d46c5ea429f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:43.439990 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eed3d-e3cd-4206-a208-3d46c5ea429f admin admin] PATH_INFO: `/v3/users/a542486e0ca24e00ab7c8760e2b32f35` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:43.441287 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7eed3d-e3cd-4206-a208-3d46c5ea429f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a542486e0ca24e00ab7c8760e2b32f35)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:43.443193 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7eed3d-e3cd-4206-a208-3d46c5ea429f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:43.485913 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-fa7eed3d-e3cd-4206-a208-3d46c5ea429f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a542486e0ca24e00ab7c8760e2b32f35'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:43.492591 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-fa7eed3d-e3cd-4206-a208-3d46c5ea429f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a542486e0ca24e00ab7c8760e2b32f35'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:43.499196 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-fa7eed3d-e3cd-4206-a208-3d46c5ea429f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a542486e0ca24e00ab7c8760e2b32f35'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:43.499843 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-fa7eed3d-e3cd-4206-a208-3d46c5ea429f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a542486e0ca24e00ab7c8760e2b32f35'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:43.500440 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-fa7eed3d-e3cd-4206-a208-3d46c5ea429f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a542486e0ca24e00ab7c8760e2b32f35'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:43.517206 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1295/2600] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:02:43 2022] DELETE /identity/v3/users/a542486e0ca24e00ab7c8760e2b32f35 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:02:43.522716 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85867ece-7900-4a85-86bf-55ce62f91063 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:43.523203 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85867ece-7900-4a85-86bf-55ce62f91063 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:43.523301 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85867ece-7900-4a85-86bf-55ce62f91063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:43.541068 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-85867ece-7900-4a85-86bf-55ce62f91063 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:02:43.542264 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-85867ece-7900-4a85-86bf-55ce62f91063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:43.599506 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1306/2601] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:02:43.609021 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eed3d-e3cd-4206-a208-3d46c5ea429f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:43.610396 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fa7eed3d-e3cd-4206-a208-3d46c5ea429f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:43.665737 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eed3d-e3cd-4206-a208-3d46c5ea429f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:43.669305 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975d08b-6339-4755-98e0-25f49d377331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:43.669933 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975d08b-6339-4755-98e0-25f49d377331 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:43.670210 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975d08b-6339-4755-98e0-25f49d377331 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:43.670481 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975d08b-6339-4755-98e0-25f49d377331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:43.679306 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975d08b-6339-4755-98e0-25f49d377331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:43.680783 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975d08b-6339-4755-98e0-25f49d377331 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:43.689825 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1296/2602] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:02:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:02:43.943556 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85867ece-7900-4a85-86bf-55ce62f91063 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:43.945023 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-85867ece-7900-4a85-86bf-55ce62f91063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:43.956966 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85867ece-7900-4a85-86bf-55ce62f91063 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:43.961504 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de655c-a0cc-46f3-97d3-47f46147200e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:43.962362 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de655c-a0cc-46f3-97d3-47f46147200e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:43.962640 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de655c-a0cc-46f3-97d3-47f46147200e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:43.962909 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de655c-a0cc-46f3-97d3-47f46147200e admin admin] PATH_INFO: `/v3/projects/1064a6b553fb4c94a1e46d890b3a7ca9` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:43.964115 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de655c-a0cc-46f3-97d3-47f46147200e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1064a6b553fb4c94a1e46d890b3a7ca9)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:43.966019 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de655c-a0cc-46f3-97d3-47f46147200e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:44.012215 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d1de655c-a0cc-46f3-97d3-47f46147200e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1064a6b553fb4c94a1e46d890b3a7ca9', 'request_id': 'req-d1de655c-a0cc-46f3-97d3-47f46147200e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:44.018431 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d1de655c-a0cc-46f3-97d3-47f46147200e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1064a6b553fb4c94a1e46d890b3a7ca9', 'request_id': 'req-d1de655c-a0cc-46f3-97d3-47f46147200e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:44.024230 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d1de655c-a0cc-46f3-97d3-47f46147200e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1064a6b553fb4c94a1e46d890b3a7ca9', 'request_id': 'req-d1de655c-a0cc-46f3-97d3-47f46147200e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:44.036425 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d1de655c-a0cc-46f3-97d3-47f46147200e admin admin] The token cache is being invalidate because project 1064a6b553fb4c94a1e46d890b3a7ca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:02:44.036742 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d1de655c-a0cc-46f3-97d3-47f46147200e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:44.037390 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d1de655c-a0cc-46f3-97d3-47f46147200e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:44.038941 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1307/2603] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:02:43 2022] DELETE /identity/v3/projects/1064a6b553fb4c94a1e46d890b3a7ca9 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:02:44.043801 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dac71-2717-4f7b-96c9-a04a3080aa1b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:44.044137 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dac71-2717-4f7b-96c9-a04a3080aa1b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:44.044407 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dac71-2717-4f7b-96c9-a04a3080aa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:44.061957 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-cd8dac71-2717-4f7b-96c9-a04a3080aa1b None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:02:44.063192 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-cd8dac71-2717-4f7b-96c9-a04a3080aa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:44.120705 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1297/2604] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:02:44.128981 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a156d-de67-47f4-9e8d-7d53acda2734 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:44.129272 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a156d-de67-47f4-9e8d-7d53acda2734 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:44.129552 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a156d-de67-47f4-9e8d-7d53acda2734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:44.147739 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-860a156d-de67-47f4-9e8d-7d53acda2734 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:02:44.148950 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-860a156d-de67-47f4-9e8d-7d53acda2734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:44.157183 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1308/2605] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:02:44.161310 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8dac71-2717-4f7b-96c9-a04a3080aa1b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:44.171534 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8dac71-2717-4f7b-96c9-a04a3080aa1b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:44.176953 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e22dfe-07d2-4350-92d5-7cd5c5c5cd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:44.177614 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e22dfe-07d2-4350-92d5-7cd5c5c5cd84 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:44.177896 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e22dfe-07d2-4350-92d5-7cd5c5c5cd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:44.178173 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e22dfe-07d2-4350-92d5-7cd5c5c5cd84 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:44.178907 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e22dfe-07d2-4350-92d5-7cd5c5c5cd84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 14:02:44.179214 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e22dfe-07d2-4350-92d5-7cd5c5c5cd84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:44.180845 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e22dfe-07d2-4350-92d5-7cd5c5c5cd84 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:44.193030 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1298/2606] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 14:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 14:02:44.197242 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a156d-de67-47f4-9e8d-7d53acda2734 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:44.206331 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a156d-de67-47f4-9e8d-7d53acda2734 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:44.211645 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfeb506-43b8-42b1-9318-b247e7ac6d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:44.212304 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfeb506-43b8-42b1-9318-b247e7ac6d90 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:44.212587 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfeb506-43b8-42b1-9318-b247e7ac6d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:44.212861 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfeb506-43b8-42b1-9318-b247e7ac6d90 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:44.213591 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfeb506-43b8-42b1-9318-b247e7ac6d90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:44.215569 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfeb506-43b8-42b1-9318-b247e7ac6d90 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:44.245398 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1309/2607] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:02:44 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:02:44.246668 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e22dfe-07d2-4350-92d5-7cd5c5c5cd84 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:44.257770 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e22dfe-07d2-4350-92d5-7cd5c5c5cd84 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:44.326754 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9e239-feb9-425c-bdc0-4814758597b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:44.327417 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9e239-feb9-425c-bdc0-4814758597b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:44.327734 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9e239-feb9-425c-bdc0-4814758597b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:44.328008 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9e239-feb9-425c-bdc0-4814758597b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:44.328718 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9e239-feb9-425c-bdc0-4814758597b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:44.330616 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9e239-feb9-425c-bdc0-4814758597b6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:44.351146 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1299/2608] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:02:44 2022] POST /identity/v3/users => generated 303 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 14:02:44.355128 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfeb506-43b8-42b1-9318-b247e7ac6d90 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:44.366306 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfeb506-43b8-42b1-9318-b247e7ac6d90 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:44.371004 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2d602-b056-4c31-82b2-a3e4f8b15336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:44.371610 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2d602-b056-4c31-82b2-a3e4f8b15336 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:44.371923 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2d602-b056-4c31-82b2-a3e4f8b15336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:44.372201 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd2d602-b056-4c31-82b2-a3e4f8b15336 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:44.372927 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2d602-b056-4c31-82b2-a3e4f8b15336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:44.374524 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd2d602-b056-4c31-82b2-a3e4f8b15336 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:44.386387 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1310/2609] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:02:44.390429 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9e239-feb9-425c-bdc0-4814758597b6 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:44.402102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9e239-feb9-425c-bdc0-4814758597b6 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:44.407466 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6524c-65e8-4a60-b66e-41b0da9411ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:44.408168 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6524c-65e8-4a60-b66e-41b0da9411ef admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:44.408451 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6524c-65e8-4a60-b66e-41b0da9411ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:44.408728 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6524c-65e8-4a60-b66e-41b0da9411ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:44.409482 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6524c-65e8-4a60-b66e-41b0da9411ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:44.411101 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6524c-65e8-4a60-b66e-41b0da9411ef admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:44.421119 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1300/2610] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:02:44.425881 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2d602-b056-4c31-82b2-a3e4f8b15336 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:44.435894 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd2d602-b056-4c31-82b2-a3e4f8b15336 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:44.441569 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a94d3-849a-4a25-8a16-af7fe7d172c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:44.442454 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a94d3-849a-4a25-8a16-af7fe7d172c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:44.442737 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a94d3-849a-4a25-8a16-af7fe7d172c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:44.443010 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a94d3-849a-4a25-8a16-af7fe7d172c3 admin admin] PATH_INFO: `/v3/projects/f79cf9ec53cf4c9dbbe59b8c3703fee3/users/0097047264544a578998afd4bbc2e079/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:44.458648 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a94d3-849a-4a25-8a16-af7fe7d172c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79cf9ec53cf4c9dbbe59b8c3703fee3, user_id=0097047264544a578998afd4bbc2e079, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:44.461329 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a94d3-849a-4a25-8a16-af7fe7d172c3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:44.473959 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1311/2611] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:02:44 2022] PUT /identity/v3/projects/f79cf9ec53cf4c9dbbe59b8c3703fee3/users/0097047264544a578998afd4bbc2e079/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:02:44.484047 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce296bcb-d7e1-4716-8fde-5c7341831f53 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:44.484415 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce296bcb-d7e1-4716-8fde-5c7341831f53 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:44.484720 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce296bcb-d7e1-4716-8fde-5c7341831f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:44.510794 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ce296bcb-d7e1-4716-8fde-5c7341831f53 None None] MFA Rules not processed for user `0097047264544a578998afd4bbc2e079`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:02:44.512032 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ce296bcb-d7e1-4716-8fde-5c7341831f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:44.572702 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1301/2612] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:02:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:02:44.577126 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a94d3-849a-4a25-8a16-af7fe7d172c3 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:44.637311 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a94d3-849a-4a25-8a16-af7fe7d172c3 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:44.641932 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2e7b9-85c5-49a7-afa0-9822c8df799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:44.642591 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2e7b9-85c5-49a7-afa0-9822c8df799b admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:44.642877 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2e7b9-85c5-49a7-afa0-9822c8df799b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:44.643155 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2e7b9-85c5-49a7-afa0-9822c8df799b admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:44.643889 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2e7b9-85c5-49a7-afa0-9822c8df799b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:44.645776 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2e7b9-85c5-49a7-afa0-9822c8df799b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:44.671153 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1312/2613] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:02:44 2022] POST /identity/v3/projects => generated 403 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:02:44.675672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce296bcb-d7e1-4716-8fde-5c7341831f53 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:44.686379 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce296bcb-d7e1-4716-8fde-5c7341831f53 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:44.740057 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4cd95-9934-405a-ad6f-61ef62a5f151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:44.740721 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4cd95-9934-405a-ad6f-61ef62a5f151 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:44.741087 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4cd95-9934-405a-ad6f-61ef62a5f151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:44.741264 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4cd95-9934-405a-ad6f-61ef62a5f151 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:44.742040 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4cd95-9934-405a-ad6f-61ef62a5f151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:44.743989 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4cd95-9934-405a-ad6f-61ef62a5f151 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:44.762562 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1302/2614] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:02:44 2022] POST /identity/v3/users => generated 308 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:02:44.767372 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2e7b9-85c5-49a7-afa0-9822c8df799b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:44.778675 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2e7b9-85c5-49a7-afa0-9822c8df799b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:44.783274 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c02ee-bfab-44ba-b4f4-10922f2364b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:44.783969 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c02ee-bfab-44ba-b4f4-10922f2364b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:44.784254 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c02ee-bfab-44ba-b4f4-10922f2364b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:44.785120 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c02ee-bfab-44ba-b4f4-10922f2364b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:44.785847 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c02ee-bfab-44ba-b4f4-10922f2364b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:44.787468 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c02ee-bfab-44ba-b4f4-10922f2364b8 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:44.797806 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1313/2615] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:02:44.801932 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4cd95-9934-405a-ad6f-61ef62a5f151 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:44.811564 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4cd95-9934-405a-ad6f-61ef62a5f151 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:44.816138 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb0d42-d7b6-406f-8a73-378bc96bea13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:44.816999 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb0d42-d7b6-406f-8a73-378bc96bea13 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:44.817281 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb0d42-d7b6-406f-8a73-378bc96bea13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:44.817551 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb0d42-d7b6-406f-8a73-378bc96bea13 admin admin] PATH_INFO: `/v3/projects/6c3fb872c39240a99188d2468c92a6a0/users/1a04fc7b25a141d5a170c15969d5ee28/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:44.832504 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb0d42-d7b6-406f-8a73-378bc96bea13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c3fb872c39240a99188d2468c92a6a0, user_id=1a04fc7b25a141d5a170c15969d5ee28, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:44.835390 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb0d42-d7b6-406f-8a73-378bc96bea13 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:44.848392 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1303/2616] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:02:44 2022] PUT /identity/v3/projects/6c3fb872c39240a99188d2468c92a6a0/users/1a04fc7b25a141d5a170c15969d5ee28/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:02:44.852257 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c02ee-bfab-44ba-b4f4-10922f2364b8 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:44.862067 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c02ee-bfab-44ba-b4f4-10922f2364b8 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:44.916081 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a3b60-e2d3-40a6-a5a3-8b12422bbbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:44.916667 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a3b60-e2d3-40a6-a5a3-8b12422bbbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:44.916952 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a3b60-e2d3-40a6-a5a3-8b12422bbbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:44.917228 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a3b60-e2d3-40a6-a5a3-8b12422bbbf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:44.917945 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a3b60-e2d3-40a6-a5a3-8b12422bbbf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:44.919547 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a3b60-e2d3-40a6-a5a3-8b12422bbbf0 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:44.929048 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1314/2617] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:02:44.933180 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb0d42-d7b6-406f-8a73-378bc96bea13 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:44.943664 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb0d42-d7b6-406f-8a73-378bc96bea13 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:44.948265 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29d3b3-cfd3-44a9-a53d-c77d9ae49843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:44.949141 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29d3b3-cfd3-44a9-a53d-c77d9ae49843 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:44.949418 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29d3b3-cfd3-44a9-a53d-c77d9ae49843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:44.949687 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29d3b3-cfd3-44a9-a53d-c77d9ae49843 admin admin] PATH_INFO: `/v3/projects/6c3fb872c39240a99188d2468c92a6a0/users/1a04fc7b25a141d5a170c15969d5ee28/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:44.951642 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29d3b3-cfd3-44a9-a53d-c77d9ae49843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c3fb872c39240a99188d2468c92a6a0, user_id=1a04fc7b25a141d5a170c15969d5ee28, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:44.954280 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29d3b3-cfd3-44a9-a53d-c77d9ae49843 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:44.964635 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1304/2618] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:02:44 2022] PUT /identity/v3/projects/6c3fb872c39240a99188d2468c92a6a0/users/1a04fc7b25a141d5a170c15969d5ee28/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:02:44.975888 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e2d9b-1af2-4e0b-ae19-16310eb0b0a1 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:44.976180 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e2d9b-1af2-4e0b-ae19-16310eb0b0a1 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:44.976486 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e2d9b-1af2-4e0b-ae19-16310eb0b0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:45.001643 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d82e2d9b-1af2-4e0b-ae19-16310eb0b0a1 None None] MFA Rules not processed for user `1a04fc7b25a141d5a170c15969d5ee28`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:02:45.002832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d82e2d9b-1af2-4e0b-ae19-16310eb0b0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:45.067574 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1315/2619] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:02:44 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:02:45.078400 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29d3b3-cfd3-44a9-a53d-c77d9ae49843 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:45.080094 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-bf29d3b3-cfd3-44a9-a53d-c77d9ae49843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:45.135055 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29d3b3-cfd3-44a9-a53d-c77d9ae49843 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:45.138713 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944e219-8116-4804-89a0-2c63eb357617 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:45.139344 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944e219-8116-4804-89a0-2c63eb357617 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:45.139619 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944e219-8116-4804-89a0-2c63eb357617 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:45.139922 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944e219-8116-4804-89a0-2c63eb357617 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:45.149756 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944e219-8116-4804-89a0-2c63eb357617 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:45.151198 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944e219-8116-4804-89a0-2c63eb357617 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:45.160514 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1305/2620] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:02:45 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:02:45.293639 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e2d9b-1af2-4e0b-ae19-16310eb0b0a1 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:45.353486 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e2d9b-1af2-4e0b-ae19-16310eb0b0a1 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:45.357983 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b3ee7-c49c-4c66-b5f6-008c3f8f9e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:45.358841 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b3ee7-c49c-4c66-b5f6-008c3f8f9e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:45.359121 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b3ee7-c49c-4c66-b5f6-008c3f8f9e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:45.359393 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b3ee7-c49c-4c66-b5f6-008c3f8f9e03 admin admin] PATH_INFO: `/v3/users/0097047264544a578998afd4bbc2e079` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:45.360627 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b3ee7-c49c-4c66-b5f6-008c3f8f9e03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0097047264544a578998afd4bbc2e079)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:45.362556 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b3ee7-c49c-4c66-b5f6-008c3f8f9e03 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:45.407507 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-989b3ee7-c49c-4c66-b5f6-008c3f8f9e03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0097047264544a578998afd4bbc2e079'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:45.408196 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-989b3ee7-c49c-4c66-b5f6-008c3f8f9e03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0097047264544a578998afd4bbc2e079'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:45.415582 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-989b3ee7-c49c-4c66-b5f6-008c3f8f9e03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0097047264544a578998afd4bbc2e079'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:45.422268 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-989b3ee7-c49c-4c66-b5f6-008c3f8f9e03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0097047264544a578998afd4bbc2e079'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:45.422895 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-989b3ee7-c49c-4c66-b5f6-008c3f8f9e03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0097047264544a578998afd4bbc2e079'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:45.439705 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1316/2621] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:02:45 2022] DELETE /identity/v3/users/0097047264544a578998afd4bbc2e079 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:02:45.444349 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43ecbb-1e6e-40cf-b153-2febee86c7c4 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:45.444848 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43ecbb-1e6e-40cf-b153-2febee86c7c4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:45.444955 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43ecbb-1e6e-40cf-b153-2febee86c7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:45.462562 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ea43ecbb-1e6e-40cf-b153-2febee86c7c4 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:02:45.463874 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ea43ecbb-1e6e-40cf-b153-2febee86c7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:45.521090 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1306/2622] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:02:45.531124 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b3ee7-c49c-4c66-b5f6-008c3f8f9e03 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:45.532662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-989b3ee7-c49c-4c66-b5f6-008c3f8f9e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:45.589345 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b3ee7-c49c-4c66-b5f6-008c3f8f9e03 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:45.593154 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7aced-745d-4716-ad62-dc3fd53a5bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:45.593799 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7aced-745d-4716-ad62-dc3fd53a5bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:45.594084 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7aced-745d-4716-ad62-dc3fd53a5bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:45.594361 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7aced-745d-4716-ad62-dc3fd53a5bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:45.604149 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7aced-745d-4716-ad62-dc3fd53a5bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:45.605592 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7aced-745d-4716-ad62-dc3fd53a5bb6 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:45.615210 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1317/2623] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:02:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:02:45.875993 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43ecbb-1e6e-40cf-b153-2febee86c7c4 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:45.877441 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ea43ecbb-1e6e-40cf-b153-2febee86c7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:45.889889 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43ecbb-1e6e-40cf-b153-2febee86c7c4 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:45.895080 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccba07d-cb51-4326-99f8-3fd38addf61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:45.895980 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccba07d-cb51-4326-99f8-3fd38addf61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:45.896544 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccba07d-cb51-4326-99f8-3fd38addf61b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:45.896819 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccba07d-cb51-4326-99f8-3fd38addf61b admin admin] PATH_INFO: `/v3/projects/f79cf9ec53cf4c9dbbe59b8c3703fee3` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:45.898005 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccba07d-cb51-4326-99f8-3fd38addf61b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f79cf9ec53cf4c9dbbe59b8c3703fee3)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:45.900105 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccba07d-cb51-4326-99f8-3fd38addf61b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:45.944933 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4ccba07d-cb51-4326-99f8-3fd38addf61b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f79cf9ec53cf4c9dbbe59b8c3703fee3', 'request_id': 'req-4ccba07d-cb51-4326-99f8-3fd38addf61b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:45.952007 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4ccba07d-cb51-4326-99f8-3fd38addf61b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f79cf9ec53cf4c9dbbe59b8c3703fee3', 'request_id': 'req-4ccba07d-cb51-4326-99f8-3fd38addf61b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:45.958332 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4ccba07d-cb51-4326-99f8-3fd38addf61b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f79cf9ec53cf4c9dbbe59b8c3703fee3', 'request_id': 'req-4ccba07d-cb51-4326-99f8-3fd38addf61b'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:45.969311 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4ccba07d-cb51-4326-99f8-3fd38addf61b admin admin] The token cache is being invalidate because project f79cf9ec53cf4c9dbbe59b8c3703fee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:02:45.969596 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4ccba07d-cb51-4326-99f8-3fd38addf61b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:45.970250 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4ccba07d-cb51-4326-99f8-3fd38addf61b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:45.973730 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1307/2624] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:02:45 2022] DELETE /identity/v3/projects/f79cf9ec53cf4c9dbbe59b8c3703fee3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:02:45.977735 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7aced-745d-4716-ad62-dc3fd53a5bb6 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:45.987347 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7aced-745d-4716-ad62-dc3fd53a5bb6 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:46.046856 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14392ab6-c7dc-4b00-bf44-693c9ef6834f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:46.047660 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14392ab6-c7dc-4b00-bf44-693c9ef6834f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:46.047968 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14392ab6-c7dc-4b00-bf44-693c9ef6834f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:46.048224 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14392ab6-c7dc-4b00-bf44-693c9ef6834f admin admin] PATH_INFO: `/v3/users/1a04fc7b25a141d5a170c15969d5ee28` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:46.049789 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14392ab6-c7dc-4b00-bf44-693c9ef6834f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a04fc7b25a141d5a170c15969d5ee28)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:46.051794 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14392ab6-c7dc-4b00-bf44-693c9ef6834f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:46.097641 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-14392ab6-c7dc-4b00-bf44-693c9ef6834f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a04fc7b25a141d5a170c15969d5ee28'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:46.098273 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-14392ab6-c7dc-4b00-bf44-693c9ef6834f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a04fc7b25a141d5a170c15969d5ee28'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:46.104849 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-14392ab6-c7dc-4b00-bf44-693c9ef6834f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a04fc7b25a141d5a170c15969d5ee28'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:46.114702 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-14392ab6-c7dc-4b00-bf44-693c9ef6834f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a04fc7b25a141d5a170c15969d5ee28'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:46.115328 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-14392ab6-c7dc-4b00-bf44-693c9ef6834f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a04fc7b25a141d5a170c15969d5ee28'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:46.133176 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1318/2625] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:02:45 2022] DELETE /identity/v3/users/1a04fc7b25a141d5a170c15969d5ee28 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:02:46.401498 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccba07d-cb51-4326-99f8-3fd38addf61b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:46.403028 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4ccba07d-cb51-4326-99f8-3fd38addf61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:46.416867 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccba07d-cb51-4326-99f8-3fd38addf61b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:46.481778 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06465720-9e29-43d2-bd55-f78c2597da94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:46.482559 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06465720-9e29-43d2-bd55-f78c2597da94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:46.482846 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06465720-9e29-43d2-bd55-f78c2597da94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:46.483122 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06465720-9e29-43d2-bd55-f78c2597da94 admin admin] PATH_INFO: `/v3/projects/6c3fb872c39240a99188d2468c92a6a0` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:46.484524 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06465720-9e29-43d2-bd55-f78c2597da94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c3fb872c39240a99188d2468c92a6a0)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:46.486449 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06465720-9e29-43d2-bd55-f78c2597da94 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:46.536060 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-06465720-9e29-43d2-bd55-f78c2597da94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c3fb872c39240a99188d2468c92a6a0', 'request_id': 'req-06465720-9e29-43d2-bd55-f78c2597da94'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:46.553125 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-06465720-9e29-43d2-bd55-f78c2597da94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c3fb872c39240a99188d2468c92a6a0', 'request_id': 'req-06465720-9e29-43d2-bd55-f78c2597da94'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:46.560264 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-06465720-9e29-43d2-bd55-f78c2597da94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c3fb872c39240a99188d2468c92a6a0', 'request_id': 'req-06465720-9e29-43d2-bd55-f78c2597da94'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:46.571668 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-06465720-9e29-43d2-bd55-f78c2597da94 admin admin] The token cache is being invalidate because project 6c3fb872c39240a99188d2468c92a6a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:02:46.572029 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-06465720-9e29-43d2-bd55-f78c2597da94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:46.572684 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-06465720-9e29-43d2-bd55-f78c2597da94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:46.574275 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1308/2626] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:02:46 2022] DELETE /identity/v3/projects/6c3fb872c39240a99188d2468c92a6a0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:02:46.580931 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154d313-adb1-46a0-bfb0-795d78cf2e9b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:46.581462 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154d313-adb1-46a0-bfb0-795d78cf2e9b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:46.581823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154d313-adb1-46a0-bfb0-795d78cf2e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:46.600614 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-5154d313-adb1-46a0-bfb0-795d78cf2e9b None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:02:46.601830 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5154d313-adb1-46a0-bfb0-795d78cf2e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:46.665363 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1319/2627] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:02:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:02:46.673412 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7d185-7811-46b1-8732-cbe17c15914c None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:46.673781 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7d185-7811-46b1-8732-cbe17c15914c None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:46.674314 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7d185-7811-46b1-8732-cbe17c15914c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:46.695839 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-33f7d185-7811-46b1-8732-cbe17c15914c None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:02:46.697059 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-33f7d185-7811-46b1-8732-cbe17c15914c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:46.704990 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1309/2628] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:02:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:02:46.710093 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154d313-adb1-46a0-bfb0-795d78cf2e9b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:46.719501 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154d313-adb1-46a0-bfb0-795d78cf2e9b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:46.725430 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd17ec6-a043-489b-b971-69e31a8cc225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:46.726102 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd17ec6-a043-489b-b971-69e31a8cc225 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:46.726382 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd17ec6-a043-489b-b971-69e31a8cc225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:46.726656 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd17ec6-a043-489b-b971-69e31a8cc225 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:46.727390 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd17ec6-a043-489b-b971-69e31a8cc225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 14:02:46.727723 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd17ec6-a043-489b-b971-69e31a8cc225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:46.729335 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd17ec6-a043-489b-b971-69e31a8cc225 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:46.741515 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1320/2629] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 14:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 14:02:46.752693 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7d185-7811-46b1-8732-cbe17c15914c None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:46.770772 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7d185-7811-46b1-8732-cbe17c15914c None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:46.775695 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075c060-fb0a-4954-974f-f192395ebbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:46.776351 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075c060-fb0a-4954-974f-f192395ebbc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:46.776631 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075c060-fb0a-4954-974f-f192395ebbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:46.776903 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075c060-fb0a-4954-974f-f192395ebbc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:46.777584 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075c060-fb0a-4954-974f-f192395ebbc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:46.779594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075c060-fb0a-4954-974f-f192395ebbc1 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:46.806867 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1310/2630] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:02:46 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:02:46.810590 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd17ec6-a043-489b-b971-69e31a8cc225 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:46.821223 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd17ec6-a043-489b-b971-69e31a8cc225 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:46.888834 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafb32b-26cb-401e-af00-c8c3fa446c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:46.889646 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafb32b-26cb-401e-af00-c8c3fa446c8a admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:46.890029 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafb32b-26cb-401e-af00-c8c3fa446c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:46.890382 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafb32b-26cb-401e-af00-c8c3fa446c8a admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:46.891578 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafb32b-26cb-401e-af00-c8c3fa446c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:46.894251 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafb32b-26cb-401e-af00-c8c3fa446c8a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:46.927717 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1321/2631] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:02:46 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:02:46.932328 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075c060-fb0a-4954-974f-f192395ebbc1 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:46.945079 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075c060-fb0a-4954-974f-f192395ebbc1 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:46.951694 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef887b-e3fb-4f6c-a5f8-a8beac85b6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:46.952946 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef887b-e3fb-4f6c-a5f8-a8beac85b6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:46.953435 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef887b-e3fb-4f6c-a5f8-a8beac85b6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:46.953930 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef887b-e3fb-4f6c-a5f8-a8beac85b6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:46.954835 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef887b-e3fb-4f6c-a5f8-a8beac85b6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:46.956941 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef887b-e3fb-4f6c-a5f8-a8beac85b6c5 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:46.973495 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafb32b-26cb-401e-af00-c8c3fa446c8a admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:46.980965 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1311/2632] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:02:46.985887 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafb32b-26cb-401e-af00-c8c3fa446c8a admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:46.992181 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f5a8f-2b25-4b6a-b374-6cd564a89776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:46.992989 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f5a8f-2b25-4b6a-b374-6cd564a89776 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:46.993348 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f5a8f-2b25-4b6a-b374-6cd564a89776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:46.993815 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f5a8f-2b25-4b6a-b374-6cd564a89776 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:46.994516 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f5a8f-2b25-4b6a-b374-6cd564a89776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:46.996256 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f5a8f-2b25-4b6a-b374-6cd564a89776 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:47.008862 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1322/2633] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:02:47.012961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef887b-e3fb-4f6c-a5f8-a8beac85b6c5 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:47.024571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef887b-e3fb-4f6c-a5f8-a8beac85b6c5 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:47.030060 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf76d8-2ec2-4353-a223-7e5b7d348eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:47.030679 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf76d8-2ec2-4353-a223-7e5b7d348eef admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:47.030970 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf76d8-2ec2-4353-a223-7e5b7d348eef admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:47.031578 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf76d8-2ec2-4353-a223-7e5b7d348eef admin admin] PATH_INFO: `/v3/projects/f96fb0a6f9f0416ea509624c78a4c33f/users/9956b3e79b5e40b2b27d096869906fb9/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:47.051004 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf76d8-2ec2-4353-a223-7e5b7d348eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f96fb0a6f9f0416ea509624c78a4c33f, user_id=9956b3e79b5e40b2b27d096869906fb9, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:47.053648 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf76d8-2ec2-4353-a223-7e5b7d348eef admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:47.077901 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1312/2634] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:02:47 2022] PUT /identity/v3/projects/f96fb0a6f9f0416ea509624c78a4c33f/users/9956b3e79b5e40b2b27d096869906fb9/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:02:47.091035 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1619907-6539-40ed-9e07-6b536f65aa4b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:47.091352 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1619907-6539-40ed-9e07-6b536f65aa4b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:47.091656 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1619907-6539-40ed-9e07-6b536f65aa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:47.119152 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c1619907-6539-40ed-9e07-6b536f65aa4b None None] MFA Rules not processed for user `9956b3e79b5e40b2b27d096869906fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:02:47.120453 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c1619907-6539-40ed-9e07-6b536f65aa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:47.184878 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1323/2635] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:02:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:02:47.196622 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf76d8-2ec2-4353-a223-7e5b7d348eef admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:47.198450 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f7cf76d8-2ec2-4353-a223-7e5b7d348eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:47.255101 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf76d8-2ec2-4353-a223-7e5b7d348eef admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:47.258663 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d7bfe-1911-41bb-8ce1-7a29947573f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:47.259305 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d7bfe-1911-41bb-8ce1-7a29947573f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:47.259584 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d7bfe-1911-41bb-8ce1-7a29947573f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:47.259885 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d7bfe-1911-41bb-8ce1-7a29947573f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:47.268136 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d7bfe-1911-41bb-8ce1-7a29947573f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:47.270190 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d7bfe-1911-41bb-8ce1-7a29947573f4 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:47.279489 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1313/2636] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:02:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:02:52.919061 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1619907-6539-40ed-9e07-6b536f65aa4b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:52.920501 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c1619907-6539-40ed-9e07-6b536f65aa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:52.974278 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1619907-6539-40ed-9e07-6b536f65aa4b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:52.977797 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cc029-bb05-4b3d-ad68-d4068e66fa04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:52.978437 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cc029-bb05-4b3d-ad68-d4068e66fa04 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:52.978717 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cc029-bb05-4b3d-ad68-d4068e66fa04 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:52.978994 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cc029-bb05-4b3d-ad68-d4068e66fa04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:52.980778 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c40cc029-bb05-4b3d-ad68-d4068e66fa04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:53.042718 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cc029-bb05-4b3d-ad68-d4068e66fa04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:53.044452 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cc029-bb05-4b3d-ad68-d4068e66fa04 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:53.054314 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1324/2637] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:02:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:02:56.226477 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d7bfe-1911-41bb-8ce1-7a29947573f4 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:56.227923 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d16d7bfe-1911-41bb-8ce1-7a29947573f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:56.242046 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d7bfe-1911-41bb-8ce1-7a29947573f4 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:56.247340 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bbbcb-d488-40c5-9e8b-7a9de70501f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:56.248290 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bbbcb-d488-40c5-9e8b-7a9de70501f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:56.248571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bbbcb-d488-40c5-9e8b-7a9de70501f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:56.248847 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bbbcb-d488-40c5-9e8b-7a9de70501f9 admin admin] PATH_INFO: `/v3/users/539174103f414528829d033481b83b0d` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:56.250034 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bbbcb-d488-40c5-9e8b-7a9de70501f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=539174103f414528829d033481b83b0d)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:56.251988 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bbbcb-d488-40c5-9e8b-7a9de70501f9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:56.302987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-0c7bbbcb-d488-40c5-9e8b-7a9de70501f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '539174103f414528829d033481b83b0d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:56.311480 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-0c7bbbcb-d488-40c5-9e8b-7a9de70501f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '539174103f414528829d033481b83b0d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:56.319576 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-0c7bbbcb-d488-40c5-9e8b-7a9de70501f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '539174103f414528829d033481b83b0d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:56.320288 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-0c7bbbcb-d488-40c5-9e8b-7a9de70501f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '539174103f414528829d033481b83b0d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:56.320919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-0c7bbbcb-d488-40c5-9e8b-7a9de70501f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '539174103f414528829d033481b83b0d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:56.345316 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1314/2638] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:02:56 2022] DELETE /identity/v3/users/539174103f414528829d033481b83b0d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:02:56.522342 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cc029-bb05-4b3d-ad68-d4068e66fa04 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:56.542007 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cc029-bb05-4b3d-ad68-d4068e66fa04 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:56.626074 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec5ce3-fa87-434a-a408-0cd3cb82a263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:56.626941 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec5ce3-fa87-434a-a408-0cd3cb82a263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:56.627255 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec5ce3-fa87-434a-a408-0cd3cb82a263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:56.627528 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec5ce3-fa87-434a-a408-0cd3cb82a263 admin admin] PATH_INFO: `/v3/projects/a8a28d94e79a4972b0f8f61ab1cb1490` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:56.628841 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec5ce3-fa87-434a-a408-0cd3cb82a263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8a28d94e79a4972b0f8f61ab1cb1490)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:56.630773 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec5ce3-fa87-434a-a408-0cd3cb82a263 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:56.678054 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e0ec5ce3-fa87-434a-a408-0cd3cb82a263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'request_id': 'req-e0ec5ce3-fa87-434a-a408-0cd3cb82a263'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:56.684720 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e0ec5ce3-fa87-434a-a408-0cd3cb82a263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'request_id': 'req-e0ec5ce3-fa87-434a-a408-0cd3cb82a263'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:56.690407 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e0ec5ce3-fa87-434a-a408-0cd3cb82a263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8a28d94e79a4972b0f8f61ab1cb1490', 'request_id': 'req-e0ec5ce3-fa87-434a-a408-0cd3cb82a263'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:56.701644 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e0ec5ce3-fa87-434a-a408-0cd3cb82a263 admin admin] The token cache is being invalidate because project a8a28d94e79a4972b0f8f61ab1cb1490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:02:56.701934 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e0ec5ce3-fa87-434a-a408-0cd3cb82a263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:56.702588 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e0ec5ce3-fa87-434a-a408-0cd3cb82a263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:02:56.704172 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1325/2639] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:02:56 2022] DELETE /identity/v3/projects/a8a28d94e79a4972b0f8f61ab1cb1490 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:02:56.709637 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0d861-5ec9-478f-9006-c6ec01307c36 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:56.709928 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0d861-5ec9-478f-9006-c6ec01307c36 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:56.710207 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0d861-5ec9-478f-9006-c6ec01307c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:56.727770 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-56f0d861-5ec9-478f-9006-c6ec01307c36 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:02:56.728971 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-56f0d861-5ec9-478f-9006-c6ec01307c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:56.787467 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1315/2640] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:02:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:02:56.795316 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879b9cb-8f6e-46f5-b69b-d9ff1dbf1dec None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:56.795604 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879b9cb-8f6e-46f5-b69b-d9ff1dbf1dec None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:56.795912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879b9cb-8f6e-46f5-b69b-d9ff1dbf1dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:56.814719 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c879b9cb-8f6e-46f5-b69b-d9ff1dbf1dec None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:02:56.816288 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c879b9cb-8f6e-46f5-b69b-d9ff1dbf1dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:56.824435 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1326/2641] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:02:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:02:56.828597 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0d861-5ec9-478f-9006-c6ec01307c36 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:56.838624 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0d861-5ec9-478f-9006-c6ec01307c36 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:56.843199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c966f11-e176-4236-bcb1-0c9143c2cc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:56.843878 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c966f11-e176-4236-bcb1-0c9143c2cc64 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:56.844162 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c966f11-e176-4236-bcb1-0c9143c2cc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:56.844437 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c966f11-e176-4236-bcb1-0c9143c2cc64 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:56.845167 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c966f11-e176-4236-bcb1-0c9143c2cc64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 14:02:56.845473 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c966f11-e176-4236-bcb1-0c9143c2cc64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:56.847877 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c966f11-e176-4236-bcb1-0c9143c2cc64 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:56.859921 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1316/2642] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 14:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 14:02:56.864289 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879b9cb-8f6e-46f5-b69b-d9ff1dbf1dec None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:56.873352 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879b9cb-8f6e-46f5-b69b-d9ff1dbf1dec None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:56.878070 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e141121-f8b0-4538-b6af-088d24655406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:56.878725 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e141121-f8b0-4538-b6af-088d24655406 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:56.879002 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e141121-f8b0-4538-b6af-088d24655406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:56.879283 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e141121-f8b0-4538-b6af-088d24655406 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:56.880016 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e141121-f8b0-4538-b6af-088d24655406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:56.881931 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e141121-f8b0-4538-b6af-088d24655406 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:56.907371 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1327/2643] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:02:56 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:02:56.912918 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c966f11-e176-4236-bcb1-0c9143c2cc64 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:56.923007 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c966f11-e176-4236-bcb1-0c9143c2cc64 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:56.976658 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07961e-9b8b-4470-8867-a2270daab6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:56.977314 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07961e-9b8b-4470-8867-a2270daab6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:56.977594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07961e-9b8b-4470-8867-a2270daab6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:56.977869 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07961e-9b8b-4470-8867-a2270daab6c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:56.978543 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07961e-9b8b-4470-8867-a2270daab6c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:56.980476 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07961e-9b8b-4470-8867-a2270daab6c2 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:56.998942 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1317/2644] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:02:56 2022] POST /identity/v3/users => generated 292 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:02:57.003836 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e141121-f8b0-4538-b6af-088d24655406 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:57.013966 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e141121-f8b0-4538-b6af-088d24655406 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:57.019374 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07079c-c49b-4c73-8050-a5af0f20109e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:57.020075 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07079c-c49b-4c73-8050-a5af0f20109e admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:57.020614 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07079c-c49b-4c73-8050-a5af0f20109e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:57.020895 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07079c-c49b-4c73-8050-a5af0f20109e admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:57.021624 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07079c-c49b-4c73-8050-a5af0f20109e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:57.023254 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07079c-c49b-4c73-8050-a5af0f20109e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:57.034626 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1328/2645] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:02:57.038664 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07961e-9b8b-4470-8867-a2270daab6c2 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:57.048465 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07961e-9b8b-4470-8867-a2270daab6c2 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:57.053376 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40139804-f426-486e-ab90-dfd5351f64dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:57.054030 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40139804-f426-486e-ab90-dfd5351f64dd admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:57.054316 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40139804-f426-486e-ab90-dfd5351f64dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:57.054613 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40139804-f426-486e-ab90-dfd5351f64dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:57.055341 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40139804-f426-486e-ab90-dfd5351f64dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:57.056979 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40139804-f426-486e-ab90-dfd5351f64dd admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:57.071060 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1318/2646] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:02:57.072329 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07079c-c49b-4c73-8050-a5af0f20109e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:57.082655 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07079c-c49b-4c73-8050-a5af0f20109e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:57.087235 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ae18b-3045-4f52-8293-5bfdd49dfbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:57.088137 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ae18b-3045-4f52-8293-5bfdd49dfbf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:57.088417 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ae18b-3045-4f52-8293-5bfdd49dfbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:57.088690 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ae18b-3045-4f52-8293-5bfdd49dfbf4 admin admin] PATH_INFO: `/v3/projects/8e0c39df8a6949878721e181a43c4643/users/ffc0b94e81b44896918d88518ab6df55/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:57.102535 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ae18b-3045-4f52-8293-5bfdd49dfbf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e0c39df8a6949878721e181a43c4643, user_id=ffc0b94e81b44896918d88518ab6df55, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:57.105206 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ae18b-3045-4f52-8293-5bfdd49dfbf4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:57.117648 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1329/2647] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:02:57 2022] PUT /identity/v3/projects/8e0c39df8a6949878721e181a43c4643/users/ffc0b94e81b44896918d88518ab6df55/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 14:02:57.128202 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b16442-fdbd-4c4b-a43e-32a224c9c309 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:57.128489 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b16442-fdbd-4c4b-a43e-32a224c9c309 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:57.128766 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b16442-fdbd-4c4b-a43e-32a224c9c309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:57.155184 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-63b16442-fdbd-4c4b-a43e-32a224c9c309 None None] MFA Rules not processed for user `ffc0b94e81b44896918d88518ab6df55`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:02:57.156574 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-63b16442-fdbd-4c4b-a43e-32a224c9c309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:57.219166 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1319/2648] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:02:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:02:57.229662 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ae18b-3045-4f52-8293-5bfdd49dfbf4 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:02:57.231314 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e64ae18b-3045-4f52-8293-5bfdd49dfbf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:02:57.301096 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ae18b-3045-4f52-8293-5bfdd49dfbf4 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:02:57.306477 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e0c61-104c-41fd-98be-673a445f1d61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:02:57.307111 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e0c61-104c-41fd-98be-673a445f1d61 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:02:57.307389 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e0c61-104c-41fd-98be-673a445f1d61 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:02:57.307691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e0c61-104c-41fd-98be-673a445f1d61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:02:57.315779 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e0c61-104c-41fd-98be-673a445f1d61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:02:57.317351 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5e0c61-104c-41fd-98be-673a445f1d61 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:02:57.326042 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1330/2649] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:02:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 14:03:06.671163 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b16442-fdbd-4c4b-a43e-32a224c9c309 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:06.744383 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b16442-fdbd-4c4b-a43e-32a224c9c309 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:06.750864 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8250d-1fd7-43d7-82ff-5e2dad31024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:06.753313 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8250d-1fd7-43d7-82ff-5e2dad31024d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:06.753313 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8250d-1fd7-43d7-82ff-5e2dad31024d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:06.753313 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8250d-1fd7-43d7-82ff-5e2dad31024d admin admin] PATH_INFO: `/v3/users/ffc0b94e81b44896918d88518ab6df55` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:06.753911 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8250d-1fd7-43d7-82ff-5e2dad31024d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc0b94e81b44896918d88518ab6df55)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:06.755961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8250d-1fd7-43d7-82ff-5e2dad31024d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:06.827735 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f1e8250d-1fd7-43d7-82ff-5e2dad31024d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc0b94e81b44896918d88518ab6df55'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:06.844148 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f1e8250d-1fd7-43d7-82ff-5e2dad31024d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc0b94e81b44896918d88518ab6df55'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:06.852450 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f1e8250d-1fd7-43d7-82ff-5e2dad31024d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc0b94e81b44896918d88518ab6df55'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:06.853250 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f1e8250d-1fd7-43d7-82ff-5e2dad31024d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc0b94e81b44896918d88518ab6df55'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:06.854110 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f1e8250d-1fd7-43d7-82ff-5e2dad31024d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc0b94e81b44896918d88518ab6df55'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:06.884524 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1320/2650] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:03:06 2022] DELETE /identity/v3/users/ffc0b94e81b44896918d88518ab6df55 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:03:06.889208 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4692b5-79aa-473b-bd89-f94b10827dc5 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:06.890145 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4692b5-79aa-473b-bd89-f94b10827dc5 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:06.890424 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4692b5-79aa-473b-bd89-f94b10827dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:06.925772 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-5a4692b5-79aa-473b-bd89-f94b10827dc5 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:06.927756 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5a4692b5-79aa-473b-bd89-f94b10827dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:06.929540 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8250d-1fd7-43d7-82ff-5e2dad31024d admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:06.931076 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f1e8250d-1fd7-43d7-82ff-5e2dad31024d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:07.004395 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1331/2651] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:03:07.011365 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8250d-1fd7-43d7-82ff-5e2dad31024d admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:07.017601 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc514658-a12f-4677-88bd-dc5c64e9b565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:07.018571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc514658-a12f-4677-88bd-dc5c64e9b565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:07.018850 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc514658-a12f-4677-88bd-dc5c64e9b565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:07.019113 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc514658-a12f-4677-88bd-dc5c64e9b565 admin admin] PATH_INFO: `/v3/users/9956b3e79b5e40b2b27d096869906fb9` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:07.020619 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc514658-a12f-4677-88bd-dc5c64e9b565 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9956b3e79b5e40b2b27d096869906fb9)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:07.023193 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc514658-a12f-4677-88bd-dc5c64e9b565 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:07.046177 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4692b5-79aa-473b-bd89-f94b10827dc5 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:07.048845 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5a4692b5-79aa-473b-bd89-f94b10827dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:07.095328 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dc514658-a12f-4677-88bd-dc5c64e9b565 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9956b3e79b5e40b2b27d096869906fb9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:07.105381 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dc514658-a12f-4677-88bd-dc5c64e9b565 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9956b3e79b5e40b2b27d096869906fb9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:07.117264 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dc514658-a12f-4677-88bd-dc5c64e9b565 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9956b3e79b5e40b2b27d096869906fb9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:07.117982 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dc514658-a12f-4677-88bd-dc5c64e9b565 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9956b3e79b5e40b2b27d096869906fb9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:07.118761 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dc514658-a12f-4677-88bd-dc5c64e9b565 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9956b3e79b5e40b2b27d096869906fb9'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:07.132188 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4692b5-79aa-473b-bd89-f94b10827dc5 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:07.136184 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195f86a-6062-43d5-8bf4-e04855a4a4ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:07.136719 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195f86a-6062-43d5-8bf4-e04855a4a4ff service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:07.137000 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195f86a-6062-43d5-8bf4-e04855a4a4ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:07.137275 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195f86a-6062-43d5-8bf4-e04855a4a4ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:07.139335 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2195f86a-6062-43d5-8bf4-e04855a4a4ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:07.148437 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1321/2652] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:03:06 2022] DELETE /identity/v3/users/9956b3e79b5e40b2b27d096869906fb9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 14:03:07.152799 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656d223-eec2-42f5-9ec4-2f06693f8287 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:07.153164 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656d223-eec2-42f5-9ec4-2f06693f8287 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:07.153389 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656d223-eec2-42f5-9ec4-2f06693f8287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:07.154106 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195f86a-6062-43d5-8bf4-e04855a4a4ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:07.155819 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195f86a-6062-43d5-8bf4-e04855a4a4ff service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:07.167278 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1332/2653] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:03:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:03:07.172945 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-1656d223-eec2-42f5-9ec4-2f06693f8287 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:07.174781 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1656d223-eec2-42f5-9ec4-2f06693f8287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:07.234621 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1322/2654] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 14:03:07.244897 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195f86a-6062-43d5-8bf4-e04855a4a4ff service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:07.246387 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2195f86a-6062-43d5-8bf4-e04855a4a4ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:07.257620 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195f86a-6062-43d5-8bf4-e04855a4a4ff service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:07.309818 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60ccfd-6463-4b0b-b8be-dbd330771d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:07.310366 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60ccfd-6463-4b0b-b8be-dbd330771d2f service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:07.310644 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60ccfd-6463-4b0b-b8be-dbd330771d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:07.310917 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60ccfd-6463-4b0b-b8be-dbd330771d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:07.320275 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60ccfd-6463-4b0b-b8be-dbd330771d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:07.321937 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60ccfd-6463-4b0b-b8be-dbd330771d2f service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:07.334297 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1333/2655] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:03:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:03:07.604005 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656d223-eec2-42f5-9ec4-2f06693f8287 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:07.612925 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-1656d223-eec2-42f5-9ec4-2f06693f8287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:07.628802 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656d223-eec2-42f5-9ec4-2f06693f8287 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:07.634549 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf902292-42ff-403f-97d0-3a257758eb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:07.639203 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf902292-42ff-403f-97d0-3a257758eb14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:07.639565 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf902292-42ff-403f-97d0-3a257758eb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:07.641809 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf902292-42ff-403f-97d0-3a257758eb14 admin admin] PATH_INFO: `/v3/projects/8e0c39df8a6949878721e181a43c4643` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:07.643465 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf902292-42ff-403f-97d0-3a257758eb14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e0c39df8a6949878721e181a43c4643)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:07.646011 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf902292-42ff-403f-97d0-3a257758eb14 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:07.660074 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60ccfd-6463-4b0b-b8be-dbd330771d2f service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:07.661543 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-9e60ccfd-6463-4b0b-b8be-dbd330771d2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:07.682657 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60ccfd-6463-4b0b-b8be-dbd330771d2f service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:07.694052 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbe60f-ba35-451f-b8c9-83da9cbedca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:07.694980 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbe60f-ba35-451f-b8c9-83da9cbedca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:07.695451 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbe60f-ba35-451f-b8c9-83da9cbedca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:07.695834 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbe60f-ba35-451f-b8c9-83da9cbedca7 admin admin] PATH_INFO: `/v3/projects/f96fb0a6f9f0416ea509624c78a4c33f` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:07.697101 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbe60f-ba35-451f-b8c9-83da9cbedca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f96fb0a6f9f0416ea509624c78a4c33f)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:07.699161 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbe60f-ba35-451f-b8c9-83da9cbedca7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:07.707245 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-cf902292-42ff-403f-97d0-3a257758eb14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e0c39df8a6949878721e181a43c4643', 'request_id': 'req-cf902292-42ff-403f-97d0-3a257758eb14'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:07.715032 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-cf902292-42ff-403f-97d0-3a257758eb14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e0c39df8a6949878721e181a43c4643', 'request_id': 'req-cf902292-42ff-403f-97d0-3a257758eb14'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:07.721908 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-cf902292-42ff-403f-97d0-3a257758eb14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e0c39df8a6949878721e181a43c4643', 'request_id': 'req-cf902292-42ff-403f-97d0-3a257758eb14'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:07.733824 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-cf902292-42ff-403f-97d0-3a257758eb14 admin admin] The token cache is being invalidate because project 8e0c39df8a6949878721e181a43c4643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:03:07.734240 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-cf902292-42ff-403f-97d0-3a257758eb14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:07.734984 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-cf902292-42ff-403f-97d0-3a257758eb14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:07.737246 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1323/2656] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:03:07 2022] DELETE /identity/v3/projects/8e0c39df8a6949878721e181a43c4643 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 14:03:07.743287 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea7c32-b672-4719-90c4-7bdf921e9486 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:07.743672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea7c32-b672-4719-90c4-7bdf921e9486 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:07.743975 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea7c32-b672-4719-90c4-7bdf921e9486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:07.755738 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-dbdbe60f-ba35-451f-b8c9-83da9cbedca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f96fb0a6f9f0416ea509624c78a4c33f', 'request_id': 'req-dbdbe60f-ba35-451f-b8c9-83da9cbedca7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:07.762753 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-dbdbe60f-ba35-451f-b8c9-83da9cbedca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f96fb0a6f9f0416ea509624c78a4c33f', 'request_id': 'req-dbdbe60f-ba35-451f-b8c9-83da9cbedca7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:07.766540 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-edea7c32-b672-4719-90c4-7bdf921e9486 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:07.768033 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-edea7c32-b672-4719-90c4-7bdf921e9486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:07.769414 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-dbdbe60f-ba35-451f-b8c9-83da9cbedca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f96fb0a6f9f0416ea509624c78a4c33f', 'request_id': 'req-dbdbe60f-ba35-451f-b8c9-83da9cbedca7'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:07.791024 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-dbdbe60f-ba35-451f-b8c9-83da9cbedca7 admin admin] The token cache is being invalidate because project f96fb0a6f9f0416ea509624c78a4c33f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:03:07.791316 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-dbdbe60f-ba35-451f-b8c9-83da9cbedca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:07.792165 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-dbdbe60f-ba35-451f-b8c9-83da9cbedca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:07.796596 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1334/2657] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:03:07 2022] DELETE /identity/v3/projects/f96fb0a6f9f0416ea509624c78a4c33f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 14:03:07.802560 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02622425-34a3-442e-9fde-86a06b9327ea None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:07.803018 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02622425-34a3-442e-9fde-86a06b9327ea None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:07.803300 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02622425-34a3-442e-9fde-86a06b9327ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:07.823585 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-02622425-34a3-442e-9fde-86a06b9327ea None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:07.824986 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-02622425-34a3-442e-9fde-86a06b9327ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:07.839349 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1324/2658] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 14:03:07.847677 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700676e5-5442-447a-91c4-7c3da04bd975 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:07.847969 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700676e5-5442-447a-91c4-7c3da04bd975 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:07.848252 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700676e5-5442-447a-91c4-7c3da04bd975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:07.865893 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-700676e5-5442-447a-91c4-7c3da04bd975 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:07.867134 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-700676e5-5442-447a-91c4-7c3da04bd975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:07.875570 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1325/2659] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 14:03:07.879847 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700676e5-5442-447a-91c4-7c3da04bd975 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:07.884349 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1335/2660] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:03:07.889560 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700676e5-5442-447a-91c4-7c3da04bd975 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:07.891584 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee52b3-54bb-4255-bbda-371aa3f6cd91 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:07.892065 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee52b3-54bb-4255-bbda-371aa3f6cd91 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:07.892163 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee52b3-54bb-4255-bbda-371aa3f6cd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:07.895562 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8b7a9-2a97-4c2a-b9fb-d79317080d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:07.896258 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8b7a9-2a97-4c2a-b9fb-d79317080d96 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:07.896542 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8b7a9-2a97-4c2a-b9fb-d79317080d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:07.896817 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8b7a9-2a97-4c2a-b9fb-d79317080d96 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:07.897550 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8b7a9-2a97-4c2a-b9fb-d79317080d96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 14:03:07.897857 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8b7a9-2a97-4c2a-b9fb-d79317080d96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:07.899464 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8b7a9-2a97-4c2a-b9fb-d79317080d96 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:07.911331 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-f8ee52b3-54bb-4255-bbda-371aa3f6cd91 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:07.914919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1326/2661] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 14:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 14:03:07.915034 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f8ee52b3-54bb-4255-bbda-371aa3f6cd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:07.915660 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8b7a9-2a97-4c2a-b9fb-d79317080d96 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:07.922885 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1336/2662] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 14:03:07.924580 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee52b3-54bb-4255-bbda-371aa3f6cd91 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:07.925835 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8b7a9-2a97-4c2a-b9fb-d79317080d96 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:07.930504 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be06cea-bbe1-4eb9-9310-de16673101ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:07.931200 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be06cea-bbe1-4eb9-9310-de16673101ae admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:07.931489 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be06cea-bbe1-4eb9-9310-de16673101ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:07.931811 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be06cea-bbe1-4eb9-9310-de16673101ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:07.932524 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be06cea-bbe1-4eb9-9310-de16673101ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:07.933664 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee52b3-54bb-4255-bbda-371aa3f6cd91 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:07.934419 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be06cea-bbe1-4eb9-9310-de16673101ae admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:07.938289 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa66170-cc5d-4f63-9fa4-79d5b1a3f820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:07.938925 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa66170-cc5d-4f63-9fa4-79d5b1a3f820 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:07.939207 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa66170-cc5d-4f63-9fa4-79d5b1a3f820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:07.939484 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa66170-cc5d-4f63-9fa4-79d5b1a3f820 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:07.940301 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa66170-cc5d-4f63-9fa4-79d5b1a3f820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 14:03:07.940679 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa66170-cc5d-4f63-9fa4-79d5b1a3f820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:07.942265 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa66170-cc5d-4f63-9fa4-79d5b1a3f820 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:07.953760 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1337/2663] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 14:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 14:03:07.958542 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa66170-cc5d-4f63-9fa4-79d5b1a3f820 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:07.960296 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1327/2664] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:03:07 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 14:03:07.964524 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be06cea-bbe1-4eb9-9310-de16673101ae admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:07.969215 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa66170-cc5d-4f63-9fa4-79d5b1a3f820 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:08.024144 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be06cea-bbe1-4eb9-9310-de16673101ae admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:08.026332 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccb0dd-7c99-4dee-bcda-bc8ce0693a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:08.027017 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccb0dd-7c99-4dee-bcda-bc8ce0693a0e admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:08.027298 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccb0dd-7c99-4dee-bcda-bc8ce0693a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:08.027570 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccb0dd-7c99-4dee-bcda-bc8ce0693a0e admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:08.028276 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feccb0dd-7c99-4dee-bcda-bc8ce0693a0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:08.029218 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936720e9-bd37-40ae-a6ce-ee679574a4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:08.029951 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936720e9-bd37-40ae-a6ce-ee679574a4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:08.030165 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feccb0dd-7c99-4dee-bcda-bc8ce0693a0e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:08.030274 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936720e9-bd37-40ae-a6ce-ee679574a4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:08.030500 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936720e9-bd37-40ae-a6ce-ee679574a4c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:08.031189 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936720e9-bd37-40ae-a6ce-ee679574a4c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:08.033300 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936720e9-bd37-40ae-a6ce-ee679574a4c2 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:08.053959 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1328/2665] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:03:07 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 14:03:08.057891 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936720e9-bd37-40ae-a6ce-ee679574a4c2 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:08.058494 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1338/2666] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:03:07 2022] POST /identity/v3/projects => generated 389 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:03:08.062549 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccb0dd-7c99-4dee-bcda-bc8ce0693a0e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:08.069294 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936720e9-bd37-40ae-a6ce-ee679574a4c2 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:08.121373 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccb0dd-7c99-4dee-bcda-bc8ce0693a0e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:08.122687 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe66f0-fcb1-4629-8da4-5edb2ed07c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:08.123357 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe66f0-fcb1-4629-8da4-5edb2ed07c4d admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:08.123652 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe66f0-fcb1-4629-8da4-5edb2ed07c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:08.123943 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe66f0-fcb1-4629-8da4-5edb2ed07c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:08.124674 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe66f0-fcb1-4629-8da4-5edb2ed07c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:08.125888 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8188cfe-05ce-423d-bb22-acc1de37c1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:08.126269 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe66f0-fcb1-4629-8da4-5edb2ed07c4d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:08.126550 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8188cfe-05ce-423d-bb22-acc1de37c1ef admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:08.126837 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8188cfe-05ce-423d-bb22-acc1de37c1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:08.127146 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8188cfe-05ce-423d-bb22-acc1de37c1ef admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:08.127862 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8188cfe-05ce-423d-bb22-acc1de37c1ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:08.129776 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8188cfe-05ce-423d-bb22-acc1de37c1ef admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:08.135945 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1329/2667] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 14:03:08.139818 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe66f0-fcb1-4629-8da4-5edb2ed07c4d admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:08.150411 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe66f0-fcb1-4629-8da4-5edb2ed07c4d admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:08.150579 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1339/2668] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:03:08 2022] POST /identity/v3/users => generated 295 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 14:03:08.155516 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8188cfe-05ce-423d-bb22-acc1de37c1ef admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:08.155707 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fac24d-7662-4ee6-93c1-5d5427f1636e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:08.156214 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fac24d-7662-4ee6-93c1-5d5427f1636e admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:08.156500 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fac24d-7662-4ee6-93c1-5d5427f1636e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:08.156776 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fac24d-7662-4ee6-93c1-5d5427f1636e admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:08.157516 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fac24d-7662-4ee6-93c1-5d5427f1636e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:08.160176 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fac24d-7662-4ee6-93c1-5d5427f1636e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:08.168411 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8188cfe-05ce-423d-bb22-acc1de37c1ef admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:08.170118 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1330/2669] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:03:08.175775 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e817a4-d4b7-499a-8a48-a08f9e2560a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:08.175969 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fac24d-7662-4ee6-93c1-5d5427f1636e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:08.176913 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e817a4-d4b7-499a-8a48-a08f9e2560a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:08.177198 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e817a4-d4b7-499a-8a48-a08f9e2560a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:08.177474 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e817a4-d4b7-499a-8a48-a08f9e2560a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:08.178206 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e817a4-d4b7-499a-8a48-a08f9e2560a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:08.179823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e817a4-d4b7-499a-8a48-a08f9e2560a2 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:08.186074 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fac24d-7662-4ee6-93c1-5d5427f1636e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:08.191339 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6725d4-60b4-45df-a365-2aff1cb903f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:08.192088 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1340/2670] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 14:03:08.192380 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6725d4-60b4-45df-a365-2aff1cb903f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:08.192677 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6725d4-60b4-45df-a365-2aff1cb903f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:08.192957 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6725d4-60b4-45df-a365-2aff1cb903f9 admin admin] PATH_INFO: `/v3/projects/0de081cbde36497eb1c299850b745b7f/users/6b94dab3044e4ce58e202cfb334711f8/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:08.195525 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e817a4-d4b7-499a-8a48-a08f9e2560a2 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:08.205202 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e817a4-d4b7-499a-8a48-a08f9e2560a2 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:08.208219 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6725d4-60b4-45df-a365-2aff1cb903f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0de081cbde36497eb1c299850b745b7f, user_id=6b94dab3044e4ce58e202cfb334711f8, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:08.210320 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fb90d-bc58-4394-8d36-ad6479acbd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:08.210880 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6725d4-60b4-45df-a365-2aff1cb903f9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:08.210994 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fb90d-bc58-4394-8d36-ad6479acbd47 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:08.211234 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fb90d-bc58-4394-8d36-ad6479acbd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:08.211510 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fb90d-bc58-4394-8d36-ad6479acbd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:08.212269 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fb90d-bc58-4394-8d36-ad6479acbd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:08.214752 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fb90d-bc58-4394-8d36-ad6479acbd47 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:08.231263 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1341/2672] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 14:03:08.231476 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1331/2672] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:03:08 2022] PUT /identity/v3/projects/0de081cbde36497eb1c299850b745b7f/users/6b94dab3044e4ce58e202cfb334711f8/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:03:08.232183 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982ae62-2067-4846-817e-e4da8fddfb5f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:08.232380 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6725d4-60b4-45df-a365-2aff1cb903f9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:08.232513 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982ae62-2067-4846-817e-e4da8fddfb5f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:08.232822 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982ae62-2067-4846-817e-e4da8fddfb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:08.251908 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-c982ae62-2067-4846-817e-e4da8fddfb5f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:08.253610 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c982ae62-2067-4846-817e-e4da8fddfb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:08.298279 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6725d4-60b4-45df-a365-2aff1cb903f9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:08.303095 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2329ada-a3a9-4698-80cb-852023f87b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:08.304044 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2329ada-a3a9-4698-80cb-852023f87b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:08.304329 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2329ada-a3a9-4698-80cb-852023f87b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:08.304602 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2329ada-a3a9-4698-80cb-852023f87b37 admin admin] PATH_INFO: `/v3/projects/5f05b6375571464d8e706039dfb3f3a1/users/b734ab9dcc3945068bd78da1e67a9331/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:08.315475 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1342/2673] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:03:08.323335 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2329ada-a3a9-4698-80cb-852023f87b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f05b6375571464d8e706039dfb3f3a1, user_id=b734ab9dcc3945068bd78da1e67a9331, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:08.325333 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982ae62-2067-4846-817e-e4da8fddfb5f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:08.326165 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2329ada-a3a9-4698-80cb-852023f87b37 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:08.326653 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c982ae62-2067-4846-817e-e4da8fddfb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:08.340451 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1332/2674] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:03:08 2022] PUT /identity/v3/projects/5f05b6375571464d8e706039dfb3f3a1/users/b734ab9dcc3945068bd78da1e67a9331/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 14:03:08.350699 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e56ff3-eb2b-4d95-97ef-2004c6d0f3cf None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:08.350987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e56ff3-eb2b-4d95-97ef-2004c6d0f3cf None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:08.351267 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e56ff3-eb2b-4d95-97ef-2004c6d0f3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:08.378328 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c5e56ff3-eb2b-4d95-97ef-2004c6d0f3cf None None] MFA Rules not processed for user `b734ab9dcc3945068bd78da1e67a9331`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:08.379552 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c5e56ff3-eb2b-4d95-97ef-2004c6d0f3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:08.390255 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982ae62-2067-4846-817e-e4da8fddfb5f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:08.442526 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26de6a-f37f-4e11-8dc1-6de2fa77dfe7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:08.442526 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26de6a-f37f-4e11-8dc1-6de2fa77dfe7 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:08.442526 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26de6a-f37f-4e11-8dc1-6de2fa77dfe7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:08.442937 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26de6a-f37f-4e11-8dc1-6de2fa77dfe7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:08.450362 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1333/2675] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 14:03:08.470935 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e56ff3-eb2b-4d95-97ef-2004c6d0f3cf None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:08.472500 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c5e56ff3-eb2b-4d95-97ef-2004c6d0f3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:08.513327 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26de6a-f37f-4e11-8dc1-6de2fa77dfe7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:08.515497 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26de6a-f37f-4e11-8dc1-6de2fa77dfe7 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:08.531072 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1343/2676] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 14:03:08.533705 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e56ff3-eb2b-4d95-97ef-2004c6d0f3cf None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:08.538050 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb2be4-100b-4be5-8d14-a5822695a69e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:08.538712 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb2be4-100b-4be5-8d14-a5822695a69e service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:08.538997 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb2be4-100b-4be5-8d14-a5822695a69e service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:08.539274 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb2be4-100b-4be5-8d14-a5822695a69e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:08.547967 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb2be4-100b-4be5-8d14-a5822695a69e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:08.549712 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb2be4-100b-4be5-8d14-a5822695a69e service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:08.559812 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1334/2677] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:03:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:03:09.359113 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f4ae4-19fe-46b9-8c70-90805e88ef44 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:09.359693 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f4ae4-19fe-46b9-8c70-90805e88ef44 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:09.359693 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f4ae4-19fe-46b9-8c70-90805e88ef44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:09.392253 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-7c9f4ae4-19fe-46b9-8c70-90805e88ef44 None None] MFA Rules not processed for user `6b94dab3044e4ce58e202cfb334711f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:09.394184 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7c9f4ae4-19fe-46b9-8c70-90805e88ef44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:09.463852 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1344/2678] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 14:03:09.468443 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb2be4-100b-4be5-8d14-a5822695a69e service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:09.480393 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb2be4-100b-4be5-8d14-a5822695a69e service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:09.485086 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688fac4-c591-44a6-be21-bf4b6157976d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:09.485743 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688fac4-c591-44a6-be21-bf4b6157976d admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:09.486026 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688fac4-c591-44a6-be21-bf4b6157976d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:09.486301 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688fac4-c591-44a6-be21-bf4b6157976d admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:09.487022 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688fac4-c591-44a6-be21-bf4b6157976d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:09.489422 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688fac4-c591-44a6-be21-bf4b6157976d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:09.518384 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1335/2679] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:03:09 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:03:09.520101 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f4ae4-19fe-46b9-8c70-90805e88ef44 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:09.530819 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f4ae4-19fe-46b9-8c70-90805e88ef44 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:09.586417 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd87deb-83b4-4e26-8c6f-cfae6e17529a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:09.587088 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd87deb-83b4-4e26-8c6f-cfae6e17529a admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:09.587373 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd87deb-83b4-4e26-8c6f-cfae6e17529a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:09.587681 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd87deb-83b4-4e26-8c6f-cfae6e17529a admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:09.588381 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd87deb-83b4-4e26-8c6f-cfae6e17529a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:09.590306 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd87deb-83b4-4e26-8c6f-cfae6e17529a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:09.611720 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1345/2680] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:03:09 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:03:09.615580 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688fac4-c591-44a6-be21-bf4b6157976d admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:09.626036 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688fac4-c591-44a6-be21-bf4b6157976d admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:09.630934 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99611a4c-e8c3-435a-be3b-f2abdc9228a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:09.631590 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99611a4c-e8c3-435a-be3b-f2abdc9228a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:09.631915 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99611a4c-e8c3-435a-be3b-f2abdc9228a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:09.632192 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99611a4c-e8c3-435a-be3b-f2abdc9228a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:09.632927 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99611a4c-e8c3-435a-be3b-f2abdc9228a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:09.634520 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99611a4c-e8c3-435a-be3b-f2abdc9228a6 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:09.645833 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1336/2681] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:03:09.649918 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd87deb-83b4-4e26-8c6f-cfae6e17529a admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:09.660361 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd87deb-83b4-4e26-8c6f-cfae6e17529a admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:09.664940 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63577de4-2884-40e8-9fc8-841204dffe03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:09.665809 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63577de4-2884-40e8-9fc8-841204dffe03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:09.666083 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63577de4-2884-40e8-9fc8-841204dffe03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:09.666352 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63577de4-2884-40e8-9fc8-841204dffe03 admin admin] PATH_INFO: `/v3/projects/1a47c62f379f4a1e9465ad711e59f14f/users/e5349b242ecf499895553f0f643fbf82/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:09.680449 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63577de4-2884-40e8-9fc8-841204dffe03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a47c62f379f4a1e9465ad711e59f14f, user_id=e5349b242ecf499895553f0f643fbf82, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:09.683105 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63577de4-2884-40e8-9fc8-841204dffe03 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:09.696286 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1346/2682] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:03:09 2022] PUT /identity/v3/projects/1a47c62f379f4a1e9465ad711e59f14f/users/e5349b242ecf499895553f0f643fbf82/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:03:09.700287 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99611a4c-e8c3-435a-be3b-f2abdc9228a6 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:09.710193 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99611a4c-e8c3-435a-be3b-f2abdc9228a6 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:09.764587 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143736e-e2c9-48b4-9e4b-19e67513d8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:09.765355 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143736e-e2c9-48b4-9e4b-19e67513d8ea admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:09.765598 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143736e-e2c9-48b4-9e4b-19e67513d8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:09.765923 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143736e-e2c9-48b4-9e4b-19e67513d8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:09.766762 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143736e-e2c9-48b4-9e4b-19e67513d8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:09.768438 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143736e-e2c9-48b4-9e4b-19e67513d8ea admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:09.778276 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1337/2683] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:03:09.782509 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63577de4-2884-40e8-9fc8-841204dffe03 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:09.793029 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63577de4-2884-40e8-9fc8-841204dffe03 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:09.797575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c94dda-6d00-4b63-9e5e-42f7bc374306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:09.798455 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c94dda-6d00-4b63-9e5e-42f7bc374306 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:09.798730 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c94dda-6d00-4b63-9e5e-42f7bc374306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:09.799580 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c94dda-6d00-4b63-9e5e-42f7bc374306 admin admin] PATH_INFO: `/v3/projects/1a47c62f379f4a1e9465ad711e59f14f/users/e5349b242ecf499895553f0f643fbf82/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:09.801557 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c94dda-6d00-4b63-9e5e-42f7bc374306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a47c62f379f4a1e9465ad711e59f14f, user_id=e5349b242ecf499895553f0f643fbf82, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:09.804313 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c94dda-6d00-4b63-9e5e-42f7bc374306 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:09.814468 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1347/2684] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:03:09 2022] PUT /identity/v3/projects/1a47c62f379f4a1e9465ad711e59f14f/users/e5349b242ecf499895553f0f643fbf82/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:03:10.473406 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16181f2b-22fe-4390-acdb-9065e193599b None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:10.473977 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16181f2b-22fe-4390-acdb-9065e193599b None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:10.474112 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16181f2b-22fe-4390-acdb-9065e193599b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:10.506246 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-16181f2b-22fe-4390-acdb-9065e193599b None None] MFA Rules not processed for user `e5349b242ecf499895553f0f643fbf82`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:10.508028 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-16181f2b-22fe-4390-acdb-9065e193599b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:10.577009 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1338/2685] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:03:10.589113 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c94dda-6d00-4b63-9e5e-42f7bc374306 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:10.645180 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c94dda-6d00-4b63-9e5e-42f7bc374306 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:10.649016 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32885d20-6ef7-4fbe-87ab-63ca7b278d36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:10.649664 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32885d20-6ef7-4fbe-87ab-63ca7b278d36 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:10.649948 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32885d20-6ef7-4fbe-87ab-63ca7b278d36 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:10.650225 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32885d20-6ef7-4fbe-87ab-63ca7b278d36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:10.704165 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32885d20-6ef7-4fbe-87ab-63ca7b278d36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:10.705688 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32885d20-6ef7-4fbe-87ab-63ca7b278d36 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:10.714368 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1348/2686] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:03:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:03:13.096248 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16181f2b-22fe-4390-acdb-9065e193599b None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:13.105976 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16181f2b-22fe-4390-acdb-9065e193599b None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:13.109725 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a050e-c628-485a-acb8-2e22064dfcec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:13.110468 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a050e-c628-485a-acb8-2e22064dfcec service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:13.110847 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a050e-c628-485a-acb8-2e22064dfcec service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:13.111199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a050e-c628-485a-acb8-2e22064dfcec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:13.120552 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a050e-c628-485a-acb8-2e22064dfcec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:13.121994 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a050e-c628-485a-acb8-2e22064dfcec service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:13.131667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1339/2687] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:03:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:03:19.122415 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aee8f5-1194-49bd-afa4-4dd963d2f907 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:19.122925 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aee8f5-1194-49bd-afa4-4dd963d2f907 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:19.123036 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aee8f5-1194-49bd-afa4-4dd963d2f907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:19.140446 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-68aee8f5-1194-49bd-afa4-4dd963d2f907 None None] MFA Rules not processed for user `2cbcdc40fea745f48e1dfc62a732b7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:19.141641 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-68aee8f5-1194-49bd-afa4-4dd963d2f907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:19.195973 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1349/2688] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:03:24.791366 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a050e-c628-485a-acb8-2e22064dfcec service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:24.855696 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a050e-c628-485a-acb8-2e22064dfcec service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:24.860332 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6621b80-3693-42de-b182-153fe70a9f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:24.861209 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6621b80-3693-42de-b182-153fe70a9f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:24.861484 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6621b80-3693-42de-b182-153fe70a9f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:24.861754 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6621b80-3693-42de-b182-153fe70a9f37 admin admin] PATH_INFO: `/v3/users/b734ab9dcc3945068bd78da1e67a9331` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:24.862946 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6621b80-3693-42de-b182-153fe70a9f37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b734ab9dcc3945068bd78da1e67a9331)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:24.864959 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6621b80-3693-42de-b182-153fe70a9f37 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:24.910301 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f6621b80-3693-42de-b182-153fe70a9f37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b734ab9dcc3945068bd78da1e67a9331'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:24.916836 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f6621b80-3693-42de-b182-153fe70a9f37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b734ab9dcc3945068bd78da1e67a9331'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:24.924281 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f6621b80-3693-42de-b182-153fe70a9f37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b734ab9dcc3945068bd78da1e67a9331'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:24.924892 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f6621b80-3693-42de-b182-153fe70a9f37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b734ab9dcc3945068bd78da1e67a9331'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:24.925496 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f6621b80-3693-42de-b182-153fe70a9f37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b734ab9dcc3945068bd78da1e67a9331'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:24.942982 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1340/2689] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:03:24 2022] DELETE /identity/v3/users/b734ab9dcc3945068bd78da1e67a9331 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:03:24.947487 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df77ba-c4a4-4110-a263-2d0db7415cda None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:24.948023 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df77ba-c4a4-4110-a263-2d0db7415cda None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:24.948125 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df77ba-c4a4-4110-a263-2d0db7415cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:24.965812 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-32df77ba-c4a4-4110-a263-2d0db7415cda None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:24.967004 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-32df77ba-c4a4-4110-a263-2d0db7415cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:25.026040 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1350/2690] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:03:25.036271 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6621b80-3693-42de-b182-153fe70a9f37 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:25.037858 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f6621b80-3693-42de-b182-153fe70a9f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:25.093349 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6621b80-3693-42de-b182-153fe70a9f37 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:25.097612 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04a39a-b796-4691-99b9-b471457696f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:25.098250 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04a39a-b796-4691-99b9-b471457696f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:25.098531 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04a39a-b796-4691-99b9-b471457696f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:25.098803 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04a39a-b796-4691-99b9-b471457696f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:25.107544 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04a39a-b796-4691-99b9-b471457696f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:25.109065 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04a39a-b796-4691-99b9-b471457696f8 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:25.118322 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1341/2691] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:03:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 14:03:25.385948 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df77ba-c4a4-4110-a263-2d0db7415cda None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:25.387618 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-32df77ba-c4a4-4110-a263-2d0db7415cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:25.409093 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df77ba-c4a4-4110-a263-2d0db7415cda None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:25.429026 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594b04f-5d5b-4640-a09d-4fa4579fccb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:25.430233 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594b04f-5d5b-4640-a09d-4fa4579fccb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:25.430599 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594b04f-5d5b-4640-a09d-4fa4579fccb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:25.430931 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594b04f-5d5b-4640-a09d-4fa4579fccb5 admin admin] PATH_INFO: `/v3/projects/5f05b6375571464d8e706039dfb3f3a1` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:25.432671 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594b04f-5d5b-4640-a09d-4fa4579fccb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f05b6375571464d8e706039dfb3f3a1)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:25.435083 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594b04f-5d5b-4640-a09d-4fa4579fccb5 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:25.498286 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c594b04f-5d5b-4640-a09d-4fa4579fccb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f05b6375571464d8e706039dfb3f3a1', 'request_id': 'req-c594b04f-5d5b-4640-a09d-4fa4579fccb5'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:25.504867 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c594b04f-5d5b-4640-a09d-4fa4579fccb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f05b6375571464d8e706039dfb3f3a1', 'request_id': 'req-c594b04f-5d5b-4640-a09d-4fa4579fccb5'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:25.510071 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c594b04f-5d5b-4640-a09d-4fa4579fccb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f05b6375571464d8e706039dfb3f3a1', 'request_id': 'req-c594b04f-5d5b-4640-a09d-4fa4579fccb5'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:25.523603 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c594b04f-5d5b-4640-a09d-4fa4579fccb5 admin admin] The token cache is being invalidate because project 5f05b6375571464d8e706039dfb3f3a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:03:25.523924 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c594b04f-5d5b-4640-a09d-4fa4579fccb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:25.524553 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c594b04f-5d5b-4640-a09d-4fa4579fccb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:25.526746 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1351/2692] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:03:25 2022] DELETE /identity/v3/projects/5f05b6375571464d8e706039dfb3f3a1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:03:29.217772 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04a39a-b796-4691-99b9-b471457696f8 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:29.219451 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6e04a39a-b796-4691-99b9-b471457696f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:29.231878 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04a39a-b796-4691-99b9-b471457696f8 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:29.288627 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd16e40-3acc-4cfb-9bcd-a3de016bad4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:29.289521 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd16e40-3acc-4cfb-9bcd-a3de016bad4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:29.289807 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd16e40-3acc-4cfb-9bcd-a3de016bad4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:29.290086 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd16e40-3acc-4cfb-9bcd-a3de016bad4a admin admin] PATH_INFO: `/v3/users/6b94dab3044e4ce58e202cfb334711f8` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:29.291459 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd16e40-3acc-4cfb-9bcd-a3de016bad4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b94dab3044e4ce58e202cfb334711f8)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:29.293415 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd16e40-3acc-4cfb-9bcd-a3de016bad4a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:29.341066 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-efd16e40-3acc-4cfb-9bcd-a3de016bad4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b94dab3044e4ce58e202cfb334711f8'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:29.348602 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-efd16e40-3acc-4cfb-9bcd-a3de016bad4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b94dab3044e4ce58e202cfb334711f8'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:29.356199 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-efd16e40-3acc-4cfb-9bcd-a3de016bad4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b94dab3044e4ce58e202cfb334711f8'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:29.356870 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-efd16e40-3acc-4cfb-9bcd-a3de016bad4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b94dab3044e4ce58e202cfb334711f8'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:29.357491 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-efd16e40-3acc-4cfb-9bcd-a3de016bad4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b94dab3044e4ce58e202cfb334711f8'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:29.374972 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1342/2693] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:03:29 2022] DELETE /identity/v3/users/6b94dab3044e4ce58e202cfb334711f8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:03:29.545764 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594b04f-5d5b-4640-a09d-4fa4579fccb5 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:29.548504 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-c594b04f-5d5b-4640-a09d-4fa4579fccb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:29.561327 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594b04f-5d5b-4640-a09d-4fa4579fccb5 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:29.622505 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8bb3a-d151-4216-99dd-3d1a70c8a5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:29.623368 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8bb3a-d151-4216-99dd-3d1a70c8a5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:29.623671 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8bb3a-d151-4216-99dd-3d1a70c8a5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:29.623951 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8bb3a-d151-4216-99dd-3d1a70c8a5f4 admin admin] PATH_INFO: `/v3/projects/0de081cbde36497eb1c299850b745b7f` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:29.625135 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8bb3a-d151-4216-99dd-3d1a70c8a5f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0de081cbde36497eb1c299850b745b7f)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:29.627165 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8bb3a-d151-4216-99dd-3d1a70c8a5f4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:29.672843 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b0d8bb3a-d151-4216-99dd-3d1a70c8a5f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0de081cbde36497eb1c299850b745b7f', 'request_id': 'req-b0d8bb3a-d151-4216-99dd-3d1a70c8a5f4'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:29.679020 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b0d8bb3a-d151-4216-99dd-3d1a70c8a5f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0de081cbde36497eb1c299850b745b7f', 'request_id': 'req-b0d8bb3a-d151-4216-99dd-3d1a70c8a5f4'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:29.684516 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b0d8bb3a-d151-4216-99dd-3d1a70c8a5f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0de081cbde36497eb1c299850b745b7f', 'request_id': 'req-b0d8bb3a-d151-4216-99dd-3d1a70c8a5f4'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:29.696896 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b0d8bb3a-d151-4216-99dd-3d1a70c8a5f4 admin admin] The token cache is being invalidate because project 0de081cbde36497eb1c299850b745b7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:03:29.697184 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b0d8bb3a-d151-4216-99dd-3d1a70c8a5f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:29.697806 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b0d8bb3a-d151-4216-99dd-3d1a70c8a5f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:29.699372 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1352/2694] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:03:29 2022] DELETE /identity/v3/projects/0de081cbde36497eb1c299850b745b7f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:03:29.704126 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd16e40-3acc-4cfb-9bcd-a3de016bad4a admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:29.706255 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-efd16e40-3acc-4cfb-9bcd-a3de016bad4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:29.718699 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd16e40-3acc-4cfb-9bcd-a3de016bad4a admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:29.774691 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b39b9-31ab-454c-8b11-413d9cd95f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:29.775781 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b39b9-31ab-454c-8b11-413d9cd95f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:29.776071 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b39b9-31ab-454c-8b11-413d9cd95f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:29.776340 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b39b9-31ab-454c-8b11-413d9cd95f3a admin admin] PATH_INFO: `/v3/users/e5349b242ecf499895553f0f643fbf82` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:29.777534 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b39b9-31ab-454c-8b11-413d9cd95f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5349b242ecf499895553f0f643fbf82)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:29.779490 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b39b9-31ab-454c-8b11-413d9cd95f3a admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:29.825670 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-220b39b9-31ab-454c-8b11-413d9cd95f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5349b242ecf499895553f0f643fbf82'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:29.832791 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-220b39b9-31ab-454c-8b11-413d9cd95f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5349b242ecf499895553f0f643fbf82'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:29.842044 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-220b39b9-31ab-454c-8b11-413d9cd95f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5349b242ecf499895553f0f643fbf82'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:29.843033 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-220b39b9-31ab-454c-8b11-413d9cd95f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5349b242ecf499895553f0f643fbf82'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:29.843739 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-220b39b9-31ab-454c-8b11-413d9cd95f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5349b242ecf499895553f0f643fbf82'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:29.862863 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1343/2695] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:03:29 2022] DELETE /identity/v3/users/e5349b242ecf499895553f0f643fbf82 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:03:30.045343 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8bb3a-d151-4216-99dd-3d1a70c8a5f4 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:30.046964 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b0d8bb3a-d151-4216-99dd-3d1a70c8a5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:30.064993 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8bb3a-d151-4216-99dd-3d1a70c8a5f4 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:30.123464 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90039a3-6f4f-4bd2-8c09-a027934cab1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:30.124358 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90039a3-6f4f-4bd2-8c09-a027934cab1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:30.124656 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90039a3-6f4f-4bd2-8c09-a027934cab1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:30.124912 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90039a3-6f4f-4bd2-8c09-a027934cab1a admin admin] PATH_INFO: `/v3/projects/1a47c62f379f4a1e9465ad711e59f14f` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:30.126944 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90039a3-6f4f-4bd2-8c09-a027934cab1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a47c62f379f4a1e9465ad711e59f14f)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:30.128890 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90039a3-6f4f-4bd2-8c09-a027934cab1a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:30.180072 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b90039a3-6f4f-4bd2-8c09-a027934cab1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a47c62f379f4a1e9465ad711e59f14f', 'request_id': 'req-b90039a3-6f4f-4bd2-8c09-a027934cab1a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:30.186073 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b90039a3-6f4f-4bd2-8c09-a027934cab1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a47c62f379f4a1e9465ad711e59f14f', 'request_id': 'req-b90039a3-6f4f-4bd2-8c09-a027934cab1a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:30.192778 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b90039a3-6f4f-4bd2-8c09-a027934cab1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a47c62f379f4a1e9465ad711e59f14f', 'request_id': 'req-b90039a3-6f4f-4bd2-8c09-a027934cab1a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:30.206482 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b90039a3-6f4f-4bd2-8c09-a027934cab1a admin admin] The token cache is being invalidate because project 1a47c62f379f4a1e9465ad711e59f14f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:03:30.206766 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b90039a3-6f4f-4bd2-8c09-a027934cab1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:30.207387 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-b90039a3-6f4f-4bd2-8c09-a027934cab1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:30.209109 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1353/2696] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:03:30 2022] DELETE /identity/v3/projects/1a47c62f379f4a1e9465ad711e59f14f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:03:30.213914 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236ee1d-5d2d-442b-8496-4e652781f875 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:30.214268 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236ee1d-5d2d-442b-8496-4e652781f875 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:30.214608 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236ee1d-5d2d-442b-8496-4e652781f875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:30.231912 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-2236ee1d-5d2d-442b-8496-4e652781f875 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:30.233297 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2236ee1d-5d2d-442b-8496-4e652781f875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:30.293175 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1344/2697] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:03:30.301799 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7b5a8-ffec-46ba-8a38-ba4f92cd4e58 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:30.302094 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7b5a8-ffec-46ba-8a38-ba4f92cd4e58 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:30.302382 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7b5a8-ffec-46ba-8a38-ba4f92cd4e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:30.321892 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-dbb7b5a8-ffec-46ba-8a38-ba4f92cd4e58 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:30.323095 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-dbb7b5a8-ffec-46ba-8a38-ba4f92cd4e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:30.332708 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1354/2698] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:03:30.337923 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236ee1d-5d2d-442b-8496-4e652781f875 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:30.348128 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236ee1d-5d2d-442b-8496-4e652781f875 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:30.352738 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd190fa6-e6e1-4bea-802d-0fe61da6f995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:30.353403 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd190fa6-e6e1-4bea-802d-0fe61da6f995 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:30.353716 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd190fa6-e6e1-4bea-802d-0fe61da6f995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:30.353997 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd190fa6-e6e1-4bea-802d-0fe61da6f995 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:30.354725 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd190fa6-e6e1-4bea-802d-0fe61da6f995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 14:03:30.355036 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd190fa6-e6e1-4bea-802d-0fe61da6f995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:30.356689 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd190fa6-e6e1-4bea-802d-0fe61da6f995 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:30.368722 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1345/2699] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 14:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 14:03:30.373326 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7b5a8-ffec-46ba-8a38-ba4f92cd4e58 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:30.383515 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7b5a8-ffec-46ba-8a38-ba4f92cd4e58 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:30.388410 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46e970-edbc-43a3-9e99-ef4a7c0f6aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:30.389143 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46e970-edbc-43a3-9e99-ef4a7c0f6aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:30.389497 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46e970-edbc-43a3-9e99-ef4a7c0f6aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:30.389846 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46e970-edbc-43a3-9e99-ef4a7c0f6aa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:30.390611 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46e970-edbc-43a3-9e99-ef4a7c0f6aa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:30.392694 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46e970-edbc-43a3-9e99-ef4a7c0f6aa3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:30.426670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1355/2700] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:03:30 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 14:03:30.427835 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd190fa6-e6e1-4bea-802d-0fe61da6f995 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:30.440950 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd190fa6-e6e1-4bea-802d-0fe61da6f995 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:30.494960 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3db2c-5379-4a1d-bbf6-9e22c3bc64b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:30.495690 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3db2c-5379-4a1d-bbf6-9e22c3bc64b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:30.496051 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3db2c-5379-4a1d-bbf6-9e22c3bc64b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:30.496327 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3db2c-5379-4a1d-bbf6-9e22c3bc64b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:30.497024 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac3db2c-5379-4a1d-bbf6-9e22c3bc64b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:30.498924 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac3db2c-5379-4a1d-bbf6-9e22c3bc64b9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:30.518888 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1346/2701] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:03:30 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 14:03:30.523071 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46e970-edbc-43a3-9e99-ef4a7c0f6aa3 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:30.533669 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46e970-edbc-43a3-9e99-ef4a7c0f6aa3 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:30.538511 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cfbc2-111d-450e-869d-6f9335047347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:30.539255 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cfbc2-111d-450e-869d-6f9335047347 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:30.539605 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cfbc2-111d-450e-869d-6f9335047347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:30.539979 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cfbc2-111d-450e-869d-6f9335047347 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:30.540797 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cfbc2-111d-450e-869d-6f9335047347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:30.542495 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cfbc2-111d-450e-869d-6f9335047347 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:30.557423 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1356/2702] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:03:30.558765 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3db2c-5379-4a1d-bbf6-9e22c3bc64b9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:30.569404 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3db2c-5379-4a1d-bbf6-9e22c3bc64b9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:30.574242 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf53a1-14a0-4cd9-8eb4-74c7f5a51b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:30.574910 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf53a1-14a0-4cd9-8eb4-74c7f5a51b8f admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:30.575304 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf53a1-14a0-4cd9-8eb4-74c7f5a51b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:30.575459 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf53a1-14a0-4cd9-8eb4-74c7f5a51b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:30.576233 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf53a1-14a0-4cd9-8eb4-74c7f5a51b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:30.577869 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf53a1-14a0-4cd9-8eb4-74c7f5a51b8f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:30.592077 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1347/2703] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:03:30.593358 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cfbc2-111d-450e-869d-6f9335047347 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:30.604249 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cfbc2-111d-450e-869d-6f9335047347 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:30.616830 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9607a1-16b6-4dde-be66-3aa9269fb035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:30.618273 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9607a1-16b6-4dde-be66-3aa9269fb035 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:30.618867 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9607a1-16b6-4dde-be66-3aa9269fb035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:30.619498 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9607a1-16b6-4dde-be66-3aa9269fb035 admin admin] PATH_INFO: `/v3/projects/de32d6b23a1b4c938a90d6129628544a/users/65a4790cbcf446f3b3f5a4e1d72e89e5/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:30.636573 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9607a1-16b6-4dde-be66-3aa9269fb035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de32d6b23a1b4c938a90d6129628544a, user_id=65a4790cbcf446f3b3f5a4e1d72e89e5, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:30.639394 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9607a1-16b6-4dde-be66-3aa9269fb035 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:30.654982 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1357/2704] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:03:30 2022] PUT /identity/v3/projects/de32d6b23a1b4c938a90d6129628544a/users/65a4790cbcf446f3b3f5a4e1d72e89e5/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:03:30.665895 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844fbd5-4df5-452c-a227-da30aa0c2f30 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:30.666449 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844fbd5-4df5-452c-a227-da30aa0c2f30 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:30.666725 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0844fbd5-4df5-452c-a227-da30aa0c2f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:30.694268 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-0844fbd5-4df5-452c-a227-da30aa0c2f30 None None] MFA Rules not processed for user `65a4790cbcf446f3b3f5a4e1d72e89e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:30.695496 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-0844fbd5-4df5-452c-a227-da30aa0c2f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:30.760997 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1348/2705] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:03:30.772639 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9607a1-16b6-4dde-be66-3aa9269fb035 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:30.774521 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6d9607a1-16b6-4dde-be66-3aa9269fb035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:30.833890 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9607a1-16b6-4dde-be66-3aa9269fb035 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:30.837686 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3ba3a-3f0e-482f-96ce-d0452ab50a93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:30.838345 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3ba3a-3f0e-482f-96ce-d0452ab50a93 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:30.838633 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3ba3a-3f0e-482f-96ce-d0452ab50a93 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:30.838908 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3ba3a-3f0e-482f-96ce-d0452ab50a93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:30.848338 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3ba3a-3f0e-482f-96ce-d0452ab50a93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:30.849791 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3ba3a-3f0e-482f-96ce-d0452ab50a93 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:30.860583 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1358/2706] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:03:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:03:30.879237 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844fbd5-4df5-452c-a227-da30aa0c2f30 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:30.944305 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0844fbd5-4df5-452c-a227-da30aa0c2f30 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:30.949498 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e99f8-ddc3-463f-86b6-9750fb3cfd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:30.950381 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e99f8-ddc3-463f-86b6-9750fb3cfd95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:30.950666 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e99f8-ddc3-463f-86b6-9750fb3cfd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:30.950943 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e99f8-ddc3-463f-86b6-9750fb3cfd95 admin admin] PATH_INFO: `/v3/users/65a4790cbcf446f3b3f5a4e1d72e89e5` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:30.952177 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e99f8-ddc3-463f-86b6-9750fb3cfd95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a4790cbcf446f3b3f5a4e1d72e89e5)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:30.954502 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e99f8-ddc3-463f-86b6-9750fb3cfd95 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:31.003660 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-850e99f8-ddc3-463f-86b6-9750fb3cfd95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a4790cbcf446f3b3f5a4e1d72e89e5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:31.010465 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-850e99f8-ddc3-463f-86b6-9750fb3cfd95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a4790cbcf446f3b3f5a4e1d72e89e5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:31.019548 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-850e99f8-ddc3-463f-86b6-9750fb3cfd95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a4790cbcf446f3b3f5a4e1d72e89e5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:31.020253 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-850e99f8-ddc3-463f-86b6-9750fb3cfd95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a4790cbcf446f3b3f5a4e1d72e89e5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:31.020993 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-850e99f8-ddc3-463f-86b6-9750fb3cfd95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a4790cbcf446f3b3f5a4e1d72e89e5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:31.040656 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1349/2707] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:03:30 2022] DELETE /identity/v3/users/65a4790cbcf446f3b3f5a4e1d72e89e5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:03:31.044929 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b6327-1639-4921-bff0-2b0c4c1669c3 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:31.045225 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b6327-1639-4921-bff0-2b0c4c1669c3 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:31.045511 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b6327-1639-4921-bff0-2b0c4c1669c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:31.064702 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-382b6327-1639-4921-bff0-2b0c4c1669c3 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:31.065974 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-382b6327-1639-4921-bff0-2b0c4c1669c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:31.132447 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1359/2708] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:03:31.143012 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e99f8-ddc3-463f-86b6-9750fb3cfd95 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:31.144713 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-850e99f8-ddc3-463f-86b6-9750fb3cfd95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:31.205221 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e99f8-ddc3-463f-86b6-9750fb3cfd95 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:31.210800 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f294f-e9bd-40de-ad03-0d2cce80621e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:31.212093 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f294f-e9bd-40de-ad03-0d2cce80621e service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:31.212677 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f294f-e9bd-40de-ad03-0d2cce80621e service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:31.213166 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f294f-e9bd-40de-ad03-0d2cce80621e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:31.223558 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f294f-e9bd-40de-ad03-0d2cce80621e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:31.225045 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f294f-e9bd-40de-ad03-0d2cce80621e service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:31.235817 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1350/2709] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:03:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:03:31.506590 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b6327-1639-4921-bff0-2b0c4c1669c3 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:31.508135 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-382b6327-1639-4921-bff0-2b0c4c1669c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:31.521558 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b6327-1639-4921-bff0-2b0c4c1669c3 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:31.527028 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f3e6b-9708-4493-8d13-14a05df06761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:31.527987 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f3e6b-9708-4493-8d13-14a05df06761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:31.528315 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f3e6b-9708-4493-8d13-14a05df06761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:31.528550 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f3e6b-9708-4493-8d13-14a05df06761 admin admin] PATH_INFO: `/v3/projects/de32d6b23a1b4c938a90d6129628544a` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:31.529768 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f3e6b-9708-4493-8d13-14a05df06761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de32d6b23a1b4c938a90d6129628544a)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:31.532445 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f3e6b-9708-4493-8d13-14a05df06761 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:31.579791 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1c7f3e6b-9708-4493-8d13-14a05df06761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de32d6b23a1b4c938a90d6129628544a', 'request_id': 'req-1c7f3e6b-9708-4493-8d13-14a05df06761'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:31.585624 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1c7f3e6b-9708-4493-8d13-14a05df06761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de32d6b23a1b4c938a90d6129628544a', 'request_id': 'req-1c7f3e6b-9708-4493-8d13-14a05df06761'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:31.591173 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1c7f3e6b-9708-4493-8d13-14a05df06761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de32d6b23a1b4c938a90d6129628544a', 'request_id': 'req-1c7f3e6b-9708-4493-8d13-14a05df06761'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:31.604762 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1c7f3e6b-9708-4493-8d13-14a05df06761 admin admin] The token cache is being invalidate because project de32d6b23a1b4c938a90d6129628544a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:03:31.605056 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1c7f3e6b-9708-4493-8d13-14a05df06761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:31.605685 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1c7f3e6b-9708-4493-8d13-14a05df06761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:31.607447 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1360/2710] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:03:31 2022] DELETE /identity/v3/projects/de32d6b23a1b4c938a90d6129628544a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:03:31.613015 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f4e17-5bf1-4d5b-96bf-70ffa23fca69 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:31.613309 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f4e17-5bf1-4d5b-96bf-70ffa23fca69 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:31.613590 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f4e17-5bf1-4d5b-96bf-70ffa23fca69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:31.631752 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4d7f4e17-5bf1-4d5b-96bf-70ffa23fca69 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:31.632971 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4d7f4e17-5bf1-4d5b-96bf-70ffa23fca69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:31.696293 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1351/2711] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:03:31.705200 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886524f3-89ff-4d8b-b533-14cdfc7be82b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:31.705490 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886524f3-89ff-4d8b-b533-14cdfc7be82b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:31.705773 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886524f3-89ff-4d8b-b533-14cdfc7be82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:31.724691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-886524f3-89ff-4d8b-b533-14cdfc7be82b None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:31.725944 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-886524f3-89ff-4d8b-b533-14cdfc7be82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:31.733931 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1361/2712] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 14:03:31.738765 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f4e17-5bf1-4d5b-96bf-70ffa23fca69 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:31.748206 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f4e17-5bf1-4d5b-96bf-70ffa23fca69 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:31.753282 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fb09e-3410-4ff4-8cca-f4a0be9fe21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:31.753973 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fb09e-3410-4ff4-8cca-f4a0be9fe21b admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:31.754255 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fb09e-3410-4ff4-8cca-f4a0be9fe21b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:31.754535 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fb09e-3410-4ff4-8cca-f4a0be9fe21b admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:31.755270 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fb09e-3410-4ff4-8cca-f4a0be9fe21b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 14:03:31.755597 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fb09e-3410-4ff4-8cca-f4a0be9fe21b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:31.757227 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fb09e-3410-4ff4-8cca-f4a0be9fe21b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:31.772391 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1352/2713] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 14:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 14:03:31.773467 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886524f3-89ff-4d8b-b533-14cdfc7be82b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:31.791174 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886524f3-89ff-4d8b-b533-14cdfc7be82b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:31.796167 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c696551-12f8-4d25-925b-7eb376ae1322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:31.797833 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c696551-12f8-4d25-925b-7eb376ae1322 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:31.798186 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c696551-12f8-4d25-925b-7eb376ae1322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:31.798534 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c696551-12f8-4d25-925b-7eb376ae1322 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:31.799303 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c696551-12f8-4d25-925b-7eb376ae1322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:31.801297 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c696551-12f8-4d25-925b-7eb376ae1322 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:31.826073 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1362/2714] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:03:31 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 14:03:31.830728 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fb09e-3410-4ff4-8cca-f4a0be9fe21b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:31.840639 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fb09e-3410-4ff4-8cca-f4a0be9fe21b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:31.897767 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd28d91-f889-45c4-8c82-ff878441b108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:31.898358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd28d91-f889-45c4-8c82-ff878441b108 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:31.898640 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd28d91-f889-45c4-8c82-ff878441b108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:31.898914 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd28d91-f889-45c4-8c82-ff878441b108 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:31.899594 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd28d91-f889-45c4-8c82-ff878441b108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:31.901571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd28d91-f889-45c4-8c82-ff878441b108 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:31.921593 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1353/2715] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:03:31 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 14:03:31.925996 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c696551-12f8-4d25-925b-7eb376ae1322 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:31.935913 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c696551-12f8-4d25-925b-7eb376ae1322 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:31.940657 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc585e-bae4-46b5-b8e8-ef2d60bef62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:31.941310 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc585e-bae4-46b5-b8e8-ef2d60bef62b admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:31.941594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc585e-bae4-46b5-b8e8-ef2d60bef62b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:31.941872 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc585e-bae4-46b5-b8e8-ef2d60bef62b admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:31.942594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc585e-bae4-46b5-b8e8-ef2d60bef62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:31.944213 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc585e-bae4-46b5-b8e8-ef2d60bef62b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:31.954764 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1363/2716] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:03:31.958493 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd28d91-f889-45c4-8c82-ff878441b108 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:31.968105 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd28d91-f889-45c4-8c82-ff878441b108 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:31.973621 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6271835-3952-4eb5-842a-d09ba6e757c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:31.974281 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6271835-3952-4eb5-842a-d09ba6e757c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:31.974563 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6271835-3952-4eb5-842a-d09ba6e757c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:31.974838 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6271835-3952-4eb5-842a-d09ba6e757c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:31.975562 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6271835-3952-4eb5-842a-d09ba6e757c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:31.977221 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6271835-3952-4eb5-842a-d09ba6e757c9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:31.989159 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1354/2717] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:03:31.993219 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc585e-bae4-46b5-b8e8-ef2d60bef62b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:32.003075 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc585e-bae4-46b5-b8e8-ef2d60bef62b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:32.007583 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efc4b9-c05b-4a2d-aa1c-d404599ca48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:32.008478 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efc4b9-c05b-4a2d-aa1c-d404599ca48a admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:32.008756 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efc4b9-c05b-4a2d-aa1c-d404599ca48a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:32.009029 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efc4b9-c05b-4a2d-aa1c-d404599ca48a admin admin] PATH_INFO: `/v3/projects/ec7ecb72ad454dcc9c21572ac6bb2515/users/fa2cfb197c9d4c7785200ea48a653f36/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:32.024051 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efc4b9-c05b-4a2d-aa1c-d404599ca48a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec7ecb72ad454dcc9c21572ac6bb2515, user_id=fa2cfb197c9d4c7785200ea48a653f36, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:32.026727 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efc4b9-c05b-4a2d-aa1c-d404599ca48a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:32.040091 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1364/2718] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:03:31 2022] PUT /identity/v3/projects/ec7ecb72ad454dcc9c21572ac6bb2515/users/fa2cfb197c9d4c7785200ea48a653f36/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:03:32.050697 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5ab7c-01cf-4e01-9709-27db6e12cee4 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:32.050988 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5ab7c-01cf-4e01-9709-27db6e12cee4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:32.051263 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5ab7c-01cf-4e01-9709-27db6e12cee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:32.076700 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c5e5ab7c-01cf-4e01-9709-27db6e12cee4 None None] MFA Rules not processed for user `fa2cfb197c9d4c7785200ea48a653f36`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:32.077904 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c5e5ab7c-01cf-4e01-9709-27db6e12cee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:32.140354 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1355/2719] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:03:32.151696 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efc4b9-c05b-4a2d-aa1c-d404599ca48a admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:32.153352 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-65efc4b9-c05b-4a2d-aa1c-d404599ca48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:32.209463 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efc4b9-c05b-4a2d-aa1c-d404599ca48a admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:32.213125 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0a475-9a67-4e16-b208-018a00763840 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:32.213764 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0a475-9a67-4e16-b208-018a00763840 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:32.214050 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0a475-9a67-4e16-b208-018a00763840 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:32.214333 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0a475-9a67-4e16-b208-018a00763840 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:32.222732 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0a475-9a67-4e16-b208-018a00763840 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:32.224198 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0a475-9a67-4e16-b208-018a00763840 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:32.232880 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1365/2720] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:03:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:03:36.444563 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5ab7c-01cf-4e01-9709-27db6e12cee4 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:36.445951 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c5e5ab7c-01cf-4e01-9709-27db6e12cee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:36.499082 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5ab7c-01cf-4e01-9709-27db6e12cee4 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:36.503576 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f492b42-bb8a-49b9-92d6-d3936aa62123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:36.504240 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f492b42-bb8a-49b9-92d6-d3936aa62123 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:36.504520 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f492b42-bb8a-49b9-92d6-d3936aa62123 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:36.504891 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f492b42-bb8a-49b9-92d6-d3936aa62123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:36.506544 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-8f492b42-bb8a-49b9-92d6-d3936aa62123 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:36.561469 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f492b42-bb8a-49b9-92d6-d3936aa62123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:36.563497 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f492b42-bb8a-49b9-92d6-d3936aa62123 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:36.572141 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1356/2721] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:03:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:03:36.705546 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0a475-9a67-4e16-b208-018a00763840 service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:36.707079 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e4f0a475-9a67-4e16-b208-018a00763840 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:36.775221 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0a475-9a67-4e16-b208-018a00763840 service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:36.784803 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0029043-4e90-4a1f-ad6b-c24ceda05a4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1885d4d35b6743299a73b3c12b1793b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:36.785479 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0029043-4e90-4a1f-ad6b-c24ceda05a4e service placement] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:36.785762 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0029043-4e90-4a1f-ad6b-c24ceda05a4e service placement] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:36.786038 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0029043-4e90-4a1f-ad6b-c24ceda05a4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:36.790717 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e0029043-4e90-4a1f-ad6b-c24ceda05a4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:36.810488 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0029043-4e90-4a1f-ad6b-c24ceda05a4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:36.820565 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0029043-4e90-4a1f-ad6b-c24ceda05a4e service placement] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:36.833713 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1366/2722] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:03:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:03:39.604422 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f492b42-bb8a-49b9-92d6-d3936aa62123 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:39.669645 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f492b42-bb8a-49b9-92d6-d3936aa62123 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:39.674468 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c62a8b-2743-40e2-a226-3c231225c89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:39.675345 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c62a8b-2743-40e2-a226-3c231225c89f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:39.675653 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c62a8b-2743-40e2-a226-3c231225c89f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:39.675932 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c62a8b-2743-40e2-a226-3c231225c89f admin admin] PATH_INFO: `/v3/users/fa2cfb197c9d4c7785200ea48a653f36` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:39.677135 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c62a8b-2743-40e2-a226-3c231225c89f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa2cfb197c9d4c7785200ea48a653f36)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:39.679085 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c62a8b-2743-40e2-a226-3c231225c89f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:39.727146 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b1c62a8b-2743-40e2-a226-3c231225c89f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa2cfb197c9d4c7785200ea48a653f36'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:39.734058 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b1c62a8b-2743-40e2-a226-3c231225c89f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa2cfb197c9d4c7785200ea48a653f36'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:39.741015 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b1c62a8b-2743-40e2-a226-3c231225c89f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa2cfb197c9d4c7785200ea48a653f36'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:39.741634 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b1c62a8b-2743-40e2-a226-3c231225c89f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa2cfb197c9d4c7785200ea48a653f36'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:39.742264 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b1c62a8b-2743-40e2-a226-3c231225c89f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa2cfb197c9d4c7785200ea48a653f36'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:39.760011 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1357/2723] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:03:39 2022] DELETE /identity/v3/users/fa2cfb197c9d4c7785200ea48a653f36 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:03:39.764553 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0e4fd-0964-4164-ade1-68fbfbb8dcc0 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:39.765657 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0e4fd-0964-4164-ade1-68fbfbb8dcc0 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:39.765657 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0e4fd-0964-4164-ade1-68fbfbb8dcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:39.783574 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d2e0e4fd-0964-4164-ade1-68fbfbb8dcc0 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:39.784823 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d2e0e4fd-0964-4164-ade1-68fbfbb8dcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:39.845822 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1367/2724] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:03:39.855888 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c62a8b-2743-40e2-a226-3c231225c89f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:39.857454 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b1c62a8b-2743-40e2-a226-3c231225c89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:39.915178 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c62a8b-2743-40e2-a226-3c231225c89f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:39.918749 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30680596-d83c-425f-bf7b-02e1b149ed1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:39.919398 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30680596-d83c-425f-bf7b-02e1b149ed1e service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:39.919710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30680596-d83c-425f-bf7b-02e1b149ed1e service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:39.919989 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30680596-d83c-425f-bf7b-02e1b149ed1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:39.929204 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30680596-d83c-425f-bf7b-02e1b149ed1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:39.930636 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30680596-d83c-425f-bf7b-02e1b149ed1e service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:39.940649 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1358/2725] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:03:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:03:40.241755 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0e4fd-0964-4164-ade1-68fbfbb8dcc0 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:40.243199 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d2e0e4fd-0964-4164-ade1-68fbfbb8dcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:40.257027 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0e4fd-0964-4164-ade1-68fbfbb8dcc0 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:40.262794 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc93f34-d2ce-44b0-8a4c-398dafcb713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:40.263746 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc93f34-d2ce-44b0-8a4c-398dafcb713a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:40.264027 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc93f34-d2ce-44b0-8a4c-398dafcb713a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:40.264347 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc93f34-d2ce-44b0-8a4c-398dafcb713a admin admin] PATH_INFO: `/v3/projects/ec7ecb72ad454dcc9c21572ac6bb2515` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:40.266250 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc93f34-d2ce-44b0-8a4c-398dafcb713a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec7ecb72ad454dcc9c21572ac6bb2515)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:40.268575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc93f34-d2ce-44b0-8a4c-398dafcb713a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:40.326476 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fcc93f34-d2ce-44b0-8a4c-398dafcb713a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec7ecb72ad454dcc9c21572ac6bb2515', 'request_id': 'req-fcc93f34-d2ce-44b0-8a4c-398dafcb713a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:40.350420 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fcc93f34-d2ce-44b0-8a4c-398dafcb713a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec7ecb72ad454dcc9c21572ac6bb2515', 'request_id': 'req-fcc93f34-d2ce-44b0-8a4c-398dafcb713a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:40.361172 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fcc93f34-d2ce-44b0-8a4c-398dafcb713a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec7ecb72ad454dcc9c21572ac6bb2515', 'request_id': 'req-fcc93f34-d2ce-44b0-8a4c-398dafcb713a'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:40.390621 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fcc93f34-d2ce-44b0-8a4c-398dafcb713a admin admin] The token cache is being invalidate because project ec7ecb72ad454dcc9c21572ac6bb2515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:03:40.390621 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fcc93f34-d2ce-44b0-8a4c-398dafcb713a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:40.391608 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-fcc93f34-d2ce-44b0-8a4c-398dafcb713a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:40.398289 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1368/2726] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:03:40 2022] DELETE /identity/v3/projects/ec7ecb72ad454dcc9c21572ac6bb2515 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:03:40.403807 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9663ec0-6207-402f-980d-1299657273e0 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:40.404167 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9663ec0-6207-402f-980d-1299657273e0 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:40.404517 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9663ec0-6207-402f-980d-1299657273e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:40.424071 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-d9663ec0-6207-402f-980d-1299657273e0 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:40.425288 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d9663ec0-6207-402f-980d-1299657273e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:40.497996 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1359/2727] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:03:40.506936 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725146f-ac42-4d24-91e6-c912974b5e10 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:40.507337 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725146f-ac42-4d24-91e6-c912974b5e10 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:40.507621 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725146f-ac42-4d24-91e6-c912974b5e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:40.528936 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-b725146f-ac42-4d24-91e6-c912974b5e10 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:40.530180 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b725146f-ac42-4d24-91e6-c912974b5e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:40.538711 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1369/2728] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:03:40.542607 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9663ec0-6207-402f-980d-1299657273e0 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:40.553024 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9663ec0-6207-402f-980d-1299657273e0 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:40.559339 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca004bf-7a62-4647-8f6a-4fc286ba7ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:40.560079 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca004bf-7a62-4647-8f6a-4fc286ba7ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:40.560378 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca004bf-7a62-4647-8f6a-4fc286ba7ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:40.560649 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca004bf-7a62-4647-8f6a-4fc286ba7ae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:40.561398 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca004bf-7a62-4647-8f6a-4fc286ba7ae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 14:03:40.562293 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca004bf-7a62-4647-8f6a-4fc286ba7ae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:40.565186 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca004bf-7a62-4647-8f6a-4fc286ba7ae1 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:40.578296 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1360/2729] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 14:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 14:03:40.582580 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725146f-ac42-4d24-91e6-c912974b5e10 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:40.592069 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725146f-ac42-4d24-91e6-c912974b5e10 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:40.597401 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaba5b7-c028-4ae0-916d-0eb100022bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:40.598114 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaba5b7-c028-4ae0-916d-0eb100022bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:40.598420 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaba5b7-c028-4ae0-916d-0eb100022bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:40.598705 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaba5b7-c028-4ae0-916d-0eb100022bc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:40.599408 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaba5b7-c028-4ae0-916d-0eb100022bc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:40.601712 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaba5b7-c028-4ae0-916d-0eb100022bc0 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:40.629193 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1370/2730] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:03:40 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:03:40.633381 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca004bf-7a62-4647-8f6a-4fc286ba7ae1 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:40.643441 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca004bf-7a62-4647-8f6a-4fc286ba7ae1 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:40.700015 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03330d9-bc9e-4808-8411-ca1fd496e38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:40.700715 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03330d9-bc9e-4808-8411-ca1fd496e38f admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:40.701002 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03330d9-bc9e-4808-8411-ca1fd496e38f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:40.701276 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03330d9-bc9e-4808-8411-ca1fd496e38f admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:40.702014 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03330d9-bc9e-4808-8411-ca1fd496e38f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:40.704033 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03330d9-bc9e-4808-8411-ca1fd496e38f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:40.722576 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1361/2731] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:03:40 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 14:03:40.726669 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaba5b7-c028-4ae0-916d-0eb100022bc0 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:40.737817 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaba5b7-c028-4ae0-916d-0eb100022bc0 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:40.742449 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ab415-79dc-4726-9439-0aaa044fc724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:40.743105 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ab415-79dc-4726-9439-0aaa044fc724 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:40.743387 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ab415-79dc-4726-9439-0aaa044fc724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:40.743691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ab415-79dc-4726-9439-0aaa044fc724 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:40.744451 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ab415-79dc-4726-9439-0aaa044fc724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:40.746045 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ab415-79dc-4726-9439-0aaa044fc724 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:40.756528 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1371/2732] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:03:40.760453 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03330d9-bc9e-4808-8411-ca1fd496e38f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:40.770433 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03330d9-bc9e-4808-8411-ca1fd496e38f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:40.775029 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10041d8-5725-486c-bf13-0e78d919f7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:40.775705 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10041d8-5725-486c-bf13-0e78d919f7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:40.775994 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10041d8-5725-486c-bf13-0e78d919f7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:40.776274 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10041d8-5725-486c-bf13-0e78d919f7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:40.777023 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10041d8-5725-486c-bf13-0e78d919f7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:40.778617 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10041d8-5725-486c-bf13-0e78d919f7b8 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:40.789113 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1362/2733] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:03:40.793369 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ab415-79dc-4726-9439-0aaa044fc724 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:40.803770 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ab415-79dc-4726-9439-0aaa044fc724 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:40.808313 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b764da6-73e0-468a-a373-11ad5612a656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:40.809191 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b764da6-73e0-468a-a373-11ad5612a656 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:40.809494 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b764da6-73e0-468a-a373-11ad5612a656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:40.809744 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b764da6-73e0-468a-a373-11ad5612a656 admin admin] PATH_INFO: `/v3/projects/7ea539d2e309403ab7ea0c5244a6d80f/users/b469e5f0479349c9bf61af6b1774583b/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:40.824267 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b764da6-73e0-468a-a373-11ad5612a656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea539d2e309403ab7ea0c5244a6d80f, user_id=b469e5f0479349c9bf61af6b1774583b, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:40.826889 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b764da6-73e0-468a-a373-11ad5612a656 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:40.842434 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1372/2734] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:03:40 2022] PUT /identity/v3/projects/7ea539d2e309403ab7ea0c5244a6d80f/users/b469e5f0479349c9bf61af6b1774583b/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 14:03:40.848109 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67632e21-e6f4-45fb-8322-7984d3e81e78 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:40.848521 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67632e21-e6f4-45fb-8322-7984d3e81e78 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:40.848801 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67632e21-e6f4-45fb-8322-7984d3e81e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:40.866571 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-67632e21-e6f4-45fb-8322-7984d3e81e78 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:40.867804 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-67632e21-e6f4-45fb-8322-7984d3e81e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:40.930800 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1363/2735] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:03:40.940608 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b764da6-73e0-468a-a373-11ad5612a656 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:40.942321 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-5b764da6-73e0-468a-a373-11ad5612a656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:40.997334 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b764da6-73e0-468a-a373-11ad5612a656 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:41.001138 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef216a60-2bf6-46da-a9d6-5e09fc7bcd3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:41.001769 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef216a60-2bf6-46da-a9d6-5e09fc7bcd3b service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:41.002050 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef216a60-2bf6-46da-a9d6-5e09fc7bcd3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:41.002323 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef216a60-2bf6-46da-a9d6-5e09fc7bcd3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:41.011184 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef216a60-2bf6-46da-a9d6-5e09fc7bcd3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:41.012704 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef216a60-2bf6-46da-a9d6-5e09fc7bcd3b service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:41.022715 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1373/2736] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:03:41.609981 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531291a-f8a6-482e-9502-e823e5c379e7 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:41.610280 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531291a-f8a6-482e-9502-e823e5c379e7 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:41.611836 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531291a-f8a6-482e-9502-e823e5c379e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:41.642380 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef216a60-2bf6-46da-a9d6-5e09fc7bcd3b service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:41.643818 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ef216a60-2bf6-46da-a9d6-5e09fc7bcd3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:41.651752 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-2531291a-f8a6-482e-9502-e823e5c379e7 None None] MFA Rules not processed for user `b469e5f0479349c9bf61af6b1774583b`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:41.652978 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-2531291a-f8a6-482e-9502-e823e5c379e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:41.659037 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef216a60-2bf6-46da-a9d6-5e09fc7bcd3b service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:41.664757 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbcffa-a7b0-4d57-acdf-1826ac1d4917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:41.665407 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbcffa-a7b0-4d57-acdf-1826ac1d4917 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:41.665692 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbcffa-a7b0-4d57-acdf-1826ac1d4917 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:41.665968 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbcffa-a7b0-4d57-acdf-1826ac1d4917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:41.674076 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-50dbcffa-a7b0-4d57-acdf-1826ac1d4917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:41.693436 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dbcffa-a7b0-4d57-acdf-1826ac1d4917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:41.695025 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dbcffa-a7b0-4d57-acdf-1826ac1d4917 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:41.706282 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1374/2737] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 14:03:41.742545 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1364/2738] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:03:41.753874 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbcffa-a7b0-4d57-acdf-1826ac1d4917 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:41.755819 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-50dbcffa-a7b0-4d57-acdf-1826ac1d4917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:41.831477 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbcffa-a7b0-4d57-acdf-1826ac1d4917 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:41.835388 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95a346-8743-4094-97a9-23e1515e0beb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:41.836366 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95a346-8743-4094-97a9-23e1515e0beb service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:41.836659 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95a346-8743-4094-97a9-23e1515e0beb service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:41.836989 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95a346-8743-4094-97a9-23e1515e0beb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:41.847849 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95a346-8743-4094-97a9-23e1515e0beb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:41.849834 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95a346-8743-4094-97a9-23e1515e0beb service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:41.860143 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1375/2739] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:03:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:03:43.202755 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32f982-6116-4a67-bac7-73da056a9760 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:43.203328 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32f982-6116-4a67-bac7-73da056a9760 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:43.203537 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32f982-6116-4a67-bac7-73da056a9760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:43.222198 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-6c32f982-6116-4a67-bac7-73da056a9760 None None] MFA Rules not processed for user `b469e5f0479349c9bf61af6b1774583b`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:43.223613 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6c32f982-6116-4a67-bac7-73da056a9760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:43.231681 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1365/2740] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:03:48.722746 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95a346-8743-4094-97a9-23e1515e0beb service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:48.724574 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-ac95a346-8743-4094-97a9-23e1515e0beb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:48.741189 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95a346-8743-4094-97a9-23e1515e0beb service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:48.745924 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344a862-3c63-4dff-b406-7bc6baeeac3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:48.746926 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344a862-3c63-4dff-b406-7bc6baeeac3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:48.747273 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344a862-3c63-4dff-b406-7bc6baeeac3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:48.747613 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344a862-3c63-4dff-b406-7bc6baeeac3b admin admin] PATH_INFO: `/v3/users/4fd5089d5b5d4f71b5789cc10b7ff971` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:48.749411 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344a862-3c63-4dff-b406-7bc6baeeac3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fd5089d5b5d4f71b5789cc10b7ff971)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:48.751391 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344a862-3c63-4dff-b406-7bc6baeeac3b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:48.798082 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4344a862-3c63-4dff-b406-7bc6baeeac3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fd5089d5b5d4f71b5789cc10b7ff971'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:48.798664 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4344a862-3c63-4dff-b406-7bc6baeeac3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fd5089d5b5d4f71b5789cc10b7ff971'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:48.806264 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4344a862-3c63-4dff-b406-7bc6baeeac3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fd5089d5b5d4f71b5789cc10b7ff971'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:48.814648 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4344a862-3c63-4dff-b406-7bc6baeeac3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fd5089d5b5d4f71b5789cc10b7ff971'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:48.815323 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4344a862-3c63-4dff-b406-7bc6baeeac3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fd5089d5b5d4f71b5789cc10b7ff971'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:48.833102 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1376/2741] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:03:48 2022] DELETE /identity/v3/users/4fd5089d5b5d4f71b5789cc10b7ff971 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:03:49.026417 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32f982-6116-4a67-bac7-73da056a9760 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:49.038421 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32f982-6116-4a67-bac7-73da056a9760 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:49.108318 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d427753-e72c-4700-8f07-90cfd985efb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:49.109195 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d427753-e72c-4700-8f07-90cfd985efb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:49.109484 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d427753-e72c-4700-8f07-90cfd985efb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:49.109759 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d427753-e72c-4700-8f07-90cfd985efb3 admin admin] PATH_INFO: `/v3/projects/626d5ba1efe34953a6d00b0f0afd5013` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:49.111308 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d427753-e72c-4700-8f07-90cfd985efb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=626d5ba1efe34953a6d00b0f0afd5013)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:49.113269 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d427753-e72c-4700-8f07-90cfd985efb3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:49.160456 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4d427753-e72c-4700-8f07-90cfd985efb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '626d5ba1efe34953a6d00b0f0afd5013', 'request_id': 'req-4d427753-e72c-4700-8f07-90cfd985efb3'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:49.168183 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4d427753-e72c-4700-8f07-90cfd985efb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '626d5ba1efe34953a6d00b0f0afd5013', 'request_id': 'req-4d427753-e72c-4700-8f07-90cfd985efb3'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:49.174530 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4d427753-e72c-4700-8f07-90cfd985efb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '626d5ba1efe34953a6d00b0f0afd5013', 'request_id': 'req-4d427753-e72c-4700-8f07-90cfd985efb3'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:49.186934 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4d427753-e72c-4700-8f07-90cfd985efb3 admin admin] The token cache is being invalidate because project 626d5ba1efe34953a6d00b0f0afd5013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:03:49.187154 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4d427753-e72c-4700-8f07-90cfd985efb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:49.187870 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-4d427753-e72c-4700-8f07-90cfd985efb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:49.189658 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1366/2742] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:03:49 2022] DELETE /identity/v3/projects/626d5ba1efe34953a6d00b0f0afd5013 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:03:49.193409 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344a862-3c63-4dff-b406-7bc6baeeac3b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:49.194844 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4344a862-3c63-4dff-b406-7bc6baeeac3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:49.208498 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344a862-3c63-4dff-b406-7bc6baeeac3b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:49.265877 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8799d12-da84-4241-830d-7b75122eced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:49.267168 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8799d12-da84-4241-830d-7b75122eced3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:49.268003 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8799d12-da84-4241-830d-7b75122eced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:49.268293 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8799d12-da84-4241-830d-7b75122eced3 admin admin] PATH_INFO: `/v3/users/98c29b19e1f045849ddd61394c63989f` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:49.269520 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8799d12-da84-4241-830d-7b75122eced3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98c29b19e1f045849ddd61394c63989f)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:49.271450 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8799d12-da84-4241-830d-7b75122eced3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:49.318025 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a8799d12-da84-4241-830d-7b75122eced3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98c29b19e1f045849ddd61394c63989f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:49.318724 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a8799d12-da84-4241-830d-7b75122eced3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98c29b19e1f045849ddd61394c63989f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:49.325630 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a8799d12-da84-4241-830d-7b75122eced3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98c29b19e1f045849ddd61394c63989f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:49.333358 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a8799d12-da84-4241-830d-7b75122eced3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98c29b19e1f045849ddd61394c63989f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:49.334070 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-a8799d12-da84-4241-830d-7b75122eced3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98c29b19e1f045849ddd61394c63989f'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:49.350821 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1377/2743] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:03:49 2022] DELETE /identity/v3/users/98c29b19e1f045849ddd61394c63989f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:03:49.521889 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d427753-e72c-4700-8f07-90cfd985efb3 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:03:49.523349 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4d427753-e72c-4700-8f07-90cfd985efb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:49.536874 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d427753-e72c-4700-8f07-90cfd985efb3 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:03:49.591114 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97830b93-a7b5-467f-9bf9-d0657c4b1e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:03:49.592488 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97830b93-a7b5-467f-9bf9-d0657c4b1e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:49.592777 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97830b93-a7b5-467f-9bf9-d0657c4b1e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:49.593054 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97830b93-a7b5-467f-9bf9-d0657c4b1e16 admin admin] PATH_INFO: `/v3/projects/d32bc40164104932a96a6eebb3b739b2` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:49.594228 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97830b93-a7b5-467f-9bf9-d0657c4b1e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d32bc40164104932a96a6eebb3b739b2)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:03:49.596177 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97830b93-a7b5-467f-9bf9-d0657c4b1e16 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:03:49.640373 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-97830b93-a7b5-467f-9bf9-d0657c4b1e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd32bc40164104932a96a6eebb3b739b2', 'request_id': 'req-97830b93-a7b5-467f-9bf9-d0657c4b1e16'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:49.648620 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-97830b93-a7b5-467f-9bf9-d0657c4b1e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd32bc40164104932a96a6eebb3b739b2', 'request_id': 'req-97830b93-a7b5-467f-9bf9-d0657c4b1e16'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:49.654079 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-97830b93-a7b5-467f-9bf9-d0657c4b1e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd32bc40164104932a96a6eebb3b739b2', 'request_id': 'req-97830b93-a7b5-467f-9bf9-d0657c4b1e16'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:49.665364 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-97830b93-a7b5-467f-9bf9-d0657c4b1e16 admin admin] The token cache is being invalidate because project d32bc40164104932a96a6eebb3b739b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:03:49.665650 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-97830b93-a7b5-467f-9bf9-d0657c4b1e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:49.666275 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-97830b93-a7b5-467f-9bf9-d0657c4b1e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:03:49.667867 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1367/2744] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:03:49 2022] DELETE /identity/v3/projects/d32bc40164104932a96a6eebb3b739b2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:03:55.474475 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8677285-612f-4754-8545-641ab2035533 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:03:55.474979 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8677285-612f-4754-8545-641ab2035533 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:03:55.475104 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8677285-612f-4754-8545-641ab2035533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:03:55.492679 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-b8677285-612f-4754-8545-641ab2035533 None None] MFA Rules not processed for user `b469e5f0479349c9bf61af6b1774583b`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:03:55.493864 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b8677285-612f-4754-8545-641ab2035533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:03:55.548013 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1378/2745] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:03:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:04:12.642522 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369ff53-25d6-436c-b6b5-be5e1e9767a9 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:04:12.643054 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369ff53-25d6-436c-b6b5-be5e1e9767a9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:04:12.643054 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369ff53-25d6-436c-b6b5-be5e1e9767a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:04:12.661321 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-9369ff53-25d6-436c-b6b5-be5e1e9767a9 None None] MFA Rules not processed for user `920ed843195243f8abd6dfb2ebb3a549`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:04:12.662442 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-9369ff53-25d6-436c-b6b5-be5e1e9767a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:04:12.714788 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1368/2746] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Apr 11 14:04:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:04:12.765240 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8677285-612f-4754-8545-641ab2035533 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:04:12.766643 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-b8677285-612f-4754-8545-641ab2035533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:04:12.836104 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8677285-612f-4754-8545-641ab2035533 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:04:12.841392 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd9264-707b-4518-9918-e9a0e67fd871 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6660794b27ff4a7bbe9b6b043593598c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:04:12.842294 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd9264-707b-4518-9918-e9a0e67fd871 service swift] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:04:12.842612 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd9264-707b-4518-9918-e9a0e67fd871 service swift] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:04:12.842898 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd9264-707b-4518-9918-e9a0e67fd871 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:04:12.851353 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd9264-707b-4518-9918-e9a0e67fd871 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:04:12.853106 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd9264-707b-4518-9918-e9a0e67fd871 service swift] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:04:12.861127 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1379/2747] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Apr 11 14:04:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 14:04:22.693429 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1f6d9-b5b3-4e32-931e-9976da62ca13 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:04:22.693922 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1f6d9-b5b3-4e32-931e-9976da62ca13 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:04:22.694033 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1f6d9-b5b3-4e32-931e-9976da62ca13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:04:22.716734 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-b9d1f6d9-b5b3-4e32-931e-9976da62ca13 None None] MFA Rules not processed for user `2cbcdc40fea745f48e1dfc62a732b7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:04:22.718155 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b9d1f6d9-b5b3-4e32-931e-9976da62ca13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:04:22.788532 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1369/2748] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:04:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:04:28.667719 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd52c45-ca93-46b5-bb17-a4adc82b5446 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:04:28.668159 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd52c45-ca93-46b5-bb17-a4adc82b5446 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:04:28.668287 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd52c45-ca93-46b5-bb17-a4adc82b5446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:04:28.685987 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-6dd52c45-ca93-46b5-bb17-a4adc82b5446 None None] MFA Rules not processed for user `920ed843195243f8abd6dfb2ebb3a549`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:04:28.687160 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6dd52c45-ca93-46b5-bb17-a4adc82b5446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:04:28.694161 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1380/2749] 10.222.0.67 () {58 vars in 967 bytes} [Mon Apr 11 14:04:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 14:04:28.706752 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1f6d9-b5b3-4e32-931e-9976da62ca13 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:04:28.719180 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1f6d9-b5b3-4e32-931e-9976da62ca13 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:04:28.724159 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365a126-d119-4aa1-a004-b6f7d2907d00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6660794b27ff4a7bbe9b6b043593598c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:04:28.724803 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365a126-d119-4aa1-a004-b6f7d2907d00 service swift] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:04:28.725089 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365a126-d119-4aa1-a004-b6f7d2907d00 service swift] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:04:28.725417 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365a126-d119-4aa1-a004-b6f7d2907d00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:04:28.733988 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365a126-d119-4aa1-a004-b6f7d2907d00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:04:28.735585 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365a126-d119-4aa1-a004-b6f7d2907d00 service swift] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:04:28.743457 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1370/2750] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Apr 11 14:04:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 14:04:30.712021 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd52c45-ca93-46b5-bb17-a4adc82b5446 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:04:30.713562 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6dd52c45-ca93-46b5-bb17-a4adc82b5446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:04:30.777916 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd52c45-ca93-46b5-bb17-a4adc82b5446 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:04:30.782576 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e72f0-6c1e-44dd-8028-a1ddd64fd9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:04:30.783454 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e72f0-6c1e-44dd-8028-a1ddd64fd9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:04:30.783772 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e72f0-6c1e-44dd-8028-a1ddd64fd9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:04:30.784050 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e72f0-6c1e-44dd-8028-a1ddd64fd9d8 admin admin] PATH_INFO: `/v3/users/b469e5f0479349c9bf61af6b1774583b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:04:30.785255 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e72f0-6c1e-44dd-8028-a1ddd64fd9d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b469e5f0479349c9bf61af6b1774583b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:04:30.787175 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e72f0-6c1e-44dd-8028-a1ddd64fd9d8 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:04:30.831132 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c79e72f0-6c1e-44dd-8028-a1ddd64fd9d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b469e5f0479349c9bf61af6b1774583b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:04:30.831840 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c79e72f0-6c1e-44dd-8028-a1ddd64fd9d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b469e5f0479349c9bf61af6b1774583b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:04:30.838397 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c79e72f0-6c1e-44dd-8028-a1ddd64fd9d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b469e5f0479349c9bf61af6b1774583b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:04:30.845517 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c79e72f0-6c1e-44dd-8028-a1ddd64fd9d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b469e5f0479349c9bf61af6b1774583b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:04:30.846118 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-c79e72f0-6c1e-44dd-8028-a1ddd64fd9d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b469e5f0479349c9bf61af6b1774583b'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:04:30.863536 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1381/2751] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:04:30 2022] DELETE /identity/v3/users/b469e5f0479349c9bf61af6b1774583b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:04:31.041550 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365a126-d119-4aa1-a004-b6f7d2907d00 service swift] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:04:31.054062 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365a126-d119-4aa1-a004-b6f7d2907d00 service swift] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:04:31.122459 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bdb94-eefc-4ce7-b1b2-521203fcfede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:04:31.123449 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bdb94-eefc-4ce7-b1b2-521203fcfede admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:04:31.123882 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bdb94-eefc-4ce7-b1b2-521203fcfede admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:04:31.124162 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bdb94-eefc-4ce7-b1b2-521203fcfede admin admin] PATH_INFO: `/v3/projects/7ea539d2e309403ab7ea0c5244a6d80f` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:04:31.125364 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bdb94-eefc-4ce7-b1b2-521203fcfede admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ea539d2e309403ab7ea0c5244a6d80f)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:04:31.127256 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bdb94-eefc-4ce7-b1b2-521203fcfede admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:04:31.181681 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-816bdb94-eefc-4ce7-b1b2-521203fcfede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ea539d2e309403ab7ea0c5244a6d80f', 'request_id': 'req-816bdb94-eefc-4ce7-b1b2-521203fcfede'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:04:31.188806 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-816bdb94-eefc-4ce7-b1b2-521203fcfede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ea539d2e309403ab7ea0c5244a6d80f', 'request_id': 'req-816bdb94-eefc-4ce7-b1b2-521203fcfede'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:04:31.194197 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-816bdb94-eefc-4ce7-b1b2-521203fcfede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ea539d2e309403ab7ea0c5244a6d80f', 'request_id': 'req-816bdb94-eefc-4ce7-b1b2-521203fcfede'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:04:31.205912 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-816bdb94-eefc-4ce7-b1b2-521203fcfede admin admin] The token cache is being invalidate because project 7ea539d2e309403ab7ea0c5244a6d80f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:04:31.206209 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-816bdb94-eefc-4ce7-b1b2-521203fcfede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:04:31.206841 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-816bdb94-eefc-4ce7-b1b2-521203fcfede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:04:31.208676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1371/2752] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:04:31 2022] DELETE /identity/v3/projects/7ea539d2e309403ab7ea0c5244a6d80f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:04:40.649307 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04671604-c519-41ad-9952-98fd1f9fbdfa None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:04:40.649772 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04671604-c519-41ad-9952-98fd1f9fbdfa None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:04:40.649877 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04671604-c519-41ad-9952-98fd1f9fbdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:04:40.667371 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-04671604-c519-41ad-9952-98fd1f9fbdfa None None] MFA Rules not processed for user `64643f7804ba42f5886f949134dd4d06`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:04:40.668590 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-04671604-c519-41ad-9952-98fd1f9fbdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:04:40.721072 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1382/2753] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:04:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 14:05:26.996026 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bdb94-eefc-4ce7-b1b2-521203fcfede admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:26.997616 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-816bdb94-eefc-4ce7-b1b2-521203fcfede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:27.062437 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bdb94-eefc-4ce7-b1b2-521203fcfede admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:27.067219 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915ec1b-113f-4694-8842-01bb9e5032eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:27.068173 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915ec1b-113f-4694-8842-01bb9e5032eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:27.068468 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915ec1b-113f-4694-8842-01bb9e5032eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:27.068746 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915ec1b-113f-4694-8842-01bb9e5032eb admin admin] PATH_INFO: `/v3/users/2cbcdc40fea745f48e1dfc62a732b7ee` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:27.069969 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915ec1b-113f-4694-8842-01bb9e5032eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cbcdc40fea745f48e1dfc62a732b7ee)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:27.071952 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915ec1b-113f-4694-8842-01bb9e5032eb admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:27.120584 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f915ec1b-113f-4694-8842-01bb9e5032eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cbcdc40fea745f48e1dfc62a732b7ee'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:27.127266 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f915ec1b-113f-4694-8842-01bb9e5032eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cbcdc40fea745f48e1dfc62a732b7ee'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:27.134088 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f915ec1b-113f-4694-8842-01bb9e5032eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cbcdc40fea745f48e1dfc62a732b7ee'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:27.134707 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f915ec1b-113f-4694-8842-01bb9e5032eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cbcdc40fea745f48e1dfc62a732b7ee'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:27.135314 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f915ec1b-113f-4694-8842-01bb9e5032eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cbcdc40fea745f48e1dfc62a732b7ee'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:27.152044 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1372/2754] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:05:26 2022] DELETE /identity/v3/users/2cbcdc40fea745f48e1dfc62a732b7ee => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:27.322563 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04671604-c519-41ad-9952-98fd1f9fbdfa None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:27.333636 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04671604-c519-41ad-9952-98fd1f9fbdfa None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:27.391783 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab6487-3211-4ac5-b56d-f7aadfe3ee54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:27.392647 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab6487-3211-4ac5-b56d-f7aadfe3ee54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:27.392928 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab6487-3211-4ac5-b56d-f7aadfe3ee54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:27.393207 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab6487-3211-4ac5-b56d-f7aadfe3ee54 admin admin] PATH_INFO: `/v3/projects/63cddbab1b664b5a89b56d5632d2f62e` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:27.394402 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab6487-3211-4ac5-b56d-f7aadfe3ee54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63cddbab1b664b5a89b56d5632d2f62e)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:27.396338 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab6487-3211-4ac5-b56d-f7aadfe3ee54 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:27.442981 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d3ab6487-3211-4ac5-b56d-f7aadfe3ee54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63cddbab1b664b5a89b56d5632d2f62e', 'request_id': 'req-d3ab6487-3211-4ac5-b56d-f7aadfe3ee54'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:27.449163 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d3ab6487-3211-4ac5-b56d-f7aadfe3ee54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63cddbab1b664b5a89b56d5632d2f62e', 'request_id': 'req-d3ab6487-3211-4ac5-b56d-f7aadfe3ee54'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:27.454421 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d3ab6487-3211-4ac5-b56d-f7aadfe3ee54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63cddbab1b664b5a89b56d5632d2f62e', 'request_id': 'req-d3ab6487-3211-4ac5-b56d-f7aadfe3ee54'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:27.466654 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d3ab6487-3211-4ac5-b56d-f7aadfe3ee54 admin admin] The token cache is being invalidate because project 63cddbab1b664b5a89b56d5632d2f62e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:05:27.466943 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d3ab6487-3211-4ac5-b56d-f7aadfe3ee54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:27.467564 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-d3ab6487-3211-4ac5-b56d-f7aadfe3ee54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:27.469130 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1383/2755] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:05:27 2022] DELETE /identity/v3/projects/63cddbab1b664b5a89b56d5632d2f62e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:27.474229 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a0bf3-2c5c-47a9-b729-cb8b1aa11bab None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:27.474547 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a0bf3-2c5c-47a9-b729-cb8b1aa11bab None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:27.474832 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a0bf3-2c5c-47a9-b729-cb8b1aa11bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:27.492870 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-857a0bf3-2c5c-47a9-b729-cb8b1aa11bab None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:27.494054 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-857a0bf3-2c5c-47a9-b729-cb8b1aa11bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:27.551122 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1373/2756] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:27.559888 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be113a-a64f-4126-bfe2-d7173d7b6f6a None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:27.560211 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be113a-a64f-4126-bfe2-d7173d7b6f6a None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:27.560496 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be113a-a64f-4126-bfe2-d7173d7b6f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:27.579299 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-20be113a-a64f-4126-bfe2-d7173d7b6f6a None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:27.580556 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-20be113a-a64f-4126-bfe2-d7173d7b6f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:27.588504 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1384/2757] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:27.592727 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a0bf3-2c5c-47a9-b729-cb8b1aa11bab None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:27.602210 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a0bf3-2c5c-47a9-b729-cb8b1aa11bab None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:27.607358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b732f-2183-498d-90b5-8b3c800f9f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:27.608037 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b732f-2183-498d-90b5-8b3c800f9f87 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:27.608316 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b732f-2183-498d-90b5-8b3c800f9f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:27.608587 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b732f-2183-498d-90b5-8b3c800f9f87 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:27.609307 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b732f-2183-498d-90b5-8b3c800f9f87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 14:05:27.609610 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b732f-2183-498d-90b5-8b3c800f9f87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:27.611190 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b732f-2183-498d-90b5-8b3c800f9f87 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:27.622876 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1374/2758] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 14:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 14:05:27.627169 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be113a-a64f-4126-bfe2-d7173d7b6f6a None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:27.636525 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be113a-a64f-4126-bfe2-d7173d7b6f6a None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:27.641273 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0fdec-5e02-4182-a721-c53e52be6739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:27.641952 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0fdec-5e02-4182-a721-c53e52be6739 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:27.642236 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0fdec-5e02-4182-a721-c53e52be6739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:27.642542 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0fdec-5e02-4182-a721-c53e52be6739 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:27.643242 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0fdec-5e02-4182-a721-c53e52be6739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:27.645211 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0fdec-5e02-4182-a721-c53e52be6739 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:27.670154 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1385/2759] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:05:27 2022] POST /identity/v3/projects => generated 405 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 14:05:27.674295 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b732f-2183-498d-90b5-8b3c800f9f87 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:27.685326 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b732f-2183-498d-90b5-8b3c800f9f87 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:27.742309 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c35a9-843f-4b57-9e99-e126bc90379b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:27.743171 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c35a9-843f-4b57-9e99-e126bc90379b admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:27.743388 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c35a9-843f-4b57-9e99-e126bc90379b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:27.743700 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c35a9-843f-4b57-9e99-e126bc90379b admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:27.745751 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c35a9-843f-4b57-9e99-e126bc90379b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:27.747165 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c35a9-843f-4b57-9e99-e126bc90379b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:27.770646 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1375/2760] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:05:27 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:05:27.771716 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0fdec-5e02-4182-a721-c53e52be6739 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:27.782476 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0fdec-5e02-4182-a721-c53e52be6739 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:27.787314 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3fda6-b971-4116-8745-95f358621c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:27.788017 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3fda6-b971-4116-8745-95f358621c8e admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:27.788306 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3fda6-b971-4116-8745-95f358621c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:27.788612 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3fda6-b971-4116-8745-95f358621c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:27.789320 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3fda6-b971-4116-8745-95f358621c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:27.790920 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3fda6-b971-4116-8745-95f358621c8e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:27.801875 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1386/2761] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:05:27.806592 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c35a9-843f-4b57-9e99-e126bc90379b admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:27.817731 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c35a9-843f-4b57-9e99-e126bc90379b admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:27.822952 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216a36f-a5b2-46da-8502-1d3de72c5791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:27.823705 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216a36f-a5b2-46da-8502-1d3de72c5791 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:27.823991 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216a36f-a5b2-46da-8502-1d3de72c5791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:27.824267 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216a36f-a5b2-46da-8502-1d3de72c5791 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:27.824998 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216a36f-a5b2-46da-8502-1d3de72c5791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:27.826630 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216a36f-a5b2-46da-8502-1d3de72c5791 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:27.836345 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1376/2762] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:05:27.840834 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3fda6-b971-4116-8745-95f358621c8e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:27.850471 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3fda6-b971-4116-8745-95f358621c8e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:27.855699 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c33cb5-87a8-4179-98b5-f22a5b82198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:27.856575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c33cb5-87a8-4179-98b5-f22a5b82198b admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:27.856858 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c33cb5-87a8-4179-98b5-f22a5b82198b admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:27.857136 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c33cb5-87a8-4179-98b5-f22a5b82198b admin admin] PATH_INFO: `/v3/projects/fb41fa47c93a4087b454302d26a53d81/users/2bc9562c0c16482d9eabc195f9f8e61f/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:27.871564 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c33cb5-87a8-4179-98b5-f22a5b82198b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb41fa47c93a4087b454302d26a53d81, user_id=2bc9562c0c16482d9eabc195f9f8e61f, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:27.874276 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c33cb5-87a8-4179-98b5-f22a5b82198b admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:27.886851 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1387/2763] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:05:27 2022] PUT /identity/v3/projects/fb41fa47c93a4087b454302d26a53d81/users/2bc9562c0c16482d9eabc195f9f8e61f/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:27.891854 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c13577-397c-46f6-8792-f64099f2af45 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:27.892150 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c13577-397c-46f6-8792-f64099f2af45 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:27.892431 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c13577-397c-46f6-8792-f64099f2af45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:27.909886 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-92c13577-397c-46f6-8792-f64099f2af45 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:27.911078 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-92c13577-397c-46f6-8792-f64099f2af45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:27.967330 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1377/2764] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:27.976974 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c33cb5-87a8-4179-98b5-f22a5b82198b admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:27.978640 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-26c33cb5-87a8-4179-98b5-f22a5b82198b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:28.034755 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c33cb5-87a8-4179-98b5-f22a5b82198b admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:28.038588 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747160be-90d7-4078-9f6e-5a1eef0dbfe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:28.039240 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747160be-90d7-4078-9f6e-5a1eef0dbfe2 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:28.039526 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747160be-90d7-4078-9f6e-5a1eef0dbfe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:28.039833 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747160be-90d7-4078-9f6e-5a1eef0dbfe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:28.049595 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747160be-90d7-4078-9f6e-5a1eef0dbfe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:28.051057 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747160be-90d7-4078-9f6e-5a1eef0dbfe2 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:28.060833 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1388/2765] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:05:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:05:28.635394 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055ef83-6037-46a1-9fe0-4453e16293bd None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:28.635997 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055ef83-6037-46a1-9fe0-4453e16293bd None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:28.635997 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055ef83-6037-46a1-9fe0-4453e16293bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:28.661750 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-5055ef83-6037-46a1-9fe0-4453e16293bd None None] MFA Rules not processed for user `2bc9562c0c16482d9eabc195f9f8e61f`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:28.663009 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-5055ef83-6037-46a1-9fe0-4453e16293bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:28.728228 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1378/2766] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:28 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:28.734137 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747160be-90d7-4078-9f6e-5a1eef0dbfe2 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:28.744250 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747160be-90d7-4078-9f6e-5a1eef0dbfe2 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:28.748973 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420aa0d-7461-4ec7-9514-e27fcf3bf68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:28.749626 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420aa0d-7461-4ec7-9514-e27fcf3bf68a admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:28.749908 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420aa0d-7461-4ec7-9514-e27fcf3bf68a admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:28.750186 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420aa0d-7461-4ec7-9514-e27fcf3bf68a admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:28.750884 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420aa0d-7461-4ec7-9514-e27fcf3bf68a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:28.752813 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420aa0d-7461-4ec7-9514-e27fcf3bf68a admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:28.779660 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1389/2767] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:05:28 2022] POST /identity/v3/projects => generated 405 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:05:28.782464 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055ef83-6037-46a1-9fe0-4453e16293bd None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:28.793918 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055ef83-6037-46a1-9fe0-4453e16293bd None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:28.850062 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57074d4-6566-4f6f-b55e-3cd1807642ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:28.850728 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57074d4-6566-4f6f-b55e-3cd1807642ae admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:28.851007 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57074d4-6566-4f6f-b55e-3cd1807642ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:28.851278 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57074d4-6566-4f6f-b55e-3cd1807642ae admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:28.852061 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57074d4-6566-4f6f-b55e-3cd1807642ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:28.853965 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57074d4-6566-4f6f-b55e-3cd1807642ae admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:28.873738 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1379/2768] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:05:28 2022] POST /identity/v3/users => generated 309 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:05:28.878074 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420aa0d-7461-4ec7-9514-e27fcf3bf68a admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:28.888980 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420aa0d-7461-4ec7-9514-e27fcf3bf68a admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:28.893471 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8872b-bbfc-4c15-9118-061fa8f59049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:28.894124 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8872b-bbfc-4c15-9118-061fa8f59049 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:28.894405 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8872b-bbfc-4c15-9118-061fa8f59049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:28.894674 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8872b-bbfc-4c15-9118-061fa8f59049 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:28.895391 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8872b-bbfc-4c15-9118-061fa8f59049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:28.897131 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8872b-bbfc-4c15-9118-061fa8f59049 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:28.908743 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1390/2769] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:05:28.912761 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57074d4-6566-4f6f-b55e-3cd1807642ae admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:28.922693 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57074d4-6566-4f6f-b55e-3cd1807642ae admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:28.927349 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e5139-88c6-4dc9-aa88-8fad50a128e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:28.928245 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e5139-88c6-4dc9-aa88-8fad50a128e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:28.928539 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e5139-88c6-4dc9-aa88-8fad50a128e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:28.928813 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e5139-88c6-4dc9-aa88-8fad50a128e9 admin admin] PATH_INFO: `/v3/projects/abbcc98684a04e1d9179523ef3500985/users/0630298199524ee682a94271cdc562b1/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:28.943388 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e5139-88c6-4dc9-aa88-8fad50a128e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abbcc98684a04e1d9179523ef3500985, user_id=0630298199524ee682a94271cdc562b1, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:28.946074 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e5139-88c6-4dc9-aa88-8fad50a128e9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:28.959378 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1380/2770] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:05:28 2022] PUT /identity/v3/projects/abbcc98684a04e1d9179523ef3500985/users/0630298199524ee682a94271cdc562b1/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:28.963269 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8872b-bbfc-4c15-9118-061fa8f59049 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:28.973044 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8872b-bbfc-4c15-9118-061fa8f59049 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:29.027578 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86408be3-c307-4838-9f9b-1964f3a24cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:29.028271 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86408be3-c307-4838-9f9b-1964f3a24cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:29.028553 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86408be3-c307-4838-9f9b-1964f3a24cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:29.029544 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86408be3-c307-4838-9f9b-1964f3a24cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:29.030435 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86408be3-c307-4838-9f9b-1964f3a24cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:29.032123 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86408be3-c307-4838-9f9b-1964f3a24cb3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:29.041735 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1391/2771] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:05:29.046570 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e5139-88c6-4dc9-aa88-8fad50a128e9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:29.057004 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e5139-88c6-4dc9-aa88-8fad50a128e9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:29.062212 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa7d22-936b-4ba0-9b51-379202572101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:29.063090 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa7d22-936b-4ba0-9b51-379202572101 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:29.063372 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa7d22-936b-4ba0-9b51-379202572101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:29.063673 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa7d22-936b-4ba0-9b51-379202572101 admin admin] PATH_INFO: `/v3/projects/abbcc98684a04e1d9179523ef3500985/users/0630298199524ee682a94271cdc562b1/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:29.065661 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa7d22-936b-4ba0-9b51-379202572101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abbcc98684a04e1d9179523ef3500985, user_id=0630298199524ee682a94271cdc562b1, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:29.068461 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa7d22-936b-4ba0-9b51-379202572101 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:29.079080 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1381/2772] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:05:29 2022] PUT /identity/v3/projects/abbcc98684a04e1d9179523ef3500985/users/0630298199524ee682a94271cdc562b1/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:29.660626 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a1a8a-26ee-430b-a9b2-8cc2e11697f9 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:29.660924 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a1a8a-26ee-430b-a9b2-8cc2e11697f9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:29.661210 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a1a8a-26ee-430b-a9b2-8cc2e11697f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:29.688099 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-695a1a8a-26ee-430b-a9b2-8cc2e11697f9 None None] MFA Rules not processed for user `0630298199524ee682a94271cdc562b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:29.689375 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-695a1a8a-26ee-430b-a9b2-8cc2e11697f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:29.756279 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1392/2773] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:29 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:30.733271 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa7d22-936b-4ba0-9b51-379202572101 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:30.793375 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa7d22-936b-4ba0-9b51-379202572101 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:30.797911 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711cedd-384a-48ac-9236-64a1b1f8208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:30.798781 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711cedd-384a-48ac-9236-64a1b1f8208d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:30.799065 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711cedd-384a-48ac-9236-64a1b1f8208d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:30.799349 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711cedd-384a-48ac-9236-64a1b1f8208d admin admin] PATH_INFO: `/v3/users/2bc9562c0c16482d9eabc195f9f8e61f` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:30.800552 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711cedd-384a-48ac-9236-64a1b1f8208d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc9562c0c16482d9eabc195f9f8e61f)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:30.802461 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711cedd-384a-48ac-9236-64a1b1f8208d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:30.847728 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d711cedd-384a-48ac-9236-64a1b1f8208d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc9562c0c16482d9eabc195f9f8e61f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:30.854319 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d711cedd-384a-48ac-9236-64a1b1f8208d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc9562c0c16482d9eabc195f9f8e61f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:30.861764 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d711cedd-384a-48ac-9236-64a1b1f8208d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc9562c0c16482d9eabc195f9f8e61f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:30.862398 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d711cedd-384a-48ac-9236-64a1b1f8208d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc9562c0c16482d9eabc195f9f8e61f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:30.862978 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-d711cedd-384a-48ac-9236-64a1b1f8208d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc9562c0c16482d9eabc195f9f8e61f'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:30.879485 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1382/2774] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:05:30 2022] DELETE /identity/v3/users/2bc9562c0c16482d9eabc195f9f8e61f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:31.047819 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a1a8a-26ee-430b-a9b2-8cc2e11697f9 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:31.058724 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a1a8a-26ee-430b-a9b2-8cc2e11697f9 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:31.120877 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f4096-e681-43cd-bc82-c77d640b4455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:31.121866 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f4096-e681-43cd-bc82-c77d640b4455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:31.122150 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f4096-e681-43cd-bc82-c77d640b4455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:31.122424 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f4096-e681-43cd-bc82-c77d640b4455 admin admin] PATH_INFO: `/v3/projects/fb41fa47c93a4087b454302d26a53d81` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:31.123589 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f4096-e681-43cd-bc82-c77d640b4455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb41fa47c93a4087b454302d26a53d81)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:31.125500 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f4096-e681-43cd-bc82-c77d640b4455 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:31.170137 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-268f4096-e681-43cd-bc82-c77d640b4455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb41fa47c93a4087b454302d26a53d81', 'request_id': 'req-268f4096-e681-43cd-bc82-c77d640b4455'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:31.176102 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-268f4096-e681-43cd-bc82-c77d640b4455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb41fa47c93a4087b454302d26a53d81', 'request_id': 'req-268f4096-e681-43cd-bc82-c77d640b4455'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:31.181792 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-268f4096-e681-43cd-bc82-c77d640b4455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb41fa47c93a4087b454302d26a53d81', 'request_id': 'req-268f4096-e681-43cd-bc82-c77d640b4455'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:31.193804 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-268f4096-e681-43cd-bc82-c77d640b4455 admin admin] The token cache is being invalidate because project fb41fa47c93a4087b454302d26a53d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:05:31.194092 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-268f4096-e681-43cd-bc82-c77d640b4455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:31.194718 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-268f4096-e681-43cd-bc82-c77d640b4455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:31.196318 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1393/2775] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:05:31 2022] DELETE /identity/v3/projects/fb41fa47c93a4087b454302d26a53d81 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 14:05:31.200448 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711cedd-384a-48ac-9236-64a1b1f8208d admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:31.201849 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d711cedd-384a-48ac-9236-64a1b1f8208d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:31.215150 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711cedd-384a-48ac-9236-64a1b1f8208d admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:31.269398 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e932b-9fe8-4b3d-9a65-f1298813cc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:31.270266 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e932b-9fe8-4b3d-9a65-f1298813cc01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:31.270547 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e932b-9fe8-4b3d-9a65-f1298813cc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:31.270819 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e932b-9fe8-4b3d-9a65-f1298813cc01 admin admin] PATH_INFO: `/v3/users/0630298199524ee682a94271cdc562b1` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:31.272039 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e932b-9fe8-4b3d-9a65-f1298813cc01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0630298199524ee682a94271cdc562b1)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:31.273961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e932b-9fe8-4b3d-9a65-f1298813cc01 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:31.318074 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ae3e932b-9fe8-4b3d-9a65-f1298813cc01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0630298199524ee682a94271cdc562b1'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:31.325596 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ae3e932b-9fe8-4b3d-9a65-f1298813cc01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0630298199524ee682a94271cdc562b1'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:31.332147 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ae3e932b-9fe8-4b3d-9a65-f1298813cc01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0630298199524ee682a94271cdc562b1'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:31.332759 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ae3e932b-9fe8-4b3d-9a65-f1298813cc01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0630298199524ee682a94271cdc562b1'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:31.333367 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ae3e932b-9fe8-4b3d-9a65-f1298813cc01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0630298199524ee682a94271cdc562b1'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:31.349730 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1383/2776] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:05:31 2022] DELETE /identity/v3/users/0630298199524ee682a94271cdc562b1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:31.518450 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f4096-e681-43cd-bc82-c77d640b4455 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:31.520232 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-268f4096-e681-43cd-bc82-c77d640b4455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:31.537464 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f4096-e681-43cd-bc82-c77d640b4455 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:31.593271 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6a16d-b150-448f-ac1a-0367629eae36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:31.594130 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6a16d-b150-448f-ac1a-0367629eae36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:31.594411 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6a16d-b150-448f-ac1a-0367629eae36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:31.594685 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6a16d-b150-448f-ac1a-0367629eae36 admin admin] PATH_INFO: `/v3/projects/abbcc98684a04e1d9179523ef3500985` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:31.595947 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6a16d-b150-448f-ac1a-0367629eae36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abbcc98684a04e1d9179523ef3500985)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:31.597853 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6a16d-b150-448f-ac1a-0367629eae36 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:31.642379 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-95c6a16d-b150-448f-ac1a-0367629eae36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abbcc98684a04e1d9179523ef3500985', 'request_id': 'req-95c6a16d-b150-448f-ac1a-0367629eae36'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:31.648588 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-95c6a16d-b150-448f-ac1a-0367629eae36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abbcc98684a04e1d9179523ef3500985', 'request_id': 'req-95c6a16d-b150-448f-ac1a-0367629eae36'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:31.655095 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-95c6a16d-b150-448f-ac1a-0367629eae36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abbcc98684a04e1d9179523ef3500985', 'request_id': 'req-95c6a16d-b150-448f-ac1a-0367629eae36'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:31.666911 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-95c6a16d-b150-448f-ac1a-0367629eae36 admin admin] The token cache is being invalidate because project abbcc98684a04e1d9179523ef3500985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:05:31.667197 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-95c6a16d-b150-448f-ac1a-0367629eae36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:31.667900 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-95c6a16d-b150-448f-ac1a-0367629eae36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:31.669484 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1394/2777] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:05:31 2022] DELETE /identity/v3/projects/abbcc98684a04e1d9179523ef3500985 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:31.674387 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f9376-5818-4f98-a22e-3deb438bb81a None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:31.674680 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f9376-5818-4f98-a22e-3deb438bb81a None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:31.674989 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f9376-5818-4f98-a22e-3deb438bb81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:31.692826 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-769f9376-5818-4f98-a22e-3deb438bb81a None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:31.694068 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-769f9376-5818-4f98-a22e-3deb438bb81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:31.750740 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1384/2778] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 14:05:31.759649 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42e60e-944f-4d26-a575-06bde4fa54d0 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:31.759957 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42e60e-944f-4d26-a575-06bde4fa54d0 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:31.760238 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42e60e-944f-4d26-a575-06bde4fa54d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:31.778873 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-8e42e60e-944f-4d26-a575-06bde4fa54d0 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:31.780110 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8e42e60e-944f-4d26-a575-06bde4fa54d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:31.788061 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1395/2779] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:31.792252 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f9376-5818-4f98-a22e-3deb438bb81a None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:31.802214 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f9376-5818-4f98-a22e-3deb438bb81a None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:31.806781 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a0849-8edf-481c-991f-ca9ad5cc90b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:31.807425 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a0849-8edf-481c-991f-ca9ad5cc90b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:31.807748 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a0849-8edf-481c-991f-ca9ad5cc90b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:31.808025 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a0849-8edf-481c-991f-ca9ad5cc90b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:31.809243 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a0849-8edf-481c-991f-ca9ad5cc90b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 14:05:31.809542 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a0849-8edf-481c-991f-ca9ad5cc90b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:31.811129 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2a0849-8edf-481c-991f-ca9ad5cc90b9 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:31.822263 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1385/2780] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 14:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 14:05:31.827343 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42e60e-944f-4d26-a575-06bde4fa54d0 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:31.836587 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42e60e-944f-4d26-a575-06bde4fa54d0 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:31.841225 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d52e29-c962-4717-ac01-a86f06a6be6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:31.841867 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d52e29-c962-4717-ac01-a86f06a6be6e admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:31.842151 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d52e29-c962-4717-ac01-a86f06a6be6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:31.842430 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d52e29-c962-4717-ac01-a86f06a6be6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:31.843139 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d52e29-c962-4717-ac01-a86f06a6be6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:31.845062 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d52e29-c962-4717-ac01-a86f06a6be6e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:31.870652 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1396/2781] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:05:31 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:05:31.875501 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a0849-8edf-481c-991f-ca9ad5cc90b9 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:31.885266 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a0849-8edf-481c-991f-ca9ad5cc90b9 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:31.939247 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ca511-a87c-454c-8ca0-359fafa7c276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:31.939957 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ca511-a87c-454c-8ca0-359fafa7c276 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:31.940264 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ca511-a87c-454c-8ca0-359fafa7c276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:31.940538 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ca511-a87c-454c-8ca0-359fafa7c276 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:31.941228 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ca511-a87c-454c-8ca0-359fafa7c276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:31.943190 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ca511-a87c-454c-8ca0-359fafa7c276 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:31.962508 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1386/2782] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:05:31 2022] POST /identity/v3/users => generated 283 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:05:31.966699 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d52e29-c962-4717-ac01-a86f06a6be6e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:31.976704 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d52e29-c962-4717-ac01-a86f06a6be6e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:31.981489 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85081c-454f-4adf-9add-0a7d1923f754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:31.982141 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85081c-454f-4adf-9add-0a7d1923f754 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:31.982423 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85081c-454f-4adf-9add-0a7d1923f754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:31.982701 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85081c-454f-4adf-9add-0a7d1923f754 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:31.983418 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85081c-454f-4adf-9add-0a7d1923f754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:31.985051 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85081c-454f-4adf-9add-0a7d1923f754 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:31.995227 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1397/2783] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:05:31.999667 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ca511-a87c-454c-8ca0-359fafa7c276 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:32.009512 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ca511-a87c-454c-8ca0-359fafa7c276 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:32.015133 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05caed-9970-48c7-98c2-8b3d2657af16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:32.015832 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05caed-9970-48c7-98c2-8b3d2657af16 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:32.016146 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05caed-9970-48c7-98c2-8b3d2657af16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:32.016437 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05caed-9970-48c7-98c2-8b3d2657af16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:32.017207 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05caed-9970-48c7-98c2-8b3d2657af16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:32.018801 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05caed-9970-48c7-98c2-8b3d2657af16 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:32.029420 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1387/2784] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:05:32.034161 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85081c-454f-4adf-9add-0a7d1923f754 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:32.044698 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85081c-454f-4adf-9add-0a7d1923f754 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:32.049321 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6255078-a20e-40b7-ad32-01683f25bf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:32.050197 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6255078-a20e-40b7-ad32-01683f25bf68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:32.050481 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6255078-a20e-40b7-ad32-01683f25bf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:32.050763 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6255078-a20e-40b7-ad32-01683f25bf68 admin admin] PATH_INFO: `/v3/projects/27d52895075440c28bc886b7a11613d1/users/cb7c3644e66c4e0090c396eb213fa997/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:32.065635 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6255078-a20e-40b7-ad32-01683f25bf68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d52895075440c28bc886b7a11613d1, user_id=cb7c3644e66c4e0090c396eb213fa997, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:32.068318 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6255078-a20e-40b7-ad32-01683f25bf68 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:32.081531 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1398/2785] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:05:32 2022] PUT /identity/v3/projects/27d52895075440c28bc886b7a11613d1/users/cb7c3644e66c4e0090c396eb213fa997/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:32.092610 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef2a12-025c-46c5-b4c5-d1be815adda4 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:32.092897 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef2a12-025c-46c5-b4c5-d1be815adda4 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:32.093178 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef2a12-025c-46c5-b4c5-d1be815adda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:32.118046 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-fcef2a12-025c-46c5-b4c5-d1be815adda4 None None] MFA Rules not processed for user `cb7c3644e66c4e0090c396eb213fa997`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:32.119239 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fcef2a12-025c-46c5-b4c5-d1be815adda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:32.179878 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1388/2786] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:32.184795 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6255078-a20e-40b7-ad32-01683f25bf68 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:32.243418 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6255078-a20e-40b7-ad32-01683f25bf68 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:32.247989 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4901e-0e6b-4e23-980b-f356be84cf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:32.248633 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4901e-0e6b-4e23-980b-f356be84cf12 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:32.248911 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4901e-0e6b-4e23-980b-f356be84cf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:32.249184 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4901e-0e6b-4e23-980b-f356be84cf12 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:32.249867 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4901e-0e6b-4e23-980b-f356be84cf12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:32.251801 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4901e-0e6b-4e23-980b-f356be84cf12 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:32.276083 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1399/2787] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:05:32 2022] POST /identity/v3/projects => generated 365 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:05:32.280644 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef2a12-025c-46c5-b4c5-d1be815adda4 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:32.291358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef2a12-025c-46c5-b4c5-d1be815adda4 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:32.344958 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93e8e0-f50a-424f-be1f-fd869691de56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:32.345620 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93e8e0-f50a-424f-be1f-fd869691de56 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:32.345902 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93e8e0-f50a-424f-be1f-fd869691de56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:32.346174 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93e8e0-f50a-424f-be1f-fd869691de56 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:32.346848 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93e8e0-f50a-424f-be1f-fd869691de56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:32.348798 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93e8e0-f50a-424f-be1f-fd869691de56 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:32.368606 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1389/2788] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:05:32 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:05:32.373149 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4901e-0e6b-4e23-980b-f356be84cf12 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:32.383441 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4901e-0e6b-4e23-980b-f356be84cf12 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:32.400123 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f18cd-69bb-493a-a075-c66493678903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:32.401043 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f18cd-69bb-493a-a075-c66493678903 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:32.401331 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f18cd-69bb-493a-a075-c66493678903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:32.401610 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f18cd-69bb-493a-a075-c66493678903 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:32.402366 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f18cd-69bb-493a-a075-c66493678903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:32.404068 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f18cd-69bb-493a-a075-c66493678903 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:32.415835 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1400/2789] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:05:32.420549 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93e8e0-f50a-424f-be1f-fd869691de56 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:32.430482 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93e8e0-f50a-424f-be1f-fd869691de56 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:32.435693 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974120d5-9372-42b3-bb2a-d29632a4f4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:32.436568 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974120d5-9372-42b3-bb2a-d29632a4f4d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:32.436851 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974120d5-9372-42b3-bb2a-d29632a4f4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:32.437124 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974120d5-9372-42b3-bb2a-d29632a4f4d3 admin admin] PATH_INFO: `/v3/projects/8297019ecb3541c1afdcd29e55c2497b/users/e105b8842ce64b60b21e601d097ae317/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:32.451155 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974120d5-9372-42b3-bb2a-d29632a4f4d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8297019ecb3541c1afdcd29e55c2497b, user_id=e105b8842ce64b60b21e601d097ae317, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:32.453833 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974120d5-9372-42b3-bb2a-d29632a4f4d3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:32.468088 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1390/2790] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:05:32 2022] PUT /identity/v3/projects/8297019ecb3541c1afdcd29e55c2497b/users/e105b8842ce64b60b21e601d097ae317/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:32.471979 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f18cd-69bb-493a-a075-c66493678903 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:32.482870 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f18cd-69bb-493a-a075-c66493678903 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:32.537786 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d13e6-0bca-4093-9271-87c92183f7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:32.538383 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d13e6-0bca-4093-9271-87c92183f7de admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:32.538667 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d13e6-0bca-4093-9271-87c92183f7de admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:32.538944 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d13e6-0bca-4093-9271-87c92183f7de admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:32.539704 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d13e6-0bca-4093-9271-87c92183f7de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:32.541307 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d13e6-0bca-4093-9271-87c92183f7de admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:32.551858 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1401/2791] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:05:32.555723 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974120d5-9372-42b3-bb2a-d29632a4f4d3 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:32.566624 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974120d5-9372-42b3-bb2a-d29632a4f4d3 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:32.572585 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2499e9e-b486-491a-9d60-dc914b5fc155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:32.573577 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2499e9e-b486-491a-9d60-dc914b5fc155 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:32.573859 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2499e9e-b486-491a-9d60-dc914b5fc155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:32.574308 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2499e9e-b486-491a-9d60-dc914b5fc155 admin admin] PATH_INFO: `/v3/projects/8297019ecb3541c1afdcd29e55c2497b/users/e105b8842ce64b60b21e601d097ae317/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:32.576507 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2499e9e-b486-491a-9d60-dc914b5fc155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8297019ecb3541c1afdcd29e55c2497b, user_id=e105b8842ce64b60b21e601d097ae317, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:32.579208 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2499e9e-b486-491a-9d60-dc914b5fc155 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:32.589420 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1391/2792] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:05:32 2022] PUT /identity/v3/projects/8297019ecb3541c1afdcd29e55c2497b/users/e105b8842ce64b60b21e601d097ae317/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:32.601130 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab51df-73ae-4db4-83dd-b180aa30c7de None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:32.601419 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab51df-73ae-4db4-83dd-b180aa30c7de None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:32.601698 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab51df-73ae-4db4-83dd-b180aa30c7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:32.627163 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-6fab51df-73ae-4db4-83dd-b180aa30c7de None None] MFA Rules not processed for user `e105b8842ce64b60b21e601d097ae317`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:32.628371 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6fab51df-73ae-4db4-83dd-b180aa30c7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:32.691997 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1402/2793] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:32.703005 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2499e9e-b486-491a-9d60-dc914b5fc155 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:32.704857 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-f2499e9e-b486-491a-9d60-dc914b5fc155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:32.760296 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2499e9e-b486-491a-9d60-dc914b5fc155 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:32.764040 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d0cf6-806e-41c8-b464-057d9e38ee72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:32.764701 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d0cf6-806e-41c8-b464-057d9e38ee72 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:32.764977 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d0cf6-806e-41c8-b464-057d9e38ee72 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:32.765248 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d0cf6-806e-41c8-b464-057d9e38ee72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:32.773874 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d0cf6-806e-41c8-b464-057d9e38ee72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:32.775292 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d0cf6-806e-41c8-b464-057d9e38ee72 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:32.785256 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1392/2794] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:05:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:05:32.859313 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab51df-73ae-4db4-83dd-b180aa30c7de None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:32.868868 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab51df-73ae-4db4-83dd-b180aa30c7de None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:32.872622 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ca917-1cc1-42c8-880f-809179f294b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:32.873262 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ca917-1cc1-42c8-880f-809179f294b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:32.873546 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ca917-1cc1-42c8-880f-809179f294b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:32.873826 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ca917-1cc1-42c8-880f-809179f294b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:32.928306 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ca917-1cc1-42c8-880f-809179f294b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:32.929782 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ca917-1cc1-42c8-880f-809179f294b8 service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:32.938734 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1403/2795] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:05:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:05:35.606961 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d0cf6-806e-41c8-b464-057d9e38ee72 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:35.666671 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d0cf6-806e-41c8-b464-057d9e38ee72 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:35.672000 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44644226-bcc6-46a5-9a8f-5e0b9885f8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:35.672863 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44644226-bcc6-46a5-9a8f-5e0b9885f8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:35.673148 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44644226-bcc6-46a5-9a8f-5e0b9885f8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:35.673424 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44644226-bcc6-46a5-9a8f-5e0b9885f8a4 admin admin] PATH_INFO: `/v3/users/cb7c3644e66c4e0090c396eb213fa997` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:35.674596 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44644226-bcc6-46a5-9a8f-5e0b9885f8a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb7c3644e66c4e0090c396eb213fa997)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:35.676551 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44644226-bcc6-46a5-9a8f-5e0b9885f8a4 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:35.722907 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-44644226-bcc6-46a5-9a8f-5e0b9885f8a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb7c3644e66c4e0090c396eb213fa997'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:35.730109 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-44644226-bcc6-46a5-9a8f-5e0b9885f8a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb7c3644e66c4e0090c396eb213fa997'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:35.737568 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-44644226-bcc6-46a5-9a8f-5e0b9885f8a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb7c3644e66c4e0090c396eb213fa997'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:35.738213 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-44644226-bcc6-46a5-9a8f-5e0b9885f8a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb7c3644e66c4e0090c396eb213fa997'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:35.738817 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-44644226-bcc6-46a5-9a8f-5e0b9885f8a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb7c3644e66c4e0090c396eb213fa997'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:35.755833 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1393/2796] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:05:35 2022] DELETE /identity/v3/users/cb7c3644e66c4e0090c396eb213fa997 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 14:05:35.760403 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e71d8-7845-4fef-9077-f1d6c478176b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:35.760898 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e71d8-7845-4fef-9077-f1d6c478176b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:35.761010 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e71d8-7845-4fef-9077-f1d6c478176b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:35.779246 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-764e71d8-7845-4fef-9077-f1d6c478176b None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:35.780475 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-764e71d8-7845-4fef-9077-f1d6c478176b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:35.837484 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1404/2797] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:35.847819 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44644226-bcc6-46a5-9a8f-5e0b9885f8a4 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:35.849229 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-44644226-bcc6-46a5-9a8f-5e0b9885f8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:35.905329 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44644226-bcc6-46a5-9a8f-5e0b9885f8a4 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:35.908953 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacf66b-0a15-4c22-9935-532c595a463b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:35.909592 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacf66b-0a15-4c22-9935-532c595a463b service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:35.909874 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacf66b-0a15-4c22-9935-532c595a463b service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:35.910150 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacf66b-0a15-4c22-9935-532c595a463b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:35.919214 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacf66b-0a15-4c22-9935-532c595a463b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:35.920600 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aacf66b-0a15-4c22-9935-532c595a463b service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:35.929749 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1394/2798] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:05:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:05:36.187870 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e71d8-7845-4fef-9077-f1d6c478176b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:36.189299 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-764e71d8-7845-4fef-9077-f1d6c478176b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:36.201080 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e71d8-7845-4fef-9077-f1d6c478176b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:36.206210 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc4089-cc79-4397-b485-744d66ae0508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:36.207076 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc4089-cc79-4397-b485-744d66ae0508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:36.207385 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc4089-cc79-4397-b485-744d66ae0508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:36.207686 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc4089-cc79-4397-b485-744d66ae0508 admin admin] PATH_INFO: `/v3/projects/27d52895075440c28bc886b7a11613d1` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:36.209242 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc4089-cc79-4397-b485-744d66ae0508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d52895075440c28bc886b7a11613d1)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:36.211179 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc4089-cc79-4397-b485-744d66ae0508 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:36.255969 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-08bc4089-cc79-4397-b485-744d66ae0508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d52895075440c28bc886b7a11613d1', 'request_id': 'req-08bc4089-cc79-4397-b485-744d66ae0508'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:36.261914 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-08bc4089-cc79-4397-b485-744d66ae0508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d52895075440c28bc886b7a11613d1', 'request_id': 'req-08bc4089-cc79-4397-b485-744d66ae0508'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:36.267850 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-08bc4089-cc79-4397-b485-744d66ae0508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d52895075440c28bc886b7a11613d1', 'request_id': 'req-08bc4089-cc79-4397-b485-744d66ae0508'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:36.279700 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-08bc4089-cc79-4397-b485-744d66ae0508 admin admin] The token cache is being invalidate because project 27d52895075440c28bc886b7a11613d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:05:36.279991 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-08bc4089-cc79-4397-b485-744d66ae0508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:36.280608 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-08bc4089-cc79-4397-b485-744d66ae0508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:36.282150 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1405/2799] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:05:36 2022] DELETE /identity/v3/projects/27d52895075440c28bc886b7a11613d1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:36.286115 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacf66b-0a15-4c22-9935-532c595a463b service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:36.295576 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacf66b-0a15-4c22-9935-532c595a463b service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:36.350189 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272b59f-2611-4575-af34-65bb8e306ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:36.351057 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272b59f-2611-4575-af34-65bb8e306ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:36.351335 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272b59f-2611-4575-af34-65bb8e306ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:36.351605 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272b59f-2611-4575-af34-65bb8e306ea3 admin admin] PATH_INFO: `/v3/users/e105b8842ce64b60b21e601d097ae317` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:36.352816 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272b59f-2611-4575-af34-65bb8e306ea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e105b8842ce64b60b21e601d097ae317)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:36.354740 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272b59f-2611-4575-af34-65bb8e306ea3 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:36.401245 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b272b59f-2611-4575-af34-65bb8e306ea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e105b8842ce64b60b21e601d097ae317'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:36.408107 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b272b59f-2611-4575-af34-65bb8e306ea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e105b8842ce64b60b21e601d097ae317'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:36.415002 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b272b59f-2611-4575-af34-65bb8e306ea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e105b8842ce64b60b21e601d097ae317'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:36.415600 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b272b59f-2611-4575-af34-65bb8e306ea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e105b8842ce64b60b21e601d097ae317'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:36.416227 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-b272b59f-2611-4575-af34-65bb8e306ea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e105b8842ce64b60b21e601d097ae317'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:36.433203 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1395/2800] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:05:36 2022] DELETE /identity/v3/users/e105b8842ce64b60b21e601d097ae317 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:36.693123 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc4089-cc79-4397-b485-744d66ae0508 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:36.694545 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-08bc4089-cc79-4397-b485-744d66ae0508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:36.709063 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc4089-cc79-4397-b485-744d66ae0508 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:36.764537 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad02c6e-a6a7-4292-a409-7bb2280a362e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:36.765427 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad02c6e-a6a7-4292-a409-7bb2280a362e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:36.765710 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad02c6e-a6a7-4292-a409-7bb2280a362e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:36.765990 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad02c6e-a6a7-4292-a409-7bb2280a362e admin admin] PATH_INFO: `/v3/projects/8297019ecb3541c1afdcd29e55c2497b` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:36.767167 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad02c6e-a6a7-4292-a409-7bb2280a362e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8297019ecb3541c1afdcd29e55c2497b)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:36.769104 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad02c6e-a6a7-4292-a409-7bb2280a362e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:36.813440 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1ad02c6e-a6a7-4292-a409-7bb2280a362e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8297019ecb3541c1afdcd29e55c2497b', 'request_id': 'req-1ad02c6e-a6a7-4292-a409-7bb2280a362e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:36.819458 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1ad02c6e-a6a7-4292-a409-7bb2280a362e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8297019ecb3541c1afdcd29e55c2497b', 'request_id': 'req-1ad02c6e-a6a7-4292-a409-7bb2280a362e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:36.824792 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1ad02c6e-a6a7-4292-a409-7bb2280a362e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8297019ecb3541c1afdcd29e55c2497b', 'request_id': 'req-1ad02c6e-a6a7-4292-a409-7bb2280a362e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:36.836319 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1ad02c6e-a6a7-4292-a409-7bb2280a362e admin admin] The token cache is being invalidate because project 8297019ecb3541c1afdcd29e55c2497b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:05:36.836604 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1ad02c6e-a6a7-4292-a409-7bb2280a362e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:36.837211 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1ad02c6e-a6a7-4292-a409-7bb2280a362e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:36.838719 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1406/2801] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:05:36 2022] DELETE /identity/v3/projects/8297019ecb3541c1afdcd29e55c2497b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:36.843665 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99000e5-8273-4609-9e9a-d386723550df None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:36.844145 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99000e5-8273-4609-9e9a-d386723550df None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:36.844242 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99000e5-8273-4609-9e9a-d386723550df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:36.863131 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-c99000e5-8273-4609-9e9a-d386723550df None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:36.864465 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-c99000e5-8273-4609-9e9a-d386723550df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:36.922711 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1396/2802] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:36.930569 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ea09d-73e6-4eb6-a82f-c1607f63ffe9 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:36.930859 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ea09d-73e6-4eb6-a82f-c1607f63ffe9 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:36.931142 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ea09d-73e6-4eb6-a82f-c1607f63ffe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:36.950079 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-604ea09d-73e6-4eb6-a82f-c1607f63ffe9 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:36.951257 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-604ea09d-73e6-4eb6-a82f-c1607f63ffe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:36.959150 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1407/2803] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:36.963234 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99000e5-8273-4609-9e9a-d386723550df None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:36.973380 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99000e5-8273-4609-9e9a-d386723550df None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:36.977912 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23ddbf-1dfa-4a20-bd49-89dfb729290d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:36.978559 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23ddbf-1dfa-4a20-bd49-89dfb729290d admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:36.978960 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23ddbf-1dfa-4a20-bd49-89dfb729290d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:36.979240 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23ddbf-1dfa-4a20-bd49-89dfb729290d admin admin] PATH_INFO: `/v3/domains` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:36.980004 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23ddbf-1dfa-4a20-bd49-89dfb729290d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79786) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 14:05:36.980310 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23ddbf-1dfa-4a20-bd49-89dfb729290d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:36.982615 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23ddbf-1dfa-4a20-bd49-89dfb729290d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:36.993646 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1397/2804] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 14:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 14:05:36.997848 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ea09d-73e6-4eb6-a82f-c1607f63ffe9 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:37.006845 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ea09d-73e6-4eb6-a82f-c1607f63ffe9 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:37.011501 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66440b-229b-4985-be3b-bbe9b15efffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:37.012194 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66440b-229b-4985-be3b-bbe9b15efffc admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:37.012559 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66440b-229b-4985-be3b-bbe9b15efffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:37.012841 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66440b-229b-4985-be3b-bbe9b15efffc admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:37.013558 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66440b-229b-4985-be3b-bbe9b15efffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:37.015458 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66440b-229b-4985-be3b-bbe9b15efffc admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:37.040409 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1408/2805] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:05:36 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:05:37.045140 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23ddbf-1dfa-4a20-bd49-89dfb729290d admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:37.054820 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23ddbf-1dfa-4a20-bd49-89dfb729290d admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:37.109999 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6dd1b-34b5-4e8c-a816-898634f92b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:37.110665 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6dd1b-34b5-4e8c-a816-898634f92b1e admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:37.110948 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6dd1b-34b5-4e8c-a816-898634f92b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:37.111252 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6dd1b-34b5-4e8c-a816-898634f92b1e admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:37.111968 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6dd1b-34b5-4e8c-a816-898634f92b1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:37.113885 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6dd1b-34b5-4e8c-a816-898634f92b1e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:37.132530 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1398/2806] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:05:37 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:05:37.136675 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66440b-229b-4985-be3b-bbe9b15efffc admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:37.146812 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66440b-229b-4985-be3b-bbe9b15efffc admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:37.151420 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9447e-a9b1-4308-8a28-5a2cc565641f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:37.152357 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9447e-a9b1-4308-8a28-5a2cc565641f admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:37.152642 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9447e-a9b1-4308-8a28-5a2cc565641f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:37.153460 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9447e-a9b1-4308-8a28-5a2cc565641f admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:37.154186 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9447e-a9b1-4308-8a28-5a2cc565641f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:37.155814 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9447e-a9b1-4308-8a28-5a2cc565641f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:37.165874 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1409/2807] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:05:37.170153 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6dd1b-34b5-4e8c-a816-898634f92b1e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:37.179922 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6dd1b-34b5-4e8c-a816-898634f92b1e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:37.185862 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf21eaa-84df-4882-84aa-6c89bd67da15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:37.186516 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf21eaa-84df-4882-84aa-6c89bd67da15 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:37.186800 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf21eaa-84df-4882-84aa-6c89bd67da15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:37.187074 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf21eaa-84df-4882-84aa-6c89bd67da15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:37.187863 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf21eaa-84df-4882-84aa-6c89bd67da15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:37.189519 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf21eaa-84df-4882-84aa-6c89bd67da15 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:37.199296 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1399/2808] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:05:37.203412 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9447e-a9b1-4308-8a28-5a2cc565641f admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:37.213046 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9447e-a9b1-4308-8a28-5a2cc565641f admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:37.218369 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330e93f-2a31-4355-bf2c-670ca84ce6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:37.219239 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330e93f-2a31-4355-bf2c-670ca84ce6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:37.219520 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330e93f-2a31-4355-bf2c-670ca84ce6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:37.219841 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330e93f-2a31-4355-bf2c-670ca84ce6ea admin admin] PATH_INFO: `/v3/projects/7ce5287a6a44409d9e2a464e69d6c297/users/a5b36485e3874a4fa4e50c4c9dfc4dae/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:37.235548 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330e93f-2a31-4355-bf2c-670ca84ce6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce5287a6a44409d9e2a464e69d6c297, user_id=a5b36485e3874a4fa4e50c4c9dfc4dae, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:37.238222 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330e93f-2a31-4355-bf2c-670ca84ce6ea admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:37.250657 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1410/2809] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:05:37 2022] PUT /identity/v3/projects/7ce5287a6a44409d9e2a464e69d6c297/users/a5b36485e3874a4fa4e50c4c9dfc4dae/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 14:05:37.260907 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49ad90-cd70-4551-b187-b2b008fa0ab9 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:37.261197 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49ad90-cd70-4551-b187-b2b008fa0ab9 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:37.261478 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49ad90-cd70-4551-b187-b2b008fa0ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:37.287662 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-ed49ad90-cd70-4551-b187-b2b008fa0ab9 None None] MFA Rules not processed for user `a5b36485e3874a4fa4e50c4c9dfc4dae`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:37.288862 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ed49ad90-cd70-4551-b187-b2b008fa0ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:37.350299 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1400/2810] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 14:05:37.354783 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330e93f-2a31-4355-bf2c-670ca84ce6ea admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:37.414866 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330e93f-2a31-4355-bf2c-670ca84ce6ea admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:37.419712 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809868ea-9d84-40b2-8d77-8c0ea8788957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:37.420372 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809868ea-9d84-40b2-8d77-8c0ea8788957 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:37.420655 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809868ea-9d84-40b2-8d77-8c0ea8788957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:37.420933 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809868ea-9d84-40b2-8d77-8c0ea8788957 admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:37.421629 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809868ea-9d84-40b2-8d77-8c0ea8788957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:37.423555 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809868ea-9d84-40b2-8d77-8c0ea8788957 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:37.447157 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1411/2811] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:05:37 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:05:37.451891 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49ad90-cd70-4551-b187-b2b008fa0ab9 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:37.462612 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49ad90-cd70-4551-b187-b2b008fa0ab9 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:37.516167 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84b04a-1f59-477a-910a-8041211aa5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:37.516832 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84b04a-1f59-477a-910a-8041211aa5b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:37.517116 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84b04a-1f59-477a-910a-8041211aa5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:37.517390 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84b04a-1f59-477a-910a-8041211aa5b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:37.518079 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84b04a-1f59-477a-910a-8041211aa5b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:37.520044 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84b04a-1f59-477a-910a-8041211aa5b5 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:37.540347 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1401/2812] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:05:37 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:05:37.544753 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809868ea-9d84-40b2-8d77-8c0ea8788957 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:37.554801 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809868ea-9d84-40b2-8d77-8c0ea8788957 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:37.559859 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d7ae1-294b-4ac3-b190-da19c554a19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:37.560522 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d7ae1-294b-4ac3-b190-da19c554a19f admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:37.560810 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d7ae1-294b-4ac3-b190-da19c554a19f admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:37.561092 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d7ae1-294b-4ac3-b190-da19c554a19f admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:37.561821 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d7ae1-294b-4ac3-b190-da19c554a19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:37.563402 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d7ae1-294b-4ac3-b190-da19c554a19f admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:37.573750 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1412/2813] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:05:37.578152 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84b04a-1f59-477a-910a-8041211aa5b5 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:37.587894 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84b04a-1f59-477a-910a-8041211aa5b5 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:37.593147 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54793c2-84cd-467c-a064-57805531088b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:37.593802 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54793c2-84cd-467c-a064-57805531088b admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:37.594086 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54793c2-84cd-467c-a064-57805531088b admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:37.594365 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54793c2-84cd-467c-a064-57805531088b admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:37.595125 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54793c2-84cd-467c-a064-57805531088b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:37.596751 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54793c2-84cd-467c-a064-57805531088b admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:37.606331 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1402/2814] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:05:37.610210 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d7ae1-294b-4ac3-b190-da19c554a19f admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:37.620156 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d7ae1-294b-4ac3-b190-da19c554a19f admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:37.624691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bc990-6f9f-4a2b-befc-d3ccce1445b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:37.625559 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bc990-6f9f-4a2b-befc-d3ccce1445b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:37.625842 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bc990-6f9f-4a2b-befc-d3ccce1445b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:37.626121 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bc990-6f9f-4a2b-befc-d3ccce1445b8 admin admin] PATH_INFO: `/v3/projects/0d5402b2d9c341f6b4561cfe263f5420/users/467ec0b94992494cab10fc72f72d1b27/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:37.641545 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bc990-6f9f-4a2b-befc-d3ccce1445b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5402b2d9c341f6b4561cfe263f5420, user_id=467ec0b94992494cab10fc72f72d1b27, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:37.644692 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bc990-6f9f-4a2b-befc-d3ccce1445b8 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:37.657502 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1413/2815] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:05:37 2022] PUT /identity/v3/projects/0d5402b2d9c341f6b4561cfe263f5420/users/467ec0b94992494cab10fc72f72d1b27/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 14:05:37.668678 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8603a-06fa-4f02-b3c5-39c78fc5e669 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:37.669114 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8603a-06fa-4f02-b3c5-39c78fc5e669 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:37.669524 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8603a-06fa-4f02-b3c5-39c78fc5e669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:37.695460 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-dee8603a-06fa-4f02-b3c5-39c78fc5e669 None None] MFA Rules not processed for user `467ec0b94992494cab10fc72f72d1b27`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:37.696713 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-dee8603a-06fa-4f02-b3c5-39c78fc5e669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:37.758730 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1403/2816] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:37.763889 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bc990-6f9f-4a2b-befc-d3ccce1445b8 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:37.822573 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bc990-6f9f-4a2b-befc-d3ccce1445b8 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:37.827917 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99827a-4b3b-40a7-946c-28b8d993fbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:37.828576 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99827a-4b3b-40a7-946c-28b8d993fbab admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:37.828960 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99827a-4b3b-40a7-946c-28b8d993fbab admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:37.829243 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99827a-4b3b-40a7-946c-28b8d993fbab admin admin] PATH_INFO: `/v3/projects` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:37.829926 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99827a-4b3b-40a7-946c-28b8d993fbab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:37.831854 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99827a-4b3b-40a7-946c-28b8d993fbab admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:37.855699 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1414/2817] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:05:37 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 14:05:37.860290 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8603a-06fa-4f02-b3c5-39c78fc5e669 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:37.870764 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8603a-06fa-4f02-b3c5-39c78fc5e669 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:37.924502 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebca7de-7374-4311-a701-8eb4d1120df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:37.925187 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebca7de-7374-4311-a701-8eb4d1120df7 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:37.925455 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebca7de-7374-4311-a701-8eb4d1120df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:37.925733 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebca7de-7374-4311-a701-8eb4d1120df7 admin admin] PATH_INFO: `/v3/users` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:37.926414 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebca7de-7374-4311-a701-8eb4d1120df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:37.928393 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebca7de-7374-4311-a701-8eb4d1120df7 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:37.947497 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1404/2818] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:05:37 2022] POST /identity/v3/users => generated 299 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 14:05:37.952474 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99827a-4b3b-40a7-946c-28b8d993fbab admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:37.962792 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99827a-4b3b-40a7-946c-28b8d993fbab admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:37.967397 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd2969-5983-4049-9fb5-5400fe629693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:37.968090 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd2969-5983-4049-9fb5-5400fe629693 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:37.968378 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd2969-5983-4049-9fb5-5400fe629693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:37.968658 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd2969-5983-4049-9fb5-5400fe629693 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:37.969383 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd2969-5983-4049-9fb5-5400fe629693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:37.970977 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd2969-5983-4049-9fb5-5400fe629693 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:37.982421 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1415/2819] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:05:37.986658 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebca7de-7374-4311-a701-8eb4d1120df7 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:37.996499 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebca7de-7374-4311-a701-8eb4d1120df7 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:38.002046 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34e4dd-dc58-4ecd-beea-8fc73cf2906f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:38.002943 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34e4dd-dc58-4ecd-beea-8fc73cf2906f admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:38.003253 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34e4dd-dc58-4ecd-beea-8fc73cf2906f admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:38.003564 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34e4dd-dc58-4ecd-beea-8fc73cf2906f admin admin] PATH_INFO: `/v3/projects/1e189f5049104cfbb7581bcf824f6963/users/61931e610ac24d1592be7747fb108eea/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:38.020056 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34e4dd-dc58-4ecd-beea-8fc73cf2906f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e189f5049104cfbb7581bcf824f6963, user_id=61931e610ac24d1592be7747fb108eea, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:38.022676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34e4dd-dc58-4ecd-beea-8fc73cf2906f admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:38.038909 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1405/2820] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:05:37 2022] PUT /identity/v3/projects/1e189f5049104cfbb7581bcf824f6963/users/61931e610ac24d1592be7747fb108eea/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:38.042701 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd2969-5983-4049-9fb5-5400fe629693 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:38.054127 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd2969-5983-4049-9fb5-5400fe629693 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:38.111511 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4170a-d5d5-4b59-a3d7-0d790f4c4b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:38.112211 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4170a-d5d5-4b59-a3d7-0d790f4c4b20 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:38.112499 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4170a-d5d5-4b59-a3d7-0d790f4c4b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:38.112777 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4170a-d5d5-4b59-a3d7-0d790f4c4b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:38.113509 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4170a-d5d5-4b59-a3d7-0d790f4c4b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:38.115244 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4170a-d5d5-4b59-a3d7-0d790f4c4b20 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:38.125810 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1416/2821] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:05:38.129720 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34e4dd-dc58-4ecd-beea-8fc73cf2906f admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:38.140040 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34e4dd-dc58-4ecd-beea-8fc73cf2906f admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:38.144699 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866ee0c-b97b-4864-8eb5-c3f32aea8c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:38.145589 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866ee0c-b97b-4864-8eb5-c3f32aea8c95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:38.145875 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866ee0c-b97b-4864-8eb5-c3f32aea8c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:38.146540 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866ee0c-b97b-4864-8eb5-c3f32aea8c95 admin admin] PATH_INFO: `/v3/projects/1e189f5049104cfbb7581bcf824f6963/users/61931e610ac24d1592be7747fb108eea/roles/e3333fcf22b040e3a1f0bfbfe657cffa` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:38.148173 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866ee0c-b97b-4864-8eb5-c3f32aea8c95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e189f5049104cfbb7581bcf824f6963, user_id=61931e610ac24d1592be7747fb108eea, role_id=e3333fcf22b040e3a1f0bfbfe657cffa)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:38.150823 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866ee0c-b97b-4864-8eb5-c3f32aea8c95 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:38.161473 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1406/2822] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:05:38 2022] PUT /identity/v3/projects/1e189f5049104cfbb7581bcf824f6963/users/61931e610ac24d1592be7747fb108eea/roles/e3333fcf22b040e3a1f0bfbfe657cffa => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:38.172325 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef22330-42cc-4428-bd03-543660f9e14d None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:38.172691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef22330-42cc-4428-bd03-543660f9e14d None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:38.173039 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef22330-42cc-4428-bd03-543660f9e14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:38.199622 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-eef22330-42cc-4428-bd03-543660f9e14d None None] MFA Rules not processed for user `61931e610ac24d1592be7747fb108eea`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:38.201492 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-eef22330-42cc-4428-bd03-543660f9e14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:38.270760 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1417/2823] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:38.281942 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866ee0c-b97b-4864-8eb5-c3f32aea8c95 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:38.283734 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7866ee0c-b97b-4864-8eb5-c3f32aea8c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:38.341107 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866ee0c-b97b-4864-8eb5-c3f32aea8c95 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:38.344844 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c0187-9b05-4865-afbf-83fcef757a15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:38.345505 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c0187-9b05-4865-afbf-83fcef757a15 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:38.345794 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c0187-9b05-4865-afbf-83fcef757a15 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:38.346067 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c0187-9b05-4865-afbf-83fcef757a15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:38.355104 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c0187-9b05-4865-afbf-83fcef757a15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:38.357148 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c0187-9b05-4865-afbf-83fcef757a15 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:38.366934 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1407/2824] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:05:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:05:38.822558 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef22330-42cc-4428-bd03-543660f9e14d None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:38.823958 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-eef22330-42cc-4428-bd03-543660f9e14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:38.836239 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef22330-42cc-4428-bd03-543660f9e14d None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:38.839697 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f20211-e65a-4d61-82b8-8d33cad4c51a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:38.840329 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f20211-e65a-4d61-82b8-8d33cad4c51a service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:38.841183 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f20211-e65a-4d61-82b8-8d33cad4c51a service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:38.841566 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f20211-e65a-4d61-82b8-8d33cad4c51a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:38.895514 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f20211-e65a-4d61-82b8-8d33cad4c51a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:38.896984 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f20211-e65a-4d61-82b8-8d33cad4c51a service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:38.906563 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1418/2825] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:05:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:05:42.832607 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c0187-9b05-4865-afbf-83fcef757a15 service cinder] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:42.841247 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c0187-9b05-4865-afbf-83fcef757a15 service cinder] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:42.845547 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9443da2-2db4-49f6-aca3-9ac57900a6fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:42.846182 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9443da2-2db4-49f6-aca3-9ac57900a6fc service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:42.846471 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9443da2-2db4-49f6-aca3-9ac57900a6fc service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:42.846745 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9443da2-2db4-49f6-aca3-9ac57900a6fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:42.900507 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9443da2-2db4-49f6-aca3-9ac57900a6fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:42.901958 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9443da2-2db4-49f6-aca3-9ac57900a6fc service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:42.911699 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1408/2826] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:05:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:05:44.893991 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f20211-e65a-4d61-82b8-8d33cad4c51a service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:44.955712 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f20211-e65a-4d61-82b8-8d33cad4c51a service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:44.960179 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917e5fc-639d-4eb5-af60-fd7ec204c37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:44.961071 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917e5fc-639d-4eb5-af60-fd7ec204c37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:44.961355 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917e5fc-639d-4eb5-af60-fd7ec204c37d admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:44.961630 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917e5fc-639d-4eb5-af60-fd7ec204c37d admin admin] PATH_INFO: `/v3/users/a5b36485e3874a4fa4e50c4c9dfc4dae` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:44.962839 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917e5fc-639d-4eb5-af60-fd7ec204c37d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5b36485e3874a4fa4e50c4c9dfc4dae)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:44.964787 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917e5fc-639d-4eb5-af60-fd7ec204c37d admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:45.008197 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3917e5fc-639d-4eb5-af60-fd7ec204c37d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5b36485e3874a4fa4e50c4c9dfc4dae'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:45.008771 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3917e5fc-639d-4eb5-af60-fd7ec204c37d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5b36485e3874a4fa4e50c4c9dfc4dae'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:45.016024 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3917e5fc-639d-4eb5-af60-fd7ec204c37d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5b36485e3874a4fa4e50c4c9dfc4dae'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:45.023100 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3917e5fc-639d-4eb5-af60-fd7ec204c37d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5b36485e3874a4fa4e50c4c9dfc4dae'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:45.023750 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-3917e5fc-639d-4eb5-af60-fd7ec204c37d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5b36485e3874a4fa4e50c4c9dfc4dae'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:45.041779 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1419/2827] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:05:44 2022] DELETE /identity/v3/users/a5b36485e3874a4fa4e50c4c9dfc4dae => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:45.046547 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce56f2-9a3e-4b52-a543-25da035f2f19 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:45.047054 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce56f2-9a3e-4b52-a543-25da035f2f19 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:45.047174 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce56f2-9a3e-4b52-a543-25da035f2f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:45.063288 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-31ce56f2-9a3e-4b52-a543-25da035f2f19 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:45.064493 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-31ce56f2-9a3e-4b52-a543-25da035f2f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:45.119583 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1409/2828] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:45.129894 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917e5fc-639d-4eb5-af60-fd7ec204c37d admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:45.131303 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-3917e5fc-639d-4eb5-af60-fd7ec204c37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:45.189215 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917e5fc-639d-4eb5-af60-fd7ec204c37d admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:45.192804 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b869c4-fefb-4bde-bb0b-bba3ecec3e22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:45.193446 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b869c4-fefb-4bde-bb0b-bba3ecec3e22 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:45.193726 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b869c4-fefb-4bde-bb0b-bba3ecec3e22 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:45.193998 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b869c4-fefb-4bde-bb0b-bba3ecec3e22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:45.202975 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b869c4-fefb-4bde-bb0b-bba3ecec3e22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:45.204416 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b869c4-fefb-4bde-bb0b-bba3ecec3e22 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:45.213824 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1420/2829] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:05:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:05:45.474239 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce56f2-9a3e-4b52-a543-25da035f2f19 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:45.475791 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-31ce56f2-9a3e-4b52-a543-25da035f2f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:45.493162 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce56f2-9a3e-4b52-a543-25da035f2f19 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:45.498917 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0f793-d3f1-4340-a963-3e219270e12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:45.499848 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0f793-d3f1-4340-a963-3e219270e12d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:45.500130 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0f793-d3f1-4340-a963-3e219270e12d admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:45.500406 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0f793-d3f1-4340-a963-3e219270e12d admin admin] PATH_INFO: `/v3/projects/7ce5287a6a44409d9e2a464e69d6c297` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:45.501735 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0f793-d3f1-4340-a963-3e219270e12d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce5287a6a44409d9e2a464e69d6c297)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:45.503665 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0f793-d3f1-4340-a963-3e219270e12d admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:45.550563 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6eb0f793-d3f1-4340-a963-3e219270e12d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce5287a6a44409d9e2a464e69d6c297', 'request_id': 'req-6eb0f793-d3f1-4340-a963-3e219270e12d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:45.557358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6eb0f793-d3f1-4340-a963-3e219270e12d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce5287a6a44409d9e2a464e69d6c297', 'request_id': 'req-6eb0f793-d3f1-4340-a963-3e219270e12d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:45.562564 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6eb0f793-d3f1-4340-a963-3e219270e12d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce5287a6a44409d9e2a464e69d6c297', 'request_id': 'req-6eb0f793-d3f1-4340-a963-3e219270e12d'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:45.573089 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6eb0f793-d3f1-4340-a963-3e219270e12d admin admin] The token cache is being invalidate because project 7ce5287a6a44409d9e2a464e69d6c297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:05:45.573370 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6eb0f793-d3f1-4340-a963-3e219270e12d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:45.574020 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6eb0f793-d3f1-4340-a963-3e219270e12d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:45.575538 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1410/2830] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:05:45 2022] DELETE /identity/v3/projects/7ce5287a6a44409d9e2a464e69d6c297 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:45.580053 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b869c4-fefb-4bde-bb0b-bba3ecec3e22 service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:45.589304 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b869c4-fefb-4bde-bb0b-bba3ecec3e22 service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:45.642348 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51a511-a388-44ea-8f83-8b5e381ad8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:45.643204 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51a511-a388-44ea-8f83-8b5e381ad8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:45.643484 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51a511-a388-44ea-8f83-8b5e381ad8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:45.643785 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51a511-a388-44ea-8f83-8b5e381ad8f7 admin admin] PATH_INFO: `/v3/users/467ec0b94992494cab10fc72f72d1b27` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:45.644960 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51a511-a388-44ea-8f83-8b5e381ad8f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=467ec0b94992494cab10fc72f72d1b27)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:45.646852 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51a511-a388-44ea-8f83-8b5e381ad8f7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:45.691854 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1a51a511-a388-44ea-8f83-8b5e381ad8f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '467ec0b94992494cab10fc72f72d1b27'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:45.692516 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1a51a511-a388-44ea-8f83-8b5e381ad8f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '467ec0b94992494cab10fc72f72d1b27'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:45.699218 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1a51a511-a388-44ea-8f83-8b5e381ad8f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '467ec0b94992494cab10fc72f72d1b27'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:45.706991 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1a51a511-a388-44ea-8f83-8b5e381ad8f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '467ec0b94992494cab10fc72f72d1b27'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:45.707700 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-1a51a511-a388-44ea-8f83-8b5e381ad8f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '467ec0b94992494cab10fc72f72d1b27'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:45.724575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1421/2831] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:05:45 2022] DELETE /identity/v3/users/467ec0b94992494cab10fc72f72d1b27 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:45.984008 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0f793-d3f1-4340-a963-3e219270e12d admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:45.985451 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6eb0f793-d3f1-4340-a963-3e219270e12d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:45.999015 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0f793-d3f1-4340-a963-3e219270e12d admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:46.055789 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80efab-0922-44c1-aa75-959669856991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:46.056655 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80efab-0922-44c1-aa75-959669856991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:46.056938 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80efab-0922-44c1-aa75-959669856991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:46.057208 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80efab-0922-44c1-aa75-959669856991 admin admin] PATH_INFO: `/v3/projects/0d5402b2d9c341f6b4561cfe263f5420` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:46.058405 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80efab-0922-44c1-aa75-959669856991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d5402b2d9c341f6b4561cfe263f5420)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:46.060419 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80efab-0922-44c1-aa75-959669856991 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:46.103891 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ef80efab-0922-44c1-aa75-959669856991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d5402b2d9c341f6b4561cfe263f5420', 'request_id': 'req-ef80efab-0922-44c1-aa75-959669856991'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:46.111748 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ef80efab-0922-44c1-aa75-959669856991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d5402b2d9c341f6b4561cfe263f5420', 'request_id': 'req-ef80efab-0922-44c1-aa75-959669856991'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:46.117152 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ef80efab-0922-44c1-aa75-959669856991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d5402b2d9c341f6b4561cfe263f5420', 'request_id': 'req-ef80efab-0922-44c1-aa75-959669856991'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:46.127687 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ef80efab-0922-44c1-aa75-959669856991 admin admin] The token cache is being invalidate because project 0d5402b2d9c341f6b4561cfe263f5420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:05:46.127979 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ef80efab-0922-44c1-aa75-959669856991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:46.128637 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-ef80efab-0922-44c1-aa75-959669856991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:46.130200 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1411/2832] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:05:45 2022] DELETE /identity/v3/projects/0d5402b2d9c341f6b4561cfe263f5420 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:46.134124 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51a511-a388-44ea-8f83-8b5e381ad8f7 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:46.135562 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-1a51a511-a388-44ea-8f83-8b5e381ad8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:46.148706 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51a511-a388-44ea-8f83-8b5e381ad8f7 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:46.203562 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346566ff-fd77-4436-8a9b-c5dd3510e6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:46.204443 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346566ff-fd77-4436-8a9b-c5dd3510e6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:46.204723 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346566ff-fd77-4436-8a9b-c5dd3510e6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:46.204992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346566ff-fd77-4436-8a9b-c5dd3510e6b7 admin admin] PATH_INFO: `/v3/users/61931e610ac24d1592be7747fb108eea` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:46.206152 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346566ff-fd77-4436-8a9b-c5dd3510e6b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61931e610ac24d1592be7747fb108eea)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:46.208087 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346566ff-fd77-4436-8a9b-c5dd3510e6b7 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:46.251485 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-346566ff-fd77-4436-8a9b-c5dd3510e6b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61931e610ac24d1592be7747fb108eea'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:46.252165 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-346566ff-fd77-4436-8a9b-c5dd3510e6b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61931e610ac24d1592be7747fb108eea'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:46.258824 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-346566ff-fd77-4436-8a9b-c5dd3510e6b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61931e610ac24d1592be7747fb108eea'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:46.265843 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-346566ff-fd77-4436-8a9b-c5dd3510e6b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61931e610ac24d1592be7747fb108eea'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:46.266475 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-346566ff-fd77-4436-8a9b-c5dd3510e6b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61931e610ac24d1592be7747fb108eea'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:46.283651 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1422/2833] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:05:46 2022] DELETE /identity/v3/users/61931e610ac24d1592be7747fb108eea => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:46.541283 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80efab-0922-44c1-aa75-959669856991 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:46.542770 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-ef80efab-0922-44c1-aa75-959669856991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:46.555698 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80efab-0922-44c1-aa75-959669856991 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:46.618502 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01d303-3c82-4c81-b96a-6a6d3083f9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:46.619367 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01d303-3c82-4c81-b96a-6a6d3083f9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:46.619676 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01d303-3c82-4c81-b96a-6a6d3083f9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:46.619955 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01d303-3c82-4c81-b96a-6a6d3083f9b2 admin admin] PATH_INFO: `/v3/projects/1e189f5049104cfbb7581bcf824f6963` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:46.621136 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01d303-3c82-4c81-b96a-6a6d3083f9b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e189f5049104cfbb7581bcf824f6963)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:46.623371 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01d303-3c82-4c81-b96a-6a6d3083f9b2 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:46.667380 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6a01d303-3c82-4c81-b96a-6a6d3083f9b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e189f5049104cfbb7581bcf824f6963', 'request_id': 'req-6a01d303-3c82-4c81-b96a-6a6d3083f9b2'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:46.673869 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6a01d303-3c82-4c81-b96a-6a6d3083f9b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e189f5049104cfbb7581bcf824f6963', 'request_id': 'req-6a01d303-3c82-4c81-b96a-6a6d3083f9b2'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:46.678973 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6a01d303-3c82-4c81-b96a-6a6d3083f9b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e189f5049104cfbb7581bcf824f6963', 'request_id': 'req-6a01d303-3c82-4c81-b96a-6a6d3083f9b2'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:46.690024 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6a01d303-3c82-4c81-b96a-6a6d3083f9b2 admin admin] The token cache is being invalidate because project 1e189f5049104cfbb7581bcf824f6963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:05:46.690304 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6a01d303-3c82-4c81-b96a-6a6d3083f9b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:46.690924 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-6a01d303-3c82-4c81-b96a-6a6d3083f9b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:46.692467 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1412/2834] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:05:46 2022] DELETE /identity/v3/projects/1e189f5049104cfbb7581bcf824f6963 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:46.698631 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb6a4b-7bce-44e6-91b5-e9085468d52f None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:46.698944 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb6a4b-7bce-44e6-91b5-e9085468d52f None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:46.699220 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb6a4b-7bce-44e6-91b5-e9085468d52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:46.717820 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-d2fb6a4b-7bce-44e6-91b5-e9085468d52f None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:46.719100 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-d2fb6a4b-7bce-44e6-91b5-e9085468d52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:46.777155 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1423/2835] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:46.786421 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a415ec-4ccf-4d55-8a1d-9864b8613b21 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:46.786710 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a415ec-4ccf-4d55-8a1d-9864b8613b21 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:46.786987 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a415ec-4ccf-4d55-8a1d-9864b8613b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:46.805945 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-68a415ec-4ccf-4d55-8a1d-9864b8613b21 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:46.807143 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-68a415ec-4ccf-4d55-8a1d-9864b8613b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:46.815273 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1413/2836] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:46.819588 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb6a4b-7bce-44e6-91b5-e9085468d52f None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:46.830534 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb6a4b-7bce-44e6-91b5-e9085468d52f None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:46.835108 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472477ed-bd3d-4baa-9b9e-710b0fe15a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:46.835933 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472477ed-bd3d-4baa-9b9e-710b0fe15a02 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:46.836213 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472477ed-bd3d-4baa-9b9e-710b0fe15a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:46.836487 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472477ed-bd3d-4baa-9b9e-710b0fe15a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:46.837210 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472477ed-bd3d-4baa-9b9e-710b0fe15a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 14:05:46.837514 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472477ed-bd3d-4baa-9b9e-710b0fe15a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:46.839100 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472477ed-bd3d-4baa-9b9e-710b0fe15a02 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:46.859094 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1424/2837] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 14:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 14:05:46.863942 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a415ec-4ccf-4d55-8a1d-9864b8613b21 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:46.873033 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a415ec-4ccf-4d55-8a1d-9864b8613b21 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:46.878102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bf6fa-71a0-456a-8b76-868f2d066586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:46.878792 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bf6fa-71a0-456a-8b76-868f2d066586 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:46.879074 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bf6fa-71a0-456a-8b76-868f2d066586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:46.879346 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bf6fa-71a0-456a-8b76-868f2d066586 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:46.880139 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bf6fa-71a0-456a-8b76-868f2d066586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:46.882039 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bf6fa-71a0-456a-8b76-868f2d066586 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:46.907437 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1414/2838] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:05:46 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 14:05:46.911490 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472477ed-bd3d-4baa-9b9e-710b0fe15a02 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:46.921980 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472477ed-bd3d-4baa-9b9e-710b0fe15a02 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:46.975644 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc0e4f-b92b-49a2-8dea-edfffa9ff484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:46.976318 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc0e4f-b92b-49a2-8dea-edfffa9ff484 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:46.976596 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc0e4f-b92b-49a2-8dea-edfffa9ff484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:46.976870 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc0e4f-b92b-49a2-8dea-edfffa9ff484 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:46.977548 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc0e4f-b92b-49a2-8dea-edfffa9ff484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:46.979780 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc0e4f-b92b-49a2-8dea-edfffa9ff484 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:46.999203 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1425/2839] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:05:46 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 14:05:47.003230 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bf6fa-71a0-456a-8b76-868f2d066586 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:47.013335 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bf6fa-71a0-456a-8b76-868f2d066586 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:47.018154 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93472b-3296-4ad8-b02a-a2ec6c095df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:47.018810 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93472b-3296-4ad8-b02a-a2ec6c095df0 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:47.019097 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93472b-3296-4ad8-b02a-a2ec6c095df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:47.019375 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93472b-3296-4ad8-b02a-a2ec6c095df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:47.020147 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93472b-3296-4ad8-b02a-a2ec6c095df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:47.021757 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93472b-3296-4ad8-b02a-a2ec6c095df0 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:47.032787 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1415/2840] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:05:47.036647 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc0e4f-b92b-49a2-8dea-edfffa9ff484 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:47.047201 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc0e4f-b92b-49a2-8dea-edfffa9ff484 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:47.051914 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf84da8-fb08-4747-8c9e-9e3a5681561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:47.052565 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf84da8-fb08-4747-8c9e-9e3a5681561e admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:47.052852 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf84da8-fb08-4747-8c9e-9e3a5681561e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:47.053131 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf84da8-fb08-4747-8c9e-9e3a5681561e admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:47.053854 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf84da8-fb08-4747-8c9e-9e3a5681561e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:47.055444 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf84da8-fb08-4747-8c9e-9e3a5681561e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:47.065219 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1426/2841] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:05:47.069222 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93472b-3296-4ad8-b02a-a2ec6c095df0 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:47.079965 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93472b-3296-4ad8-b02a-a2ec6c095df0 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:47.084751 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d06b2-f8c4-4654-8cac-5adb5549b8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:47.085672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d06b2-f8c4-4654-8cac-5adb5549b8dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:47.085925 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d06b2-f8c4-4654-8cac-5adb5549b8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:47.086202 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d06b2-f8c4-4654-8cac-5adb5549b8dd admin admin] PATH_INFO: `/v3/projects/9d1be0d707b641a98c7c1a5148533a0c/users/63c9e8dbd65146fa94c0e5e524b63aef/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:47.101455 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d06b2-f8c4-4654-8cac-5adb5549b8dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1be0d707b641a98c7c1a5148533a0c, user_id=63c9e8dbd65146fa94c0e5e524b63aef, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:47.104144 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d06b2-f8c4-4654-8cac-5adb5549b8dd admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:47.116112 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1416/2842] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:05:47 2022] PUT /identity/v3/projects/9d1be0d707b641a98c7c1a5148533a0c/users/63c9e8dbd65146fa94c0e5e524b63aef/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:47.178524 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faf6bf-0fe4-48c1-aa69-939c59b44daa None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:47.179094 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faf6bf-0fe4-48c1-aa69-939c59b44daa None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:47.179094 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45faf6bf-0fe4-48c1-aa69-939c59b44daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:47.208127 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-45faf6bf-0fe4-48c1-aa69-939c59b44daa None None] MFA Rules not processed for user `63c9e8dbd65146fa94c0e5e524b63aef`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:47.209329 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-45faf6bf-0fe4-48c1-aa69-939c59b44daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:47.270182 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1427/2843] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:47.282223 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d06b2-f8c4-4654-8cac-5adb5549b8dd admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:47.284045 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-479d06b2-f8c4-4654-8cac-5adb5549b8dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:47.337779 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d06b2-f8c4-4654-8cac-5adb5549b8dd admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:47.341358 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6470d51-864f-44ec-a2f3-330110433340 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:47.342524 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470d51-864f-44ec-a2f3-330110433340 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:47.342799 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470d51-864f-44ec-a2f3-330110433340 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:47.343071 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470d51-864f-44ec-a2f3-330110433340 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:47.351063 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6470d51-864f-44ec-a2f3-330110433340 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:47.352517 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6470d51-864f-44ec-a2f3-330110433340 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:47.361005 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1417/2844] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:05:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:05:47.379858 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45faf6bf-0fe4-48c1-aa69-939c59b44daa None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:47.440856 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45faf6bf-0fe4-48c1-aa69-939c59b44daa None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:47.445420 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8a9f3-f88c-4db7-981a-72a1b189f6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:47.446280 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8a9f3-f88c-4db7-981a-72a1b189f6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:47.446564 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8a9f3-f88c-4db7-981a-72a1b189f6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:47.446859 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8a9f3-f88c-4db7-981a-72a1b189f6d4 admin admin] PATH_INFO: `/v3/users/63c9e8dbd65146fa94c0e5e524b63aef` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:47.448084 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8a9f3-f88c-4db7-981a-72a1b189f6d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63c9e8dbd65146fa94c0e5e524b63aef)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:47.450007 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8a9f3-f88c-4db7-981a-72a1b189f6d4 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:47.494280 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e1e8a9f3-f88c-4db7-981a-72a1b189f6d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63c9e8dbd65146fa94c0e5e524b63aef'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:47.494941 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e1e8a9f3-f88c-4db7-981a-72a1b189f6d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63c9e8dbd65146fa94c0e5e524b63aef'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:47.502587 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e1e8a9f3-f88c-4db7-981a-72a1b189f6d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63c9e8dbd65146fa94c0e5e524b63aef'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:47.509491 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e1e8a9f3-f88c-4db7-981a-72a1b189f6d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63c9e8dbd65146fa94c0e5e524b63aef'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:47.510138 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e1e8a9f3-f88c-4db7-981a-72a1b189f6d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63c9e8dbd65146fa94c0e5e524b63aef'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:47.527714 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1428/2845] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:05:47 2022] DELETE /identity/v3/users/63c9e8dbd65146fa94c0e5e524b63aef => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:47.532574 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20752b-6344-4719-8719-5b4bb15fce77 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:47.532858 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20752b-6344-4719-8719-5b4bb15fce77 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:47.533160 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20752b-6344-4719-8719-5b4bb15fce77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:47.556103 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-4d20752b-6344-4719-8719-5b4bb15fce77 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:47.557298 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4d20752b-6344-4719-8719-5b4bb15fce77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:47.613917 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1418/2846] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 14:05:47.623944 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8a9f3-f88c-4db7-981a-72a1b189f6d4 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:47.625438 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e1e8a9f3-f88c-4db7-981a-72a1b189f6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:47.681664 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8a9f3-f88c-4db7-981a-72a1b189f6d4 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:47.685573 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bf8e0-3c64-49f6-913d-f56860586cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:47.686709 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bf8e0-3c64-49f6-913d-f56860586cfe service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:47.686996 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bf8e0-3c64-49f6-913d-f56860586cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:47.687273 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bf8e0-3c64-49f6-913d-f56860586cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:47.696844 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bf8e0-3c64-49f6-913d-f56860586cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:47.698277 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bf8e0-3c64-49f6-913d-f56860586cfe service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:47.708261 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1429/2847] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:05:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:05:47.957613 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20752b-6344-4719-8719-5b4bb15fce77 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:47.959042 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-4d20752b-6344-4719-8719-5b4bb15fce77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:47.971200 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20752b-6344-4719-8719-5b4bb15fce77 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:47.976050 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d1554-1bf6-4baa-a461-b4330162b5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:47.976911 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d1554-1bf6-4baa-a461-b4330162b5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:47.977190 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d1554-1bf6-4baa-a461-b4330162b5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:47.977463 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d1554-1bf6-4baa-a461-b4330162b5a5 admin admin] PATH_INFO: `/v3/projects/9d1be0d707b641a98c7c1a5148533a0c` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:47.978636 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d1554-1bf6-4baa-a461-b4330162b5a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d1be0d707b641a98c7c1a5148533a0c)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:47.980567 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d1554-1bf6-4baa-a461-b4330162b5a5 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:48.026123 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-460d1554-1bf6-4baa-a461-b4330162b5a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d1be0d707b641a98c7c1a5148533a0c', 'request_id': 'req-460d1554-1bf6-4baa-a461-b4330162b5a5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:48.033300 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-460d1554-1bf6-4baa-a461-b4330162b5a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d1be0d707b641a98c7c1a5148533a0c', 'request_id': 'req-460d1554-1bf6-4baa-a461-b4330162b5a5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:48.039273 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-460d1554-1bf6-4baa-a461-b4330162b5a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d1be0d707b641a98c7c1a5148533a0c', 'request_id': 'req-460d1554-1bf6-4baa-a461-b4330162b5a5'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:48.050419 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-460d1554-1bf6-4baa-a461-b4330162b5a5 admin admin] The token cache is being invalidate because project 9d1be0d707b641a98c7c1a5148533a0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:05:48.050898 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-460d1554-1bf6-4baa-a461-b4330162b5a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:48.051577 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-460d1554-1bf6-4baa-a461-b4330162b5a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:48.053224 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1419/2848] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:05:47 2022] DELETE /identity/v3/projects/9d1be0d707b641a98c7c1a5148533a0c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:48.058073 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2be2a-a8a3-4c90-a4ce-5a6f29c98e16 None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:48.058365 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2be2a-a8a3-4c90-a4ce-5a6f29c98e16 None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:48.058642 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2be2a-a8a3-4c90-a4ce-5a6f29c98e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:48.076466 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-49c2be2a-a8a3-4c90-a4ce-5a6f29c98e16 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:48.078275 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-49c2be2a-a8a3-4c90-a4ce-5a6f29c98e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:48.134828 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1430/2849] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:48.143123 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f706491-0e3e-4a27-bb93-e7b06c192a69 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:48.143613 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f706491-0e3e-4a27-bb93-e7b06c192a69 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:48.143859 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f706491-0e3e-4a27-bb93-e7b06c192a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:48.162415 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-7f706491-0e3e-4a27-bb93-e7b06c192a69 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:48.163595 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-7f706491-0e3e-4a27-bb93-e7b06c192a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:48.171377 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1420/2850] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:48.175427 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2be2a-a8a3-4c90-a4ce-5a6f29c98e16 None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:48.185305 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2be2a-a8a3-4c90-a4ce-5a6f29c98e16 None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:48.190701 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c580ae-4bac-4867-90a3-b3d0fcc5f0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:48.191344 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c580ae-4bac-4867-90a3-b3d0fcc5f0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:48.191623 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c580ae-4bac-4867-90a3-b3d0fcc5f0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:48.191926 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c580ae-4bac-4867-90a3-b3d0fcc5f0d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:48.192642 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c580ae-4bac-4867-90a3-b3d0fcc5f0d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 14:05:48.192944 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c580ae-4bac-4867-90a3-b3d0fcc5f0d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:48.194527 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c580ae-4bac-4867-90a3-b3d0fcc5f0d3 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:48.207108 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1431/2851] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 14:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 14:05:48.211242 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f706491-0e3e-4a27-bb93-e7b06c192a69 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:48.221226 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f706491-0e3e-4a27-bb93-e7b06c192a69 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:48.226045 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac2122-e1cb-483f-ab4b-7cde7dd276d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:48.226698 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac2122-e1cb-483f-ab4b-7cde7dd276d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:48.226982 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac2122-e1cb-483f-ab4b-7cde7dd276d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:48.227258 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac2122-e1cb-483f-ab4b-7cde7dd276d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:48.227992 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac2122-e1cb-483f-ab4b-7cde7dd276d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:48.229968 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac2122-e1cb-483f-ab4b-7cde7dd276d1 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:48.255935 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1421/2852] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:05:48 2022] POST /identity/v3/projects => generated 361 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:05:48.260149 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c580ae-4bac-4867-90a3-b3d0fcc5f0d3 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:48.269950 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c580ae-4bac-4867-90a3-b3d0fcc5f0d3 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:48.323455 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6475655-9d70-4a97-bfb3-7e272db59e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:48.324215 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6475655-9d70-4a97-bfb3-7e272db59e56 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:48.324502 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6475655-9d70-4a97-bfb3-7e272db59e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:48.324805 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6475655-9d70-4a97-bfb3-7e272db59e56 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:48.325499 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6475655-9d70-4a97-bfb3-7e272db59e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:48.327492 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6475655-9d70-4a97-bfb3-7e272db59e56 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:48.346565 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1432/2853] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:05:48 2022] POST /identity/v3/users => generated 281 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:05:48.350462 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac2122-e1cb-483f-ab4b-7cde7dd276d1 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:48.361142 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac2122-e1cb-483f-ab4b-7cde7dd276d1 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:48.365788 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb7678-4744-4a97-b2ad-18881d0d45e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:48.366443 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb7678-4744-4a97-b2ad-18881d0d45e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:48.366724 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb7678-4744-4a97-b2ad-18881d0d45e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:48.366998 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb7678-4744-4a97-b2ad-18881d0d45e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:48.367752 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb7678-4744-4a97-b2ad-18881d0d45e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:48.369348 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb7678-4744-4a97-b2ad-18881d0d45e7 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:48.380112 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1422/2854] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:05:48.384122 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6475655-9d70-4a97-bfb3-7e272db59e56 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:48.394237 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6475655-9d70-4a97-bfb3-7e272db59e56 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:48.399162 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1812f8-ab06-4950-a72f-3cfbb809cc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:48.399695 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1812f8-ab06-4950-a72f-3cfbb809cc52 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:48.399980 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1812f8-ab06-4950-a72f-3cfbb809cc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:48.400257 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1812f8-ab06-4950-a72f-3cfbb809cc52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:48.400981 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1812f8-ab06-4950-a72f-3cfbb809cc52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:48.402602 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1812f8-ab06-4950-a72f-3cfbb809cc52 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:48.413762 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1433/2855] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:05:48.417968 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb7678-4744-4a97-b2ad-18881d0d45e7 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:48.428614 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb7678-4744-4a97-b2ad-18881d0d45e7 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:48.433325 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a8bfe-e660-44c9-98e7-57055e9d08ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:48.434234 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a8bfe-e660-44c9-98e7-57055e9d08ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:48.434516 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a8bfe-e660-44c9-98e7-57055e9d08ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:48.434790 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a8bfe-e660-44c9-98e7-57055e9d08ac admin admin] PATH_INFO: `/v3/projects/3905018bf7b84d99b4ef8f41def79174/users/d526e22f461d48e8934c83717623d9bc/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:48.448924 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a8bfe-e660-44c9-98e7-57055e9d08ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=3905018bf7b84d99b4ef8f41def79174, user_id=d526e22f461d48e8934c83717623d9bc, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:48.451570 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a8bfe-e660-44c9-98e7-57055e9d08ac admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:48.464334 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1423/2856] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:05:48 2022] PUT /identity/v3/projects/3905018bf7b84d99b4ef8f41def79174/users/d526e22f461d48e8934c83717623d9bc/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:48.476480 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665efd3-dfa8-4d76-a8ca-ff3bc0eeb84b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:48.476772 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665efd3-dfa8-4d76-a8ca-ff3bc0eeb84b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:48.477050 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665efd3-dfa8-4d76-a8ca-ff3bc0eeb84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:48.502418 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-f665efd3-dfa8-4d76-a8ca-ff3bc0eeb84b None None] MFA Rules not processed for user `d526e22f461d48e8934c83717623d9bc`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:48.503609 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-f665efd3-dfa8-4d76-a8ca-ff3bc0eeb84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:48.567385 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1434/2857] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:48.598323 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a8bfe-e660-44c9-98e7-57055e9d08ac admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:48.600178 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-589a8bfe-e660-44c9-98e7-57055e9d08ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:48.656070 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a8bfe-e660-44c9-98e7-57055e9d08ac admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:48.659776 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64574fd-6ffc-4be4-8c42-0fdba0d55ff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:48.660417 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64574fd-6ffc-4be4-8c42-0fdba0d55ff9 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:48.660703 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64574fd-6ffc-4be4-8c42-0fdba0d55ff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:48.660980 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64574fd-6ffc-4be4-8c42-0fdba0d55ff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:48.669152 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64574fd-6ffc-4be4-8c42-0fdba0d55ff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:48.670584 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64574fd-6ffc-4be4-8c42-0fdba0d55ff9 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:48.679070 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1424/2858] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:05:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:05:48.693635 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665efd3-dfa8-4d76-a8ca-ff3bc0eeb84b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:48.756224 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665efd3-dfa8-4d76-a8ca-ff3bc0eeb84b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:48.760757 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8d2cb-48db-48dd-952b-93e30f4c1654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:48.761622 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8d2cb-48db-48dd-952b-93e30f4c1654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:48.761910 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8d2cb-48db-48dd-952b-93e30f4c1654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:48.762188 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8d2cb-48db-48dd-952b-93e30f4c1654 admin admin] PATH_INFO: `/v3/users/d526e22f461d48e8934c83717623d9bc` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:48.763386 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8d2cb-48db-48dd-952b-93e30f4c1654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d526e22f461d48e8934c83717623d9bc)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:48.766220 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8d2cb-48db-48dd-952b-93e30f4c1654 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:48.809648 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e6c8d2cb-48db-48dd-952b-93e30f4c1654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd526e22f461d48e8934c83717623d9bc'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:48.810311 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e6c8d2cb-48db-48dd-952b-93e30f4c1654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd526e22f461d48e8934c83717623d9bc'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:48.817887 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e6c8d2cb-48db-48dd-952b-93e30f4c1654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd526e22f461d48e8934c83717623d9bc'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:48.824581 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e6c8d2cb-48db-48dd-952b-93e30f4c1654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd526e22f461d48e8934c83717623d9bc'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:48.825234 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-e6c8d2cb-48db-48dd-952b-93e30f4c1654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd526e22f461d48e8934c83717623d9bc'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:48.842450 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1435/2859] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:05:48 2022] DELETE /identity/v3/users/d526e22f461d48e8934c83717623d9bc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:48.847572 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584781e5-f8ab-4fb0-b6c3-4b86af5a9203 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:48.847919 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584781e5-f8ab-4fb0-b6c3-4b86af5a9203 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:48.848197 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584781e5-f8ab-4fb0-b6c3-4b86af5a9203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:48.865400 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-584781e5-f8ab-4fb0-b6c3-4b86af5a9203 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:48.866600 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-584781e5-f8ab-4fb0-b6c3-4b86af5a9203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:48.923033 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1425/2860] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:48.932716 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8d2cb-48db-48dd-952b-93e30f4c1654 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:48.934168 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e6c8d2cb-48db-48dd-952b-93e30f4c1654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:48.989180 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8d2cb-48db-48dd-952b-93e30f4c1654 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:48.992772 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbba973-639a-482f-b38a-a3b4694530c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:48.993408 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbba973-639a-482f-b38a-a3b4694530c7 service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:48.993691 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbba973-639a-482f-b38a-a3b4694530c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:48.993964 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbba973-639a-482f-b38a-a3b4694530c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:49.003416 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbba973-639a-482f-b38a-a3b4694530c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:49.004885 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbba973-639a-482f-b38a-a3b4694530c7 service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:49.014232 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1436/2861] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:05:49.277506 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584781e5-f8ab-4fb0-b6c3-4b86af5a9203 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:49.279308 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-584781e5-f8ab-4fb0-b6c3-4b86af5a9203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:49.292272 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584781e5-f8ab-4fb0-b6c3-4b86af5a9203 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:49.297364 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c29996-124a-46b7-970b-5475e7a4dcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:49.298370 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c29996-124a-46b7-970b-5475e7a4dcfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:49.298670 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c29996-124a-46b7-970b-5475e7a4dcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:49.298989 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c29996-124a-46b7-970b-5475e7a4dcfb admin admin] PATH_INFO: `/v3/projects/3905018bf7b84d99b4ef8f41def79174` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:49.300488 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c29996-124a-46b7-970b-5475e7a4dcfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3905018bf7b84d99b4ef8f41def79174)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:49.302690 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c29996-124a-46b7-970b-5475e7a4dcfb admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:49.347503 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f8c29996-124a-46b7-970b-5475e7a4dcfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3905018bf7b84d99b4ef8f41def79174', 'request_id': 'req-f8c29996-124a-46b7-970b-5475e7a4dcfb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:49.353816 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f8c29996-124a-46b7-970b-5475e7a4dcfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3905018bf7b84d99b4ef8f41def79174', 'request_id': 'req-f8c29996-124a-46b7-970b-5475e7a4dcfb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:49.359492 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f8c29996-124a-46b7-970b-5475e7a4dcfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3905018bf7b84d99b4ef8f41def79174', 'request_id': 'req-f8c29996-124a-46b7-970b-5475e7a4dcfb'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:49.369973 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f8c29996-124a-46b7-970b-5475e7a4dcfb admin admin] The token cache is being invalidate because project 3905018bf7b84d99b4ef8f41def79174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:05:49.370280 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f8c29996-124a-46b7-970b-5475e7a4dcfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:49.370897 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-f8c29996-124a-46b7-970b-5475e7a4dcfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:05:49.372476 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1426/2862] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:05:49 2022] DELETE /identity/v3/projects/3905018bf7b84d99b4ef8f41def79174 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:05:49.377889 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67195b06-f34c-4374-be2f-6d34536cdd7e None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:49.378347 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67195b06-f34c-4374-be2f-6d34536cdd7e None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:49.378465 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67195b06-f34c-4374-be2f-6d34536cdd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:49.396832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-67195b06-f34c-4374-be2f-6d34536cdd7e None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:49.398027 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-67195b06-f34c-4374-be2f-6d34536cdd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:49.455161 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1437/2863] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:49.463072 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cae69-d340-4735-8352-36ca18580b61 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:49.463368 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cae69-d340-4735-8352-36ca18580b61 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:49.463737 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cae69-d340-4735-8352-36ca18580b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:49.481433 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-3d6cae69-d340-4735-8352-36ca18580b61 None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:49.482628 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-3d6cae69-d340-4735-8352-36ca18580b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:49.490759 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1427/2864] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 14:05:49.495018 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67195b06-f34c-4374-be2f-6d34536cdd7e None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:49.505082 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67195b06-f34c-4374-be2f-6d34536cdd7e None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:49.509646 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea7de1-4e4e-40f7-88d3-8bd0d823ccbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:49.510292 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea7de1-4e4e-40f7-88d3-8bd0d823ccbb admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:49.510575 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea7de1-4e4e-40f7-88d3-8bd0d823ccbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:49.510852 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea7de1-4e4e-40f7-88d3-8bd0d823ccbb admin admin] PATH_INFO: `/v3/domains` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:49.511572 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea7de1-4e4e-40f7-88d3-8bd0d823ccbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 14:05:49.511911 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea7de1-4e4e-40f7-88d3-8bd0d823ccbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:49.513498 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ea7de1-4e4e-40f7-88d3-8bd0d823ccbb admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:49.525459 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1438/2865] 10.222.0.67 () {58 vars in 1152 bytes} [Mon Apr 11 14:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 14:05:49.529831 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cae69-d340-4735-8352-36ca18580b61 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:49.539296 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cae69-d340-4735-8352-36ca18580b61 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:49.544024 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e0de9-abd4-4cfc-8ac6-d854b0a6f7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:49.544669 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e0de9-abd4-4cfc-8ac6-d854b0a6f7fd admin admin] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:49.544954 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e0de9-abd4-4cfc-8ac6-d854b0a6f7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:49.545231 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e0de9-abd4-4cfc-8ac6-d854b0a6f7fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:49.545940 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e0de9-abd4-4cfc-8ac6-d854b0a6f7fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:49.548155 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e0de9-abd4-4cfc-8ac6-d854b0a6f7fd admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:49.574451 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1428/2866] 10.222.0.67 () {60 vars in 1152 bytes} [Mon Apr 11 14:05:49 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:05:49.579277 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea7de1-4e4e-40f7-88d3-8bd0d823ccbb admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:49.588983 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea7de1-4e4e-40f7-88d3-8bd0d823ccbb admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:49.641901 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fd306-f6c3-499a-82a6-928dfc53b254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:49.642553 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fd306-f6c3-499a-82a6-928dfc53b254 admin admin] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:49.642838 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fd306-f6c3-499a-82a6-928dfc53b254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:49.643115 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fd306-f6c3-499a-82a6-928dfc53b254 admin admin] PATH_INFO: `/v3/users` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:49.643832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628fd306-f6c3-499a-82a6-928dfc53b254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:49.645776 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628fd306-f6c3-499a-82a6-928dfc53b254 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:49.665165 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1439/2867] 10.222.0.67 () {60 vars in 1143 bytes} [Mon Apr 11 14:05:49 2022] POST /identity/v3/users => generated 288 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 14:05:49.669341 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e0de9-abd4-4cfc-8ac6-d854b0a6f7fd admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:49.679465 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e0de9-abd4-4cfc-8ac6-d854b0a6f7fd admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:49.684202 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a08fa-74f5-4922-be1f-52115cde0665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:49.684865 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a08fa-74f5-4922-be1f-52115cde0665 admin admin] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:49.685148 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a08fa-74f5-4922-be1f-52115cde0665 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:49.685425 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a08fa-74f5-4922-be1f-52115cde0665 admin admin] PATH_INFO: `/v3/roles` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:49.686154 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a08fa-74f5-4922-be1f-52115cde0665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:49.688321 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a08fa-74f5-4922-be1f-52115cde0665 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:49.698643 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1429/2868] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:05:49.703390 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fd306-f6c3-499a-82a6-928dfc53b254 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:49.713518 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fd306-f6c3-499a-82a6-928dfc53b254 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:49.718204 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0487c2-fc89-451f-b8e7-807400e8bff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:49.718958 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0487c2-fc89-451f-b8e7-807400e8bff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:49.719247 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0487c2-fc89-451f-b8e7-807400e8bff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:49.719529 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0487c2-fc89-451f-b8e7-807400e8bff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:49.720320 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0487c2-fc89-451f-b8e7-807400e8bff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:49.721917 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0487c2-fc89-451f-b8e7-807400e8bff9 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:49.733229 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1440/2869] 10.222.0.67 () {58 vars in 1121 bytes} [Mon Apr 11 14:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 14:05:49.737882 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a08fa-74f5-4922-be1f-52115cde0665 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:49.747649 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a08fa-74f5-4922-be1f-52115cde0665 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:49.753153 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137db9c-8dd7-431a-8204-30525cedd24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:49.754021 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137db9c-8dd7-431a-8204-30525cedd24e admin admin] REQUEST_METHOD: `PUT` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:49.754302 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137db9c-8dd7-431a-8204-30525cedd24e admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:49.754575 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137db9c-8dd7-431a-8204-30525cedd24e admin admin] PATH_INFO: `/v3/projects/ae0324148d904170b97ea11375cda639/users/d64166d0ccb0468490126c2d53cfaa5e/roles/3daf622d91e64ce685da6f482aa181ea` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:49.768540 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137db9c-8dd7-431a-8204-30525cedd24e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae0324148d904170b97ea11375cda639, user_id=d64166d0ccb0468490126c2d53cfaa5e, role_id=3daf622d91e64ce685da6f482aa181ea)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:49.771186 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137db9c-8dd7-431a-8204-30525cedd24e admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:49.783896 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1430/2870] 10.222.0.67 () {60 vars in 1482 bytes} [Mon Apr 11 14:05:49 2022] PUT /identity/v3/projects/ae0324148d904170b97ea11375cda639/users/d64166d0ccb0468490126c2d53cfaa5e/roles/3daf622d91e64ce685da6f482aa181ea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 14:05:49.793992 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0942d3-d91d-4c03-8e30-6ab51b21232b None None] REQUEST_METHOD: `POST` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:49.794312 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0942d3-d91d-4c03-8e30-6ab51b21232b None None] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:49.794594 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0942d3-d91d-4c03-8e30-6ab51b21232b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:49.820309 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.auth.core [None req-fc0942d3-d91d-4c03-8e30-6ab51b21232b None None] MFA Rules not processed for user `d64166d0ccb0468490126c2d53cfaa5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:05:49.821537 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-fc0942d3-d91d-4c03-8e30-6ab51b21232b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:49.884321 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1441/2871] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:05:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:05:49.895110 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137db9c-8dd7-431a-8204-30525cedd24e admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:49.896802 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-8137db9c-8dd7-431a-8204-30525cedd24e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:05:49.950397 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137db9c-8dd7-431a-8204-30525cedd24e admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:49.954853 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603a739-0f69-4579-844a-fe44429d8c85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:49.955509 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603a739-0f69-4579-844a-fe44429d8c85 service cinder] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:49.955823 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603a739-0f69-4579-844a-fe44429d8c85 service cinder] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:49.956102 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603a739-0f69-4579-844a-fe44429d8c85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:49.964386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603a739-0f69-4579-844a-fe44429d8c85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:49.965810 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603a739-0f69-4579-844a-fe44429d8c85 service cinder] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:05:49.974990 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1431/2872] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:05:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:05:59.890364 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0942d3-d91d-4c03-8e30-6ab51b21232b None None] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:05:59.949975 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0942d3-d91d-4c03-8e30-6ab51b21232b None None] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:05:59.954388 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce718b-9b8b-4392-9411-68e779c61021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:05:59.955908 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce718b-9b8b-4392-9411-68e779c61021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:05:59.956175 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce718b-9b8b-4392-9411-68e779c61021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:05:59.956455 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce718b-9b8b-4392-9411-68e779c61021 admin admin] PATH_INFO: `/v3/users/d64166d0ccb0468490126c2d53cfaa5e` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:05:59.957661 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce718b-9b8b-4392-9411-68e779c61021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d64166d0ccb0468490126c2d53cfaa5e)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:05:59.959576 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce718b-9b8b-4392-9411-68e779c61021 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:06:00.003299 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-63ce718b-9b8b-4392-9411-68e779c61021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd64166d0ccb0468490126c2d53cfaa5e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:06:00.003955 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-63ce718b-9b8b-4392-9411-68e779c61021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd64166d0ccb0468490126c2d53cfaa5e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:06:00.010481 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-63ce718b-9b8b-4392-9411-68e779c61021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd64166d0ccb0468490126c2d53cfaa5e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:06:00.017376 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-63ce718b-9b8b-4392-9411-68e779c61021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd64166d0ccb0468490126c2d53cfaa5e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:06:00.018951 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-63ce718b-9b8b-4392-9411-68e779c61021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd64166d0ccb0468490126c2d53cfaa5e'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:06:00.035927 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1442/2873] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:05:59 2022] DELETE /identity/v3/users/d64166d0ccb0468490126c2d53cfaa5e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:06:00.040386 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da21b7-a2e5-4251-bede-b804489cb5db None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:06:00.040871 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da21b7-a2e5-4251-bede-b804489cb5db None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:06:00.040980 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da21b7-a2e5-4251-bede-b804489cb5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:06:00.057366 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-63da21b7-a2e5-4251-bede-b804489cb5db None None] MFA Rules not processed for user `a8b5e2d388d34b24a1ace24c7c6fb803`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:06:00.058549 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-63da21b7-a2e5-4251-bede-b804489cb5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:06:00.114839 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1432/2874] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:06:00.124378 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce718b-9b8b-4392-9411-68e779c61021 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:06:00.125770 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-63ce718b-9b8b-4392-9411-68e779c61021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:06:00.184219 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce718b-9b8b-4392-9411-68e779c61021 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:06:00.188110 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabda6e-e440-455a-8c12-fff40fc3bf5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:06:00.188755 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabda6e-e440-455a-8c12-fff40fc3bf5c service neutron] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:06:00.189041 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabda6e-e440-455a-8c12-fff40fc3bf5c service neutron] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:06:00.189322 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabda6e-e440-455a-8c12-fff40fc3bf5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:06:00.198766 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabda6e-e440-455a-8c12-fff40fc3bf5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:06:00.200284 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabda6e-e440-455a-8c12-fff40fc3bf5c service neutron] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:06:00.209825 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1443/2875] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:06:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:06:00.463485 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da21b7-a2e5-4251-bede-b804489cb5db None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:06:00.465069 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-63da21b7-a2e5-4251-bede-b804489cb5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:06:00.477321 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da21b7-a2e5-4251-bede-b804489cb5db None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:06:00.482044 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ae13b-6dd7-43d1-afd0-f8c762ca48f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:06:00.482908 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ae13b-6dd7-43d1-afd0-f8c762ca48f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:06:00.483191 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ae13b-6dd7-43d1-afd0-f8c762ca48f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:06:00.483463 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ae13b-6dd7-43d1-afd0-f8c762ca48f0 admin admin] PATH_INFO: `/v3/projects/ae0324148d904170b97ea11375cda639` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:06:00.484848 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ae13b-6dd7-43d1-afd0-f8c762ca48f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae0324148d904170b97ea11375cda639)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:06:00.487520 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ae13b-6dd7-43d1-afd0-f8c762ca48f0 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:06:00.534466 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-833ae13b-6dd7-43d1-afd0-f8c762ca48f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae0324148d904170b97ea11375cda639', 'request_id': 'req-833ae13b-6dd7-43d1-afd0-f8c762ca48f0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:06:00.541616 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-833ae13b-6dd7-43d1-afd0-f8c762ca48f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae0324148d904170b97ea11375cda639', 'request_id': 'req-833ae13b-6dd7-43d1-afd0-f8c762ca48f0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:06:00.547266 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-833ae13b-6dd7-43d1-afd0-f8c762ca48f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae0324148d904170b97ea11375cda639', 'request_id': 'req-833ae13b-6dd7-43d1-afd0-f8c762ca48f0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:06:00.558769 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-833ae13b-6dd7-43d1-afd0-f8c762ca48f0 admin admin] The token cache is being invalidate because project ae0324148d904170b97ea11375cda639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:06:00.559055 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-833ae13b-6dd7-43d1-afd0-f8c762ca48f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:06:00.559715 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-833ae13b-6dd7-43d1-afd0-f8c762ca48f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:06:00.561255 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1433/2876] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:06:00 2022] DELETE /identity/v3/projects/ae0324148d904170b97ea11375cda639 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:06:31.138616 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabda6e-e440-455a-8c12-fff40fc3bf5c service neutron] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:06:31.140075 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-6aabda6e-e440-455a-8c12-fff40fc3bf5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:06:31.194442 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabda6e-e440-455a-8c12-fff40fc3bf5c service neutron] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:06:31.239783 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba06158-d15a-4d56-8273-198bb8e9c61c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:06:31.240414 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba06158-d15a-4d56-8273-198bb8e9c61c service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:06:31.240694 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba06158-d15a-4d56-8273-198bb8e9c61c service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:06:31.240967 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba06158-d15a-4d56-8273-198bb8e9c61c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:06:31.242717 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2ba06158-d15a-4d56-8273-198bb8e9c61c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:06:31.297139 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba06158-d15a-4d56-8273-198bb8e9c61c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:06:31.298549 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba06158-d15a-4d56-8273-198bb8e9c61c service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:06:31.307994 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1444/2877] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:06:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:06:31.408387 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dae28-6bb6-48fc-afa4-44034f739eb3 None None] REQUEST_METHOD: `POST` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:06:31.408847 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dae28-6bb6-48fc-afa4-44034f739eb3 None None] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:06:31.408953 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dae28-6bb6-48fc-afa4-44034f739eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:06:31.426933 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.auth.core [None req-400dae28-6bb6-48fc-afa4-44034f739eb3 None None] MFA Rules not processed for user `64643f7804ba42f5886f949134dd4d06`. Rule list: `[]` (Enabled: `True`). {{(pid=79786) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 14:06:31.428164 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-400dae28-6bb6-48fc-afa4-44034f739eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:06:31.435881 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1434/2878] 10.222.0.67 () {58 vars in 957 bytes} [Mon Apr 11 14:06:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 14:06:31.470327 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba06158-d15a-4d56-8273-198bb8e9c61c service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:06:31.471731 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-2ba06158-d15a-4d56-8273-198bb8e9c61c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:06:31.482995 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba06158-d15a-4d56-8273-198bb8e9c61c service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:06:31.486670 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7ff23-0222-40b7-8687-016214c7191b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2e8f671cba49969ccf9e13778b5052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:06:31.487302 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7ff23-0222-40b7-8687-016214c7191b service cinder] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:06:31.487586 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7ff23-0222-40b7-8687-016214c7191b service cinder] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:06:31.487894 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7ff23-0222-40b7-8687-016214c7191b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:06:31.489598 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e9a7ff23-0222-40b7-8687-016214c7191b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:06:31.559091 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7ff23-0222-40b7-8687-016214c7191b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:06:31.560559 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7ff23-0222-40b7-8687-016214c7191b service cinder] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:06:31.571389 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1445/2879] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:06:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:06:31.845697 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dae28-6bb6-48fc-afa4-44034f739eb3 None None] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:06:31.847093 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-400dae28-6bb6-48fc-afa4-44034f739eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:06:31.904183 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dae28-6bb6-48fc-afa4-44034f739eb3 None None] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:06:31.907672 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244d1fc-4078-47f3-bba1-b6808e1c4cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:06:31.908318 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244d1fc-4078-47f3-bba1-b6808e1c4cfe service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:06:31.908600 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244d1fc-4078-47f3-bba1-b6808e1c4cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:06:31.908881 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244d1fc-4078-47f3-bba1-b6808e1c4cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:06:31.910922 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6244d1fc-4078-47f3-bba1-b6808e1c4cfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:06:31.920876 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244d1fc-4078-47f3-bba1-b6808e1c4cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:06:31.922300 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244d1fc-4078-47f3-bba1-b6808e1c4cfe service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:06:31.930056 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1435/2880] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:06:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:06:32.623701 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7ff23-0222-40b7-8687-016214c7191b service cinder] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:06:32.625213 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-e9a7ff23-0222-40b7-8687-016214c7191b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:06:32.630248 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244d1fc-4078-47f3-bba1-b6808e1c4cfe service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:06:32.632165 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-6244d1fc-4078-47f3-bba1-b6808e1c4cfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:06:32.643198 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244d1fc-4078-47f3-bba1-b6808e1c4cfe service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:06:32.646880 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b21ab0-a9cc-401a-b43d-ebe127a9b992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:06:32.647518 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b21ab0-a9cc-401a-b43d-ebe127a9b992 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:06:32.647853 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b21ab0-a9cc-401a-b43d-ebe127a9b992 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:06:32.648130 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b21ab0-a9cc-401a-b43d-ebe127a9b992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:06:32.650046 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-b6b21ab0-a9cc-401a-b43d-ebe127a9b992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:06:32.663656 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b21ab0-a9cc-401a-b43d-ebe127a9b992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:06:32.665115 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b21ab0-a9cc-401a-b43d-ebe127a9b992 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:06:32.676037 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1436/2881] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:06:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 14:06:32.691712 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7ff23-0222-40b7-8687-016214c7191b service cinder] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:06:32.697177 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52058e9a-6fff-4355-8282-9f37097c73a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1885d4d35b6743299a73b3c12b1793b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:06:32.697812 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52058e9a-6fff-4355-8282-9f37097c73a4 service placement] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:06:32.698088 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52058e9a-6fff-4355-8282-9f37097c73a4 service placement] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:06:32.698357 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52058e9a-6fff-4355-8282-9f37097c73a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:06:32.700150 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-52058e9a-6fff-4355-8282-9f37097c73a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:06:32.711832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52058e9a-6fff-4355-8282-9f37097c73a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:06:32.713996 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52058e9a-6fff-4355-8282-9f37097c73a4 service placement] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:06:32.724527 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1446/2882] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:06:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:06:34.345305 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b21ab0-a9cc-401a-b43d-ebe127a9b992 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:06:34.354647 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b21ab0-a9cc-401a-b43d-ebe127a9b992 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:06:34.358326 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0899be5-0293-4837-b416-0f4f27c49581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:06:34.358977 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0899be5-0293-4837-b416-0f4f27c49581 service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:06:34.359260 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0899be5-0293-4837-b416-0f4f27c49581 service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:06:34.359537 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0899be5-0293-4837-b416-0f4f27c49581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:06:34.361402 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d0899be5-0293-4837-b416-0f4f27c49581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:06:34.372307 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0899be5-0293-4837-b416-0f4f27c49581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:06:34.373761 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0899be5-0293-4837-b416-0f4f27c49581 service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:06:34.382439 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1437/2883] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:06:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:06:35.035494 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52058e9a-6fff-4355-8282-9f37097c73a4 service placement] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:06:35.037291 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-52058e9a-6fff-4355-8282-9f37097c73a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:06:35.055168 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52058e9a-6fff-4355-8282-9f37097c73a4 service placement] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:06:35.061876 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885966cb-a9b5-48d8-94c9-1cdbb8bc7665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:06:35.062852 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885966cb-a9b5-48d8-94c9-1cdbb8bc7665 service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:06:35.063140 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885966cb-a9b5-48d8-94c9-1cdbb8bc7665 service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:06:35.063417 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885966cb-a9b5-48d8-94c9-1cdbb8bc7665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:06:35.065337 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-885966cb-a9b5-48d8-94c9-1cdbb8bc7665 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:06:35.079211 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885966cb-a9b5-48d8-94c9-1cdbb8bc7665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:06:35.081056 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885966cb-a9b5-48d8-94c9-1cdbb8bc7665 service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:06:35.096282 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1447/2884] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:06:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:06:39.618078 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0899be5-0293-4837-b416-0f4f27c49581 service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:06:39.619541 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-d0899be5-0293-4837-b416-0f4f27c49581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:06:39.638977 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0899be5-0293-4837-b416-0f4f27c49581 service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:06:39.644658 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a1386-9de0-4a79-abf8-85c8cd5f9de0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:06:39.645316 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a1386-9de0-4a79-abf8-85c8cd5f9de0 service nova] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:06:39.645599 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a1386-9de0-4a79-abf8-85c8cd5f9de0 service nova] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:06:39.645876 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a1386-9de0-4a79-abf8-85c8cd5f9de0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:06:39.647660 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-bd5a1386-9de0-4a79-abf8-85c8cd5f9de0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:06:39.661201 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a1386-9de0-4a79-abf8-85c8cd5f9de0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:06:39.662753 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a1386-9de0-4a79-abf8-85c8cd5f9de0 service nova] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:06:39.674547 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1438/2885] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:06:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:08:06.341872 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885966cb-a9b5-48d8-94c9-1cdbb8bc7665 service nova] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:08:06.393570 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885966cb-a9b5-48d8-94c9-1cdbb8bc7665 service nova] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:08:06.404853 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7ba15-5381-48d0-a92f-3c8e76e3a6ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fedd2314dc594bcba749bf7b0d1e50fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service', 'member', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:08:06.405742 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7ba15-5381-48d0-a92f-3c8e76e3a6ca service nova] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:08:06.406030 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7ba15-5381-48d0-a92f-3c8e76e3a6ca service nova] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:08:06.406313 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7ba15-5381-48d0-a92f-3c8e76e3a6ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:08:06.408175 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8fe7ba15-5381-48d0-a92f-3c8e76e3a6ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:08:06.444755 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7ba15-5381-48d0-a92f-3c8e76e3a6ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:08:06.450682 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7ba15-5381-48d0-a92f-3c8e76e3a6ca service nova] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:08:06.465798 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1448/2886] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:08:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:08:18.449278 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a1386-9de0-4a79-abf8-85c8cd5f9de0 service nova] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:08:18.485630 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a1386-9de0-4a79-abf8-85c8cd5f9de0 service nova] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:08:18.489151 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6845ee-a0f0-4f3a-bc09-0c93468e6f9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c084d218ea414d638ef2dc45364a492c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:08:18.489786 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6845ee-a0f0-4f3a-bc09-0c93468e6f9c service neutron] REQUEST_METHOD: `GET` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:08:18.490063 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6845ee-a0f0-4f3a-bc09-0c93468e6f9c service neutron] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:08:18.490333 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6845ee-a0f0-4f3a-bc09-0c93468e6f9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:08:18.492202 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-fb6845ee-a0f0-4f3a-bc09-0c93468e6f9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:08:18.575003 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6845ee-a0f0-4f3a-bc09-0c93468e6f9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:08:18.576539 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6845ee-a0f0-4f3a-bc09-0c93468e6f9c service neutron] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:08:18.594897 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1439/2887] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 14:08:24.889832 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7ba15-5381-48d0-a92f-3c8e76e3a6ca service nova] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:08:24.891351 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-8fe7ba15-5381-48d0-a92f-3c8e76e3a6ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:08:24.905860 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7ba15-5381-48d0-a92f-3c8e76e3a6ca service nova] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:08:24.910408 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a867029-29c4-455a-9592-198bd8b2196e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:08:24.911318 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a867029-29c4-455a-9592-198bd8b2196e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:08:24.911549 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a867029-29c4-455a-9592-198bd8b2196e admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:08:24.911868 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a867029-29c4-455a-9592-198bd8b2196e admin admin] PATH_INFO: `/v3/users/64643f7804ba42f5886f949134dd4d06` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:08:24.913041 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a867029-29c4-455a-9592-198bd8b2196e admin admin] RBAC: Authorizing `identity:delete_user(user_id=64643f7804ba42f5886f949134dd4d06)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:08:24.914947 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a867029-29c4-455a-9592-198bd8b2196e admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:08:24.962207 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4a867029-29c4-455a-9592-198bd8b2196e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64643f7804ba42f5886f949134dd4d06'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:08:24.963360 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4a867029-29c4-455a-9592-198bd8b2196e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64643f7804ba42f5886f949134dd4d06'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:08:24.969921 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4a867029-29c4-455a-9592-198bd8b2196e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64643f7804ba42f5886f949134dd4d06'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:08:24.976642 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4a867029-29c4-455a-9592-198bd8b2196e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64643f7804ba42f5886f949134dd4d06'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:08:24.977446 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-4a867029-29c4-455a-9592-198bd8b2196e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64643f7804ba42f5886f949134dd4d06'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:08:24.995078 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1449/2888] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:08:24 2022] DELETE /identity/v3/users/64643f7804ba42f5886f949134dd4d06 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:08:25.165079 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6845ee-a0f0-4f3a-bc09-0c93468e6f9c service neutron] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:08:25.176133 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6845ee-a0f0-4f3a-bc09-0c93468e6f9c service neutron] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:08:25.232860 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf48332-1c76-44b2-9ac9-b7e80a3f17e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:08:25.233714 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf48332-1c76-44b2-9ac9-b7e80a3f17e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:08:25.233989 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf48332-1c76-44b2-9ac9-b7e80a3f17e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:08:25.234256 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf48332-1c76-44b2-9ac9-b7e80a3f17e2 admin admin] PATH_INFO: `/v3/projects/40c040f0c3e74276bcab8dbc8e439de5` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:08:25.235443 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf48332-1c76-44b2-9ac9-b7e80a3f17e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c040f0c3e74276bcab8dbc8e439de5)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:08:25.237384 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf48332-1c76-44b2-9ac9-b7e80a3f17e2 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:08:25.280447 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dbf48332-1c76-44b2-9ac9-b7e80a3f17e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c040f0c3e74276bcab8dbc8e439de5', 'request_id': 'req-dbf48332-1c76-44b2-9ac9-b7e80a3f17e2'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:08:25.287461 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dbf48332-1c76-44b2-9ac9-b7e80a3f17e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c040f0c3e74276bcab8dbc8e439de5', 'request_id': 'req-dbf48332-1c76-44b2-9ac9-b7e80a3f17e2'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:08:25.293584 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dbf48332-1c76-44b2-9ac9-b7e80a3f17e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c040f0c3e74276bcab8dbc8e439de5', 'request_id': 'req-dbf48332-1c76-44b2-9ac9-b7e80a3f17e2'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:08:25.304339 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dbf48332-1c76-44b2-9ac9-b7e80a3f17e2 admin admin] The token cache is being invalidate because project 40c040f0c3e74276bcab8dbc8e439de5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:08:25.304625 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dbf48332-1c76-44b2-9ac9-b7e80a3f17e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:08:25.305241 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-dbf48332-1c76-44b2-9ac9-b7e80a3f17e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:08:25.307781 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1440/2889] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:08:25 2022] DELETE /identity/v3/projects/40c040f0c3e74276bcab8dbc8e439de5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:08:25.311730 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a867029-29c4-455a-9592-198bd8b2196e admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:08:25.313141 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-4a867029-29c4-455a-9592-198bd8b2196e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:08:25.325824 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a867029-29c4-455a-9592-198bd8b2196e admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:08:25.380389 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189829f-fa45-4902-b276-678af4503859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:08:25.381270 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189829f-fa45-4902-b276-678af4503859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:08:25.381563 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189829f-fa45-4902-b276-678af4503859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:08:25.381865 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189829f-fa45-4902-b276-678af4503859 admin admin] PATH_INFO: `/v3/users/025fc3ead3654c8989a0fdca8af5a7ef` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:08:25.383073 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189829f-fa45-4902-b276-678af4503859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=025fc3ead3654c8989a0fdca8af5a7ef)` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:08:25.385218 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189829f-fa45-4902-b276-678af4503859 admin admin] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:08:25.430737 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-7189829f-fa45-4902-b276-678af4503859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '025fc3ead3654c8989a0fdca8af5a7ef'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:08:25.431965 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-7189829f-fa45-4902-b276-678af4503859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '025fc3ead3654c8989a0fdca8af5a7ef'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:08:25.438447 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-7189829f-fa45-4902-b276-678af4503859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '025fc3ead3654c8989a0fdca8af5a7ef'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:08:25.445484 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-7189829f-fa45-4902-b276-678af4503859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '025fc3ead3654c8989a0fdca8af5a7ef'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:08:25.446134 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.notifications [None req-7189829f-fa45-4902-b276-678af4503859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '025fc3ead3654c8989a0fdca8af5a7ef'} {{(pid=79785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:08:25.462552 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1450/2890] 10.222.0.67 () {58 vars in 1223 bytes} [Mon Apr 11 14:08:25 2022] DELETE /identity/v3/users/025fc3ead3654c8989a0fdca8af5a7ef => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:08:25.631623 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf48332-1c76-44b2-9ac9-b7e80a3f17e2 admin admin] Authenticating user token {{(pid=79786) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:08:25.633170 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.fernet_utils [None req-dbf48332-1c76-44b2-9ac9-b7e80a3f17e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79786) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:08:25.652070 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf48332-1c76-44b2-9ac9-b7e80a3f17e2 admin admin] Validating token access rules against request {{(pid=79786) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:08:25.710067 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b796aa6-a850-4234-bd94-a0885080cdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8b5e2d388d34b24a1ace24c7c6fb803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ea005f626c8456495dc1d10183dc603', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79786) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:08:25.710861 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b796aa6-a850-4234-bd94-a0885080cdf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:08:25.711158 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b796aa6-a850-4234-bd94-a0885080cdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:08:25.711420 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b796aa6-a850-4234-bd94-a0885080cdf0 admin admin] PATH_INFO: `/v3/projects/3376c318d5ca400588d96924b596052c` {{(pid=79786) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:08:25.713185 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b796aa6-a850-4234-bd94-a0885080cdf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3376c318d5ca400588d96924b596052c)` {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:08:25.715260 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b796aa6-a850-4234-bd94-a0885080cdf0 admin admin] RBAC: Authorization granted {{(pid=79786) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:08:25.758494 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7b796aa6-a850-4234-bd94-a0885080cdf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3376c318d5ca400588d96924b596052c', 'request_id': 'req-7b796aa6-a850-4234-bd94-a0885080cdf0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:08:25.765615 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7b796aa6-a850-4234-bd94-a0885080cdf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3376c318d5ca400588d96924b596052c', 'request_id': 'req-7b796aa6-a850-4234-bd94-a0885080cdf0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:08:25.770845 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7b796aa6-a850-4234-bd94-a0885080cdf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3376c318d5ca400588d96924b596052c', 'request_id': 'req-7b796aa6-a850-4234-bd94-a0885080cdf0'} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:08:25.782588 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7b796aa6-a850-4234-bd94-a0885080cdf0 admin admin] The token cache is being invalidate because project 3376c318d5ca400588d96924b596052c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79786) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 14:08:25.782883 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7b796aa6-a850-4234-bd94-a0885080cdf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:08:25.783526 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: DEBUG keystone.notifications [None req-7b796aa6-a850-4234-bd94-a0885080cdf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79786) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 14:08:25.800739 dv-cinder-830787-2-iscsi devstack@keystone.service[79786]: [pid: 79786|app: 0|req: 1441/2891] 10.222.0.67 () {58 vars in 1232 bytes} [Mon Apr 11 14:08:25 2022] DELETE /identity/v3/projects/3376c318d5ca400588d96924b596052c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 14:08:37.736251 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189829f-fa45-4902-b276-678af4503859 admin admin] Authenticating user token {{(pid=79785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 14:08:37.737772 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7189829f-fa45-4902-b276-678af4503859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:08:37.827149 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189829f-fa45-4902-b276-678af4503859 admin admin] Validating token access rules against request {{(pid=79785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 14:08:37.882654 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b110a87-c1d3-4c3d-8a92-bcdf60e434f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1885d4d35b6743299a73b3c12b1793b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd46063ee60fd4f6dba86d1c5946e9381', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 14:08:37.883301 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b110a87-c1d3-4c3d-8a92-bcdf60e434f2 service placement] REQUEST_METHOD: `GET` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 14:08:37.883588 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b110a87-c1d3-4c3d-8a92-bcdf60e434f2 service placement] SCRIPT_NAME: `/identity` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 14:08:37.883898 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b110a87-c1d3-4c3d-8a92-bcdf60e434f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 14:08:37.886421 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.fernet_utils [None req-7b110a87-c1d3-4c3d-8a92-bcdf60e434f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 14:08:37.897431 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b110a87-c1d3-4c3d-8a92-bcdf60e434f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 14:08:37.898999 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b110a87-c1d3-4c3d-8a92-bcdf60e434f2 service placement] RBAC: Authorization granted {{(pid=79785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 14:08:37.908896 dv-cinder-830787-2-iscsi devstack@keystone.service[79785]: [pid: 79785|app: 0|req: 1451/2892] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Apr 11 14:08:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)